00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2418 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3679 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.133 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.133 The recommended git tool is: git 00:00:00.134 using credential 00000000-0000-0000-0000-000000000002 00:00:00.142 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.169 Fetching changes from the remote Git repository 00:00:00.172 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.205 Using shallow fetch with depth 1 00:00:00.205 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.205 > git --version # timeout=10 00:00:00.234 > git --version # 'git version 2.39.2' 00:00:00.234 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.256 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.256 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:08.349 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:08.358 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:08.368 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:08.368 > git config core.sparsecheckout # timeout=10 00:00:08.378 > git read-tree -mu HEAD # timeout=10 00:00:08.391 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:08.410 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:08.411 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:08.485 [Pipeline] Start of Pipeline 00:00:08.499 [Pipeline] library 00:00:08.501 Loading library shm_lib@master 00:00:08.501 Library shm_lib@master is cached. Copying from home. 00:00:08.518 [Pipeline] node 00:00:08.536 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:08.538 [Pipeline] { 00:00:08.550 [Pipeline] catchError 00:00:08.552 [Pipeline] { 00:00:08.566 [Pipeline] wrap 00:00:08.575 [Pipeline] { 00:00:08.582 [Pipeline] stage 00:00:08.584 [Pipeline] { (Prologue) 00:00:08.779 [Pipeline] sh 00:00:09.634 + logger -p user.info -t JENKINS-CI 00:00:09.660 [Pipeline] echo 00:00:09.662 Node: GP11 00:00:09.670 [Pipeline] sh 00:00:10.004 [Pipeline] setCustomBuildProperty 00:00:10.019 [Pipeline] echo 00:00:10.021 Cleanup processes 00:00:10.027 [Pipeline] sh 00:00:10.323 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:10.323 6619 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:10.339 [Pipeline] sh 00:00:10.632 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:10.632 ++ grep -v 'sudo pgrep' 00:00:10.632 ++ awk '{print $1}' 00:00:10.632 + sudo kill -9 00:00:10.632 + true 00:00:10.650 [Pipeline] cleanWs 00:00:10.662 [WS-CLEANUP] Deleting project workspace... 00:00:10.662 [WS-CLEANUP] Deferred wipeout is used... 00:00:10.677 [WS-CLEANUP] done 00:00:10.684 [Pipeline] setCustomBuildProperty 00:00:10.699 [Pipeline] sh 00:00:10.992 + sudo git config --global --replace-all safe.directory '*' 00:00:11.115 [Pipeline] httpRequest 00:00:13.448 [Pipeline] echo 00:00:13.451 Sorcerer 10.211.164.20 is alive 00:00:13.463 [Pipeline] retry 00:00:13.465 [Pipeline] { 00:00:13.481 [Pipeline] httpRequest 00:00:13.487 HttpMethod: GET 00:00:13.487 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.489 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.513 Response Code: HTTP/1.1 200 OK 00:00:13.513 Success: Status code 200 is in the accepted range: 200,404 00:00:13.514 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:43.226 [Pipeline] } 00:00:43.240 [Pipeline] // retry 00:00:43.247 [Pipeline] sh 00:00:43.538 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:43.559 [Pipeline] httpRequest 00:00:43.950 [Pipeline] echo 00:00:43.952 Sorcerer 10.211.164.20 is alive 00:00:43.960 [Pipeline] retry 00:00:43.962 [Pipeline] { 00:00:43.975 [Pipeline] httpRequest 00:00:43.980 HttpMethod: GET 00:00:43.980 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:43.981 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:43.997 Response Code: HTTP/1.1 200 OK 00:00:43.997 Success: Status code 200 is in the accepted range: 200,404 00:00:43.997 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:16.962 [Pipeline] } 00:01:16.980 [Pipeline] // retry 00:01:16.988 [Pipeline] sh 00:01:17.285 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:20.612 [Pipeline] sh 00:01:20.904 + git -C spdk log --oneline -n5 00:01:20.904 c13c99a5e test: Various fixes for Fedora40 00:01:20.904 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:20.904 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:20.904 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:20.904 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:20.917 [Pipeline] } 00:01:20.932 [Pipeline] // stage 00:01:20.941 [Pipeline] stage 00:01:20.944 [Pipeline] { (Prepare) 00:01:20.961 [Pipeline] writeFile 00:01:20.977 [Pipeline] sh 00:01:21.268 + logger -p user.info -t JENKINS-CI 00:01:21.283 [Pipeline] sh 00:01:21.572 + logger -p user.info -t JENKINS-CI 00:01:21.587 [Pipeline] sh 00:01:21.877 + cat autorun-spdk.conf 00:01:21.877 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:21.877 SPDK_TEST_NVMF=1 00:01:21.877 SPDK_TEST_NVME_CLI=1 00:01:21.877 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:21.877 SPDK_TEST_NVMF_NICS=e810 00:01:21.877 SPDK_RUN_UBSAN=1 00:01:21.877 NET_TYPE=phy 00:01:21.887 RUN_NIGHTLY=1 00:01:21.892 [Pipeline] readFile 00:01:21.947 [Pipeline] withEnv 00:01:21.949 [Pipeline] { 00:01:21.962 [Pipeline] sh 00:01:22.256 + set -ex 00:01:22.256 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:22.256 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:22.256 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:22.256 ++ SPDK_TEST_NVMF=1 00:01:22.256 ++ SPDK_TEST_NVME_CLI=1 00:01:22.256 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:22.256 ++ SPDK_TEST_NVMF_NICS=e810 00:01:22.256 ++ SPDK_RUN_UBSAN=1 00:01:22.256 ++ NET_TYPE=phy 00:01:22.256 ++ RUN_NIGHTLY=1 00:01:22.256 + case $SPDK_TEST_NVMF_NICS in 00:01:22.256 + DRIVERS=ice 00:01:22.256 + [[ tcp == \r\d\m\a ]] 00:01:22.256 + [[ -n ice ]] 00:01:22.256 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:22.256 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:25.565 rmmod: ERROR: Module irdma is not currently loaded 00:01:25.565 rmmod: ERROR: Module i40iw is not currently loaded 00:01:25.565 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:25.565 + true 00:01:25.565 + for D in $DRIVERS 00:01:25.565 + sudo modprobe ice 00:01:25.565 + exit 0 00:01:25.577 [Pipeline] } 00:01:25.591 [Pipeline] // withEnv 00:01:25.597 [Pipeline] } 00:01:25.610 [Pipeline] // stage 00:01:25.620 [Pipeline] catchError 00:01:25.622 [Pipeline] { 00:01:25.636 [Pipeline] timeout 00:01:25.636 Timeout set to expire in 1 hr 0 min 00:01:25.638 [Pipeline] { 00:01:25.652 [Pipeline] stage 00:01:25.654 [Pipeline] { (Tests) 00:01:25.668 [Pipeline] sh 00:01:25.962 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.962 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.962 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.962 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:25.962 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.962 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:25.962 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:25.962 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:25.962 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:25.962 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:25.962 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:25.962 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.962 + source /etc/os-release 00:01:25.962 ++ NAME='Fedora Linux' 00:01:25.963 ++ VERSION='39 (Cloud Edition)' 00:01:25.963 ++ ID=fedora 00:01:25.963 ++ VERSION_ID=39 00:01:25.963 ++ VERSION_CODENAME= 00:01:25.963 ++ PLATFORM_ID=platform:f39 00:01:25.963 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:25.963 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:25.963 ++ LOGO=fedora-logo-icon 00:01:25.963 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:25.963 ++ HOME_URL=https://fedoraproject.org/ 00:01:25.963 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:25.963 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:25.963 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:25.963 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:25.963 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:25.963 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:25.963 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:25.963 ++ SUPPORT_END=2024-11-12 00:01:25.963 ++ VARIANT='Cloud Edition' 00:01:25.963 ++ VARIANT_ID=cloud 00:01:25.963 + uname -a 00:01:25.963 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:25.963 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:26.904 Hugepages 00:01:26.904 node hugesize free / total 00:01:26.904 node0 1048576kB 0 / 0 00:01:26.904 node0 2048kB 0 / 0 00:01:26.904 node1 1048576kB 0 / 0 00:01:26.904 node1 2048kB 0 / 0 00:01:26.904 00:01:26.904 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:26.904 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:26.904 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:26.904 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:26.904 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:26.904 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:26.904 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:26.904 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:26.904 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:26.904 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:26.904 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:26.904 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:26.904 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:26.904 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:26.904 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:26.904 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:26.904 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:27.164 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:27.164 + rm -f /tmp/spdk-ld-path 00:01:27.164 + source autorun-spdk.conf 00:01:27.164 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:27.164 ++ SPDK_TEST_NVMF=1 00:01:27.164 ++ SPDK_TEST_NVME_CLI=1 00:01:27.164 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:27.164 ++ SPDK_TEST_NVMF_NICS=e810 00:01:27.164 ++ SPDK_RUN_UBSAN=1 00:01:27.164 ++ NET_TYPE=phy 00:01:27.164 ++ RUN_NIGHTLY=1 00:01:27.164 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:27.164 + [[ -n '' ]] 00:01:27.164 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:27.164 + for M in /var/spdk/build-*-manifest.txt 00:01:27.164 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:27.164 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:27.164 + for M in /var/spdk/build-*-manifest.txt 00:01:27.164 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:27.164 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:27.164 + for M in /var/spdk/build-*-manifest.txt 00:01:27.164 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:27.164 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:27.164 ++ uname 00:01:27.164 + [[ Linux == \L\i\n\u\x ]] 00:01:27.164 + sudo dmesg -T 00:01:27.164 + sudo dmesg --clear 00:01:27.164 + dmesg_pid=7313 00:01:27.164 + [[ Fedora Linux == FreeBSD ]] 00:01:27.164 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:27.164 + sudo dmesg -Tw 00:01:27.164 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:27.164 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:27.164 + [[ -x /usr/src/fio-static/fio ]] 00:01:27.165 + export FIO_BIN=/usr/src/fio-static/fio 00:01:27.165 + FIO_BIN=/usr/src/fio-static/fio 00:01:27.165 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:27.165 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:27.165 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:27.165 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:27.165 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:27.165 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:27.165 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:27.165 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:27.165 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:27.165 Test configuration: 00:01:27.165 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:27.165 SPDK_TEST_NVMF=1 00:01:27.165 SPDK_TEST_NVME_CLI=1 00:01:27.165 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:27.165 SPDK_TEST_NVMF_NICS=e810 00:01:27.165 SPDK_RUN_UBSAN=1 00:01:27.165 NET_TYPE=phy 00:01:27.165 RUN_NIGHTLY=1 16:43:38 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:27.165 16:43:38 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:27.165 16:43:38 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:27.165 16:43:38 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:27.165 16:43:38 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:27.165 16:43:38 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:27.165 16:43:38 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:27.165 16:43:38 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:27.165 16:43:38 -- paths/export.sh@5 -- $ export PATH 00:01:27.165 16:43:38 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:27.165 16:43:38 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:27.165 16:43:38 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:27.165 16:43:38 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732895018.XXXXXX 00:01:27.165 16:43:38 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732895018.O8KVBs 00:01:27.165 16:43:38 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:27.165 16:43:38 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:27.165 16:43:38 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:27.165 16:43:38 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:27.165 16:43:38 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:27.165 16:43:38 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:27.165 16:43:38 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:27.165 16:43:38 -- common/autotest_common.sh@10 -- $ set +x 00:01:27.165 16:43:38 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:27.165 16:43:38 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:27.165 16:43:38 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:27.165 16:43:38 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:27.165 16:43:38 -- spdk/autobuild.sh@16 -- $ date -u 00:01:27.165 Fri Nov 29 03:43:38 PM UTC 2024 00:01:27.165 16:43:38 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:27.165 LTS-67-gc13c99a5e 00:01:27.165 16:43:38 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:27.165 16:43:38 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:27.165 16:43:38 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:27.165 16:43:38 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:27.165 16:43:38 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:27.165 16:43:38 -- common/autotest_common.sh@10 -- $ set +x 00:01:27.165 ************************************ 00:01:27.165 START TEST ubsan 00:01:27.165 ************************************ 00:01:27.165 16:43:38 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:27.165 using ubsan 00:01:27.165 00:01:27.165 real 0m0.000s 00:01:27.165 user 0m0.000s 00:01:27.165 sys 0m0.000s 00:01:27.165 16:43:38 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:27.165 16:43:38 -- common/autotest_common.sh@10 -- $ set +x 00:01:27.165 ************************************ 00:01:27.165 END TEST ubsan 00:01:27.165 ************************************ 00:01:27.165 16:43:38 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:27.165 16:43:38 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:27.165 16:43:38 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:27.165 16:43:38 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:27.165 16:43:38 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:27.165 16:43:38 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:27.165 16:43:38 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:27.165 16:43:38 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:27.165 16:43:38 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:27.425 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:27.425 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:28.808 Using 'verbs' RDMA provider 00:01:44.278 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:52.436 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:52.436 Creating mk/config.mk...done. 00:01:52.436 Creating mk/cc.flags.mk...done. 00:01:52.436 Type 'make' to build. 00:01:52.436 16:44:03 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:52.436 16:44:03 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:52.436 16:44:03 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:52.436 16:44:03 -- common/autotest_common.sh@10 -- $ set +x 00:01:52.436 ************************************ 00:01:52.436 START TEST make 00:01:52.436 ************************************ 00:01:52.437 16:44:03 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:52.697 make[1]: Nothing to be done for 'all'. 00:02:02.728 The Meson build system 00:02:02.728 Version: 1.5.0 00:02:02.728 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:02:02.728 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:02:02.728 Build type: native build 00:02:02.728 Program cat found: YES (/usr/bin/cat) 00:02:02.728 Project name: DPDK 00:02:02.728 Project version: 23.11.0 00:02:02.728 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:02:02.728 C linker for the host machine: cc ld.bfd 2.40-14 00:02:02.728 Host machine cpu family: x86_64 00:02:02.728 Host machine cpu: x86_64 00:02:02.728 Message: ## Building in Developer Mode ## 00:02:02.728 Program pkg-config found: YES (/usr/bin/pkg-config) 00:02:02.728 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:02:02.728 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:02:02.728 Program python3 found: YES (/usr/bin/python3) 00:02:02.728 Program cat found: YES (/usr/bin/cat) 00:02:02.728 Compiler for C supports arguments -march=native: YES 00:02:02.728 Checking for size of "void *" : 8 00:02:02.728 Checking for size of "void *" : 8 (cached) 00:02:02.728 Library m found: YES 00:02:02.728 Library numa found: YES 00:02:02.728 Has header "numaif.h" : YES 00:02:02.728 Library fdt found: NO 00:02:02.728 Library execinfo found: NO 00:02:02.728 Has header "execinfo.h" : YES 00:02:02.728 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:02:02.728 Run-time dependency libarchive found: NO (tried pkgconfig) 00:02:02.728 Run-time dependency libbsd found: NO (tried pkgconfig) 00:02:02.728 Run-time dependency jansson found: NO (tried pkgconfig) 00:02:02.728 Run-time dependency openssl found: YES 3.1.1 00:02:02.728 Run-time dependency libpcap found: YES 1.10.4 00:02:02.728 Has header "pcap.h" with dependency libpcap: YES 00:02:02.728 Compiler for C supports arguments -Wcast-qual: YES 00:02:02.728 Compiler for C supports arguments -Wdeprecated: YES 00:02:02.728 Compiler for C supports arguments -Wformat: YES 00:02:02.728 Compiler for C supports arguments -Wformat-nonliteral: NO 00:02:02.728 Compiler for C supports arguments -Wformat-security: NO 00:02:02.728 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:02.728 Compiler for C supports arguments -Wmissing-prototypes: YES 00:02:02.728 Compiler for C supports arguments -Wnested-externs: YES 00:02:02.728 Compiler for C supports arguments -Wold-style-definition: YES 00:02:02.728 Compiler for C supports arguments -Wpointer-arith: YES 00:02:02.728 Compiler for C supports arguments -Wsign-compare: YES 00:02:02.728 Compiler for C supports arguments -Wstrict-prototypes: YES 00:02:02.728 Compiler for C supports arguments -Wundef: YES 00:02:02.728 Compiler for C supports arguments -Wwrite-strings: YES 00:02:02.728 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:02:02.728 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:02:02.728 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:02.728 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:02:02.728 Program objdump found: YES (/usr/bin/objdump) 00:02:02.728 Compiler for C supports arguments -mavx512f: YES 00:02:02.728 Checking if "AVX512 checking" compiles: YES 00:02:02.728 Fetching value of define "__SSE4_2__" : 1 00:02:02.728 Fetching value of define "__AES__" : 1 00:02:02.728 Fetching value of define "__AVX__" : 1 00:02:02.728 Fetching value of define "__AVX2__" : (undefined) 00:02:02.728 Fetching value of define "__AVX512BW__" : (undefined) 00:02:02.728 Fetching value of define "__AVX512CD__" : (undefined) 00:02:02.728 Fetching value of define "__AVX512DQ__" : (undefined) 00:02:02.728 Fetching value of define "__AVX512F__" : (undefined) 00:02:02.728 Fetching value of define "__AVX512VL__" : (undefined) 00:02:02.728 Fetching value of define "__PCLMUL__" : 1 00:02:02.728 Fetching value of define "__RDRND__" : 1 00:02:02.728 Fetching value of define "__RDSEED__" : (undefined) 00:02:02.728 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:02:02.728 Fetching value of define "__znver1__" : (undefined) 00:02:02.728 Fetching value of define "__znver2__" : (undefined) 00:02:02.728 Fetching value of define "__znver3__" : (undefined) 00:02:02.728 Fetching value of define "__znver4__" : (undefined) 00:02:02.728 Compiler for C supports arguments -Wno-format-truncation: YES 00:02:02.728 Message: lib/log: Defining dependency "log" 00:02:02.728 Message: lib/kvargs: Defining dependency "kvargs" 00:02:02.728 Message: lib/telemetry: Defining dependency "telemetry" 00:02:02.728 Checking for function "getentropy" : NO 00:02:02.728 Message: lib/eal: Defining dependency "eal" 00:02:02.728 Message: lib/ring: Defining dependency "ring" 00:02:02.728 Message: lib/rcu: Defining dependency "rcu" 00:02:02.728 Message: lib/mempool: Defining dependency "mempool" 00:02:02.728 Message: lib/mbuf: Defining dependency "mbuf" 00:02:02.728 Fetching value of define "__PCLMUL__" : 1 (cached) 00:02:02.728 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:02:02.728 Compiler for C supports arguments -mpclmul: YES 00:02:02.728 Compiler for C supports arguments -maes: YES 00:02:02.728 Compiler for C supports arguments -mavx512f: YES (cached) 00:02:02.728 Compiler for C supports arguments -mavx512bw: YES 00:02:02.728 Compiler for C supports arguments -mavx512dq: YES 00:02:02.728 Compiler for C supports arguments -mavx512vl: YES 00:02:02.728 Compiler for C supports arguments -mvpclmulqdq: YES 00:02:02.728 Compiler for C supports arguments -mavx2: YES 00:02:02.728 Compiler for C supports arguments -mavx: YES 00:02:02.728 Message: lib/net: Defining dependency "net" 00:02:02.728 Message: lib/meter: Defining dependency "meter" 00:02:02.728 Message: lib/ethdev: Defining dependency "ethdev" 00:02:02.728 Message: lib/pci: Defining dependency "pci" 00:02:02.728 Message: lib/cmdline: Defining dependency "cmdline" 00:02:02.728 Message: lib/hash: Defining dependency "hash" 00:02:02.728 Message: lib/timer: Defining dependency "timer" 00:02:02.728 Message: lib/compressdev: Defining dependency "compressdev" 00:02:02.728 Message: lib/cryptodev: Defining dependency "cryptodev" 00:02:02.728 Message: lib/dmadev: Defining dependency "dmadev" 00:02:02.728 Compiler for C supports arguments -Wno-cast-qual: YES 00:02:02.729 Message: lib/power: Defining dependency "power" 00:02:02.729 Message: lib/reorder: Defining dependency "reorder" 00:02:02.729 Message: lib/security: Defining dependency "security" 00:02:02.729 Has header "linux/userfaultfd.h" : YES 00:02:02.729 Has header "linux/vduse.h" : YES 00:02:02.729 Message: lib/vhost: Defining dependency "vhost" 00:02:02.729 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:02:02.729 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:02:02.729 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:02:02.729 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:02:02.729 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:02:02.729 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:02:02.729 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:02:02.729 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:02:02.729 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:02:02.729 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:02:02.729 Program doxygen found: YES (/usr/local/bin/doxygen) 00:02:02.729 Configuring doxy-api-html.conf using configuration 00:02:02.729 Configuring doxy-api-man.conf using configuration 00:02:02.729 Program mandb found: YES (/usr/bin/mandb) 00:02:02.729 Program sphinx-build found: NO 00:02:02.729 Configuring rte_build_config.h using configuration 00:02:02.729 Message: 00:02:02.729 ================= 00:02:02.729 Applications Enabled 00:02:02.729 ================= 00:02:02.729 00:02:02.729 apps: 00:02:02.729 00:02:02.729 00:02:02.729 Message: 00:02:02.729 ================= 00:02:02.729 Libraries Enabled 00:02:02.729 ================= 00:02:02.729 00:02:02.729 libs: 00:02:02.729 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:02:02.729 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:02:02.729 cryptodev, dmadev, power, reorder, security, vhost, 00:02:02.729 00:02:02.729 Message: 00:02:02.729 =============== 00:02:02.729 Drivers Enabled 00:02:02.729 =============== 00:02:02.729 00:02:02.729 common: 00:02:02.729 00:02:02.729 bus: 00:02:02.729 pci, vdev, 00:02:02.729 mempool: 00:02:02.729 ring, 00:02:02.729 dma: 00:02:02.729 00:02:02.729 net: 00:02:02.729 00:02:02.729 crypto: 00:02:02.729 00:02:02.729 compress: 00:02:02.729 00:02:02.729 vdpa: 00:02:02.729 00:02:02.729 00:02:02.729 Message: 00:02:02.729 ================= 00:02:02.729 Content Skipped 00:02:02.729 ================= 00:02:02.729 00:02:02.729 apps: 00:02:02.729 dumpcap: explicitly disabled via build config 00:02:02.729 graph: explicitly disabled via build config 00:02:02.729 pdump: explicitly disabled via build config 00:02:02.729 proc-info: explicitly disabled via build config 00:02:02.729 test-acl: explicitly disabled via build config 00:02:02.729 test-bbdev: explicitly disabled via build config 00:02:02.729 test-cmdline: explicitly disabled via build config 00:02:02.729 test-compress-perf: explicitly disabled via build config 00:02:02.729 test-crypto-perf: explicitly disabled via build config 00:02:02.729 test-dma-perf: explicitly disabled via build config 00:02:02.729 test-eventdev: explicitly disabled via build config 00:02:02.729 test-fib: explicitly disabled via build config 00:02:02.729 test-flow-perf: explicitly disabled via build config 00:02:02.729 test-gpudev: explicitly disabled via build config 00:02:02.729 test-mldev: explicitly disabled via build config 00:02:02.729 test-pipeline: explicitly disabled via build config 00:02:02.729 test-pmd: explicitly disabled via build config 00:02:02.729 test-regex: explicitly disabled via build config 00:02:02.729 test-sad: explicitly disabled via build config 00:02:02.729 test-security-perf: explicitly disabled via build config 00:02:02.729 00:02:02.729 libs: 00:02:02.729 metrics: explicitly disabled via build config 00:02:02.729 acl: explicitly disabled via build config 00:02:02.729 bbdev: explicitly disabled via build config 00:02:02.729 bitratestats: explicitly disabled via build config 00:02:02.729 bpf: explicitly disabled via build config 00:02:02.729 cfgfile: explicitly disabled via build config 00:02:02.729 distributor: explicitly disabled via build config 00:02:02.729 efd: explicitly disabled via build config 00:02:02.729 eventdev: explicitly disabled via build config 00:02:02.729 dispatcher: explicitly disabled via build config 00:02:02.729 gpudev: explicitly disabled via build config 00:02:02.729 gro: explicitly disabled via build config 00:02:02.729 gso: explicitly disabled via build config 00:02:02.729 ip_frag: explicitly disabled via build config 00:02:02.729 jobstats: explicitly disabled via build config 00:02:02.729 latencystats: explicitly disabled via build config 00:02:02.729 lpm: explicitly disabled via build config 00:02:02.729 member: explicitly disabled via build config 00:02:02.729 pcapng: explicitly disabled via build config 00:02:02.729 rawdev: explicitly disabled via build config 00:02:02.729 regexdev: explicitly disabled via build config 00:02:02.729 mldev: explicitly disabled via build config 00:02:02.729 rib: explicitly disabled via build config 00:02:02.729 sched: explicitly disabled via build config 00:02:02.729 stack: explicitly disabled via build config 00:02:02.729 ipsec: explicitly disabled via build config 00:02:02.729 pdcp: explicitly disabled via build config 00:02:02.729 fib: explicitly disabled via build config 00:02:02.729 port: explicitly disabled via build config 00:02:02.729 pdump: explicitly disabled via build config 00:02:02.729 table: explicitly disabled via build config 00:02:02.729 pipeline: explicitly disabled via build config 00:02:02.729 graph: explicitly disabled via build config 00:02:02.729 node: explicitly disabled via build config 00:02:02.729 00:02:02.729 drivers: 00:02:02.729 common/cpt: not in enabled drivers build config 00:02:02.729 common/dpaax: not in enabled drivers build config 00:02:02.729 common/iavf: not in enabled drivers build config 00:02:02.729 common/idpf: not in enabled drivers build config 00:02:02.729 common/mvep: not in enabled drivers build config 00:02:02.729 common/octeontx: not in enabled drivers build config 00:02:02.729 bus/auxiliary: not in enabled drivers build config 00:02:02.729 bus/cdx: not in enabled drivers build config 00:02:02.729 bus/dpaa: not in enabled drivers build config 00:02:02.729 bus/fslmc: not in enabled drivers build config 00:02:02.729 bus/ifpga: not in enabled drivers build config 00:02:02.729 bus/platform: not in enabled drivers build config 00:02:02.729 bus/vmbus: not in enabled drivers build config 00:02:02.729 common/cnxk: not in enabled drivers build config 00:02:02.729 common/mlx5: not in enabled drivers build config 00:02:02.729 common/nfp: not in enabled drivers build config 00:02:02.729 common/qat: not in enabled drivers build config 00:02:02.729 common/sfc_efx: not in enabled drivers build config 00:02:02.729 mempool/bucket: not in enabled drivers build config 00:02:02.729 mempool/cnxk: not in enabled drivers build config 00:02:02.729 mempool/dpaa: not in enabled drivers build config 00:02:02.729 mempool/dpaa2: not in enabled drivers build config 00:02:02.729 mempool/octeontx: not in enabled drivers build config 00:02:02.729 mempool/stack: not in enabled drivers build config 00:02:02.729 dma/cnxk: not in enabled drivers build config 00:02:02.730 dma/dpaa: not in enabled drivers build config 00:02:02.730 dma/dpaa2: not in enabled drivers build config 00:02:02.730 dma/hisilicon: not in enabled drivers build config 00:02:02.730 dma/idxd: not in enabled drivers build config 00:02:02.730 dma/ioat: not in enabled drivers build config 00:02:02.730 dma/skeleton: not in enabled drivers build config 00:02:02.730 net/af_packet: not in enabled drivers build config 00:02:02.730 net/af_xdp: not in enabled drivers build config 00:02:02.730 net/ark: not in enabled drivers build config 00:02:02.730 net/atlantic: not in enabled drivers build config 00:02:02.730 net/avp: not in enabled drivers build config 00:02:02.730 net/axgbe: not in enabled drivers build config 00:02:02.730 net/bnx2x: not in enabled drivers build config 00:02:02.730 net/bnxt: not in enabled drivers build config 00:02:02.730 net/bonding: not in enabled drivers build config 00:02:02.730 net/cnxk: not in enabled drivers build config 00:02:02.730 net/cpfl: not in enabled drivers build config 00:02:02.730 net/cxgbe: not in enabled drivers build config 00:02:02.730 net/dpaa: not in enabled drivers build config 00:02:02.730 net/dpaa2: not in enabled drivers build config 00:02:02.730 net/e1000: not in enabled drivers build config 00:02:02.730 net/ena: not in enabled drivers build config 00:02:02.730 net/enetc: not in enabled drivers build config 00:02:02.730 net/enetfec: not in enabled drivers build config 00:02:02.730 net/enic: not in enabled drivers build config 00:02:02.730 net/failsafe: not in enabled drivers build config 00:02:02.730 net/fm10k: not in enabled drivers build config 00:02:02.730 net/gve: not in enabled drivers build config 00:02:02.730 net/hinic: not in enabled drivers build config 00:02:02.730 net/hns3: not in enabled drivers build config 00:02:02.730 net/i40e: not in enabled drivers build config 00:02:02.730 net/iavf: not in enabled drivers build config 00:02:02.730 net/ice: not in enabled drivers build config 00:02:02.730 net/idpf: not in enabled drivers build config 00:02:02.730 net/igc: not in enabled drivers build config 00:02:02.730 net/ionic: not in enabled drivers build config 00:02:02.730 net/ipn3ke: not in enabled drivers build config 00:02:02.730 net/ixgbe: not in enabled drivers build config 00:02:02.730 net/mana: not in enabled drivers build config 00:02:02.730 net/memif: not in enabled drivers build config 00:02:02.730 net/mlx4: not in enabled drivers build config 00:02:02.730 net/mlx5: not in enabled drivers build config 00:02:02.730 net/mvneta: not in enabled drivers build config 00:02:02.730 net/mvpp2: not in enabled drivers build config 00:02:02.730 net/netvsc: not in enabled drivers build config 00:02:02.730 net/nfb: not in enabled drivers build config 00:02:02.730 net/nfp: not in enabled drivers build config 00:02:02.730 net/ngbe: not in enabled drivers build config 00:02:02.730 net/null: not in enabled drivers build config 00:02:02.730 net/octeontx: not in enabled drivers build config 00:02:02.730 net/octeon_ep: not in enabled drivers build config 00:02:02.730 net/pcap: not in enabled drivers build config 00:02:02.730 net/pfe: not in enabled drivers build config 00:02:02.730 net/qede: not in enabled drivers build config 00:02:02.730 net/ring: not in enabled drivers build config 00:02:02.730 net/sfc: not in enabled drivers build config 00:02:02.730 net/softnic: not in enabled drivers build config 00:02:02.730 net/tap: not in enabled drivers build config 00:02:02.730 net/thunderx: not in enabled drivers build config 00:02:02.730 net/txgbe: not in enabled drivers build config 00:02:02.730 net/vdev_netvsc: not in enabled drivers build config 00:02:02.730 net/vhost: not in enabled drivers build config 00:02:02.730 net/virtio: not in enabled drivers build config 00:02:02.730 net/vmxnet3: not in enabled drivers build config 00:02:02.730 raw/*: missing internal dependency, "rawdev" 00:02:02.730 crypto/armv8: not in enabled drivers build config 00:02:02.730 crypto/bcmfs: not in enabled drivers build config 00:02:02.730 crypto/caam_jr: not in enabled drivers build config 00:02:02.730 crypto/ccp: not in enabled drivers build config 00:02:02.730 crypto/cnxk: not in enabled drivers build config 00:02:02.730 crypto/dpaa_sec: not in enabled drivers build config 00:02:02.730 crypto/dpaa2_sec: not in enabled drivers build config 00:02:02.730 crypto/ipsec_mb: not in enabled drivers build config 00:02:02.730 crypto/mlx5: not in enabled drivers build config 00:02:02.730 crypto/mvsam: not in enabled drivers build config 00:02:02.730 crypto/nitrox: not in enabled drivers build config 00:02:02.730 crypto/null: not in enabled drivers build config 00:02:02.730 crypto/octeontx: not in enabled drivers build config 00:02:02.730 crypto/openssl: not in enabled drivers build config 00:02:02.730 crypto/scheduler: not in enabled drivers build config 00:02:02.730 crypto/uadk: not in enabled drivers build config 00:02:02.730 crypto/virtio: not in enabled drivers build config 00:02:02.730 compress/isal: not in enabled drivers build config 00:02:02.730 compress/mlx5: not in enabled drivers build config 00:02:02.730 compress/octeontx: not in enabled drivers build config 00:02:02.730 compress/zlib: not in enabled drivers build config 00:02:02.730 regex/*: missing internal dependency, "regexdev" 00:02:02.730 ml/*: missing internal dependency, "mldev" 00:02:02.730 vdpa/ifc: not in enabled drivers build config 00:02:02.730 vdpa/mlx5: not in enabled drivers build config 00:02:02.730 vdpa/nfp: not in enabled drivers build config 00:02:02.730 vdpa/sfc: not in enabled drivers build config 00:02:02.730 event/*: missing internal dependency, "eventdev" 00:02:02.730 baseband/*: missing internal dependency, "bbdev" 00:02:02.730 gpu/*: missing internal dependency, "gpudev" 00:02:02.730 00:02:02.730 00:02:02.730 Build targets in project: 85 00:02:02.730 00:02:02.730 DPDK 23.11.0 00:02:02.730 00:02:02.730 User defined options 00:02:02.730 buildtype : debug 00:02:02.730 default_library : shared 00:02:02.730 libdir : lib 00:02:02.730 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:02:02.730 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:02:02.730 c_link_args : 00:02:02.730 cpu_instruction_set: native 00:02:02.730 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:02:02.730 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:02:02.730 enable_docs : false 00:02:02.730 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:02:02.730 enable_kmods : false 00:02:02.730 tests : false 00:02:02.730 00:02:02.730 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:02.730 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:02:02.730 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:02:02.730 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:02:02.730 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:02:02.730 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:02:02.730 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:02:02.730 [6/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:02:02.730 [7/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:02:02.730 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:02:02.730 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:02:02.730 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:02:03.016 [11/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:02:03.016 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:02:03.016 [13/265] Linking static target lib/librte_kvargs.a 00:02:03.016 [14/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:02:03.016 [15/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:02:03.016 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:02:03.016 [17/265] Linking static target lib/librte_log.a 00:02:03.016 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:02:03.016 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:02:03.016 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:02:03.016 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:02:03.594 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.594 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:02:03.594 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:02:03.594 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:02:03.594 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:02:03.594 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:02:03.594 [28/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:02:03.594 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:02:03.594 [30/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:02:03.594 [31/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:02:03.594 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:02:03.594 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:02:03.859 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:02:03.859 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:02:03.859 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:02:03.859 [37/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:02:03.859 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:02:03.859 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:02:03.859 [40/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:02:03.859 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:02:03.859 [42/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:02:03.859 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:02:03.859 [44/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:02:03.859 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:02:03.859 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:02:03.859 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:02:03.859 [48/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:02:03.859 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:02:03.859 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:02:03.859 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:02:03.859 [52/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:02:03.859 [53/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:02:03.859 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:02:03.859 [55/265] Linking static target lib/librte_telemetry.a 00:02:03.859 [56/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:02:03.859 [57/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:02:03.859 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:02:03.859 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:02:03.859 [60/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:02:03.859 [61/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:02:03.860 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:02:03.860 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:02:03.860 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:02:04.120 [65/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:02:04.120 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:02:04.120 [67/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.120 [68/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:02:04.120 [69/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:02:04.120 [70/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:02:04.120 [71/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:02:04.120 [72/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:02:04.120 [73/265] Linking static target lib/librte_pci.a 00:02:04.120 [74/265] Linking target lib/librte_log.so.24.0 00:02:04.120 [75/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:02:04.120 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:02:04.120 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:02:04.384 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:02:04.384 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:02:04.384 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:02:04.384 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:02:04.384 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:02:04.384 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:02:04.384 [84/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:02:04.384 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:02:04.384 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:02:04.384 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:02:04.647 [88/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:02:04.647 [89/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:02:04.647 [90/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:02:04.647 [91/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:02:04.647 [92/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:02:04.647 [93/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.647 [94/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:02:04.647 [95/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:02:04.647 [96/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:02:04.647 [97/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:02:04.647 [98/265] Linking target lib/librte_kvargs.so.24.0 00:02:04.647 [99/265] Linking static target lib/librte_ring.a 00:02:04.647 [100/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:02:04.647 [101/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:02:04.647 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:02:04.647 [103/265] Linking static target lib/librte_eal.a 00:02:04.647 [104/265] Linking static target lib/librte_meter.a 00:02:04.647 [105/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:02:04.919 [106/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:02:04.919 [107/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:02:04.919 [108/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:02:04.919 [109/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:02:04.919 [110/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:02:04.919 [111/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:02:04.919 [112/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:02:04.919 [113/265] Linking static target lib/librte_rcu.a 00:02:04.919 [114/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.919 [115/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:02:04.919 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:02:04.919 [117/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:02:04.919 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:02:04.919 [119/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:02:04.919 [120/265] Linking static target lib/librte_mempool.a 00:02:04.919 [121/265] Linking target lib/librte_telemetry.so.24.0 00:02:04.919 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:02:04.919 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:02:04.919 [124/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:02:04.919 [125/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:02:05.184 [126/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:02:05.184 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:02:05.184 [128/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:02:05.184 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:02:05.184 [130/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:02:05.184 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:02:05.184 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:02:05.184 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:02:05.184 [134/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:02:05.184 [135/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:02:05.185 [136/265] Linking static target lib/librte_cmdline.a 00:02:05.185 [137/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.450 [138/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:05.450 [139/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:02:05.450 [140/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:02:05.450 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:02:05.450 [142/265] Linking static target lib/librte_net.a 00:02:05.450 [143/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.450 [144/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:02:05.450 [145/265] Linking static target lib/librte_timer.a 00:02:05.450 [146/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.450 [147/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:05.450 [148/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:02:05.450 [149/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:02:05.450 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:02:05.710 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:02:05.710 [152/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:02:05.710 [153/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:02:05.710 [154/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:02:05.710 [155/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:05.710 [156/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.710 [157/265] Linking static target lib/librte_dmadev.a 00:02:05.710 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:02:05.710 [159/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:02:05.710 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:05.710 [161/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.970 [162/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.971 [163/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:05.971 [164/265] Linking static target lib/librte_hash.a 00:02:05.971 [165/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:05.971 [166/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:02:05.971 [167/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:05.971 [168/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:05.971 [169/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:05.971 [170/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:02:05.971 [171/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:02:05.971 [172/265] Linking static target lib/librte_compressdev.a 00:02:05.971 [173/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:05.971 [174/265] Linking static target lib/librte_power.a 00:02:06.231 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:02:06.231 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:02:06.231 [177/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:06.231 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:06.231 [179/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.231 [180/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.231 [181/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:06.231 [182/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:06.231 [183/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:06.231 [184/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:06.231 [185/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:06.231 [186/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:06.231 [187/265] Linking static target lib/librte_reorder.a 00:02:06.231 [188/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:06.491 [189/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:06.491 [190/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:06.491 [191/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:06.491 [192/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.491 [193/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:06.491 [194/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:06.491 [195/265] Linking static target lib/librte_mbuf.a 00:02:06.491 [196/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.491 [197/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:06.491 [198/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:06.491 [199/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:06.491 [200/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:06.491 [201/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:06.491 [202/265] Linking static target drivers/librte_bus_vdev.a 00:02:06.491 [203/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.491 [204/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:06.491 [205/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:06.491 [206/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.750 [207/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:06.750 [208/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:06.750 [209/265] Linking static target drivers/librte_bus_pci.a 00:02:06.750 [210/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:06.750 [211/265] Linking static target lib/librte_security.a 00:02:06.750 [212/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:06.750 [213/265] Linking static target lib/librte_ethdev.a 00:02:06.750 [214/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:06.750 [215/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:06.750 [216/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:06.751 [217/265] Linking static target drivers/librte_mempool_ring.a 00:02:06.751 [218/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.009 [219/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.009 [220/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.009 [221/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:07.009 [222/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.009 [223/265] Linking static target lib/librte_cryptodev.a 00:02:08.387 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.323 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:11.223 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:11.223 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:11.223 [228/265] Linking target lib/librte_eal.so.24.0 00:02:11.223 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:11.223 [230/265] Linking target lib/librte_ring.so.24.0 00:02:11.223 [231/265] Linking target lib/librte_timer.so.24.0 00:02:11.223 [232/265] Linking target lib/librte_meter.so.24.0 00:02:11.223 [233/265] Linking target lib/librte_pci.so.24.0 00:02:11.223 [234/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:11.223 [235/265] Linking target lib/librte_dmadev.so.24.0 00:02:11.223 [236/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:11.223 [237/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:11.223 [238/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:11.223 [239/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:11.223 [240/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:11.483 [241/265] Linking target lib/librte_rcu.so.24.0 00:02:11.483 [242/265] Linking target lib/librte_mempool.so.24.0 00:02:11.483 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:11.483 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:11.483 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:11.483 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:11.483 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:11.742 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:11.742 [249/265] Linking target lib/librte_reorder.so.24.0 00:02:11.742 [250/265] Linking target lib/librte_net.so.24.0 00:02:11.742 [251/265] Linking target lib/librte_compressdev.so.24.0 00:02:11.742 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:11.742 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:11.742 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:11.742 [255/265] Linking target lib/librte_hash.so.24.0 00:02:11.742 [256/265] Linking target lib/librte_security.so.24.0 00:02:11.742 [257/265] Linking target lib/librte_cmdline.so.24.0 00:02:11.742 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:12.002 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:12.002 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:12.002 [261/265] Linking target lib/librte_power.so.24.0 00:02:14.547 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:14.547 [263/265] Linking static target lib/librte_vhost.a 00:02:15.487 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:15.487 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:15.487 INFO: autodetecting backend as ninja 00:02:15.487 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:16.431 CC lib/log/log.o 00:02:16.431 CC lib/ut_mock/mock.o 00:02:16.431 CC lib/log/log_flags.o 00:02:16.431 CC lib/log/log_deprecated.o 00:02:16.431 CC lib/ut/ut.o 00:02:16.690 LIB libspdk_ut_mock.a 00:02:16.690 SO libspdk_ut_mock.so.5.0 00:02:16.690 LIB libspdk_log.a 00:02:16.690 LIB libspdk_ut.a 00:02:16.690 SO libspdk_ut.so.1.0 00:02:16.690 SO libspdk_log.so.6.1 00:02:16.690 SYMLINK libspdk_ut_mock.so 00:02:16.690 SYMLINK libspdk_ut.so 00:02:16.690 SYMLINK libspdk_log.so 00:02:16.948 CC lib/ioat/ioat.o 00:02:16.948 CC lib/dma/dma.o 00:02:16.948 CXX lib/trace_parser/trace.o 00:02:16.948 CC lib/util/base64.o 00:02:16.948 CC lib/util/bit_array.o 00:02:16.948 CC lib/util/cpuset.o 00:02:16.948 CC lib/util/crc16.o 00:02:16.948 CC lib/util/crc32.o 00:02:16.948 CC lib/util/crc32c.o 00:02:16.948 CC lib/util/crc32_ieee.o 00:02:16.948 CC lib/util/crc64.o 00:02:16.948 CC lib/util/dif.o 00:02:16.948 CC lib/util/fd.o 00:02:16.948 CC lib/util/file.o 00:02:16.948 CC lib/util/hexlify.o 00:02:16.948 CC lib/util/iov.o 00:02:16.948 CC lib/util/pipe.o 00:02:16.948 CC lib/util/math.o 00:02:16.948 CC lib/util/strerror_tls.o 00:02:16.948 CC lib/util/string.o 00:02:16.948 CC lib/util/uuid.o 00:02:16.948 CC lib/util/fd_group.o 00:02:16.948 CC lib/util/xor.o 00:02:16.948 CC lib/util/zipf.o 00:02:16.948 CC lib/vfio_user/host/vfio_user_pci.o 00:02:16.948 CC lib/vfio_user/host/vfio_user.o 00:02:17.210 LIB libspdk_dma.a 00:02:17.210 SO libspdk_dma.so.3.0 00:02:17.210 LIB libspdk_ioat.a 00:02:17.210 SO libspdk_ioat.so.6.0 00:02:17.210 SYMLINK libspdk_dma.so 00:02:17.210 LIB libspdk_vfio_user.a 00:02:17.210 SYMLINK libspdk_ioat.so 00:02:17.210 SO libspdk_vfio_user.so.4.0 00:02:17.210 SYMLINK libspdk_vfio_user.so 00:02:17.470 LIB libspdk_util.a 00:02:17.470 SO libspdk_util.so.8.0 00:02:17.470 SYMLINK libspdk_util.so 00:02:17.729 CC lib/conf/conf.o 00:02:17.729 CC lib/rdma/common.o 00:02:17.729 CC lib/rdma/rdma_verbs.o 00:02:17.729 CC lib/json/json_parse.o 00:02:17.729 CC lib/idxd/idxd.o 00:02:17.729 CC lib/vmd/vmd.o 00:02:17.729 CC lib/idxd/idxd_user.o 00:02:17.729 CC lib/json/json_util.o 00:02:17.729 CC lib/env_dpdk/env.o 00:02:17.729 CC lib/vmd/led.o 00:02:17.729 CC lib/json/json_write.o 00:02:17.729 CC lib/idxd/idxd_kernel.o 00:02:17.729 CC lib/env_dpdk/memory.o 00:02:17.729 CC lib/env_dpdk/pci.o 00:02:17.729 CC lib/env_dpdk/init.o 00:02:17.729 CC lib/env_dpdk/threads.o 00:02:17.729 CC lib/env_dpdk/pci_ioat.o 00:02:17.729 CC lib/env_dpdk/pci_virtio.o 00:02:17.729 CC lib/env_dpdk/pci_vmd.o 00:02:17.729 CC lib/env_dpdk/pci_idxd.o 00:02:17.729 CC lib/env_dpdk/pci_event.o 00:02:17.729 CC lib/env_dpdk/sigbus_handler.o 00:02:17.729 CC lib/env_dpdk/pci_dpdk.o 00:02:17.729 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:17.729 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:17.988 LIB libspdk_json.a 00:02:17.988 LIB libspdk_rdma.a 00:02:17.988 LIB libspdk_conf.a 00:02:17.988 SO libspdk_rdma.so.5.0 00:02:17.988 SO libspdk_json.so.5.1 00:02:17.988 SO libspdk_conf.so.5.0 00:02:17.988 SYMLINK libspdk_conf.so 00:02:17.988 SYMLINK libspdk_rdma.so 00:02:17.988 SYMLINK libspdk_json.so 00:02:18.246 CC lib/jsonrpc/jsonrpc_server.o 00:02:18.247 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:18.247 CC lib/jsonrpc/jsonrpc_client.o 00:02:18.247 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:18.247 LIB libspdk_idxd.a 00:02:18.247 SO libspdk_idxd.so.11.0 00:02:18.247 SYMLINK libspdk_idxd.so 00:02:18.247 LIB libspdk_vmd.a 00:02:18.506 SO libspdk_vmd.so.5.0 00:02:18.506 SYMLINK libspdk_vmd.so 00:02:18.506 LIB libspdk_jsonrpc.a 00:02:18.506 SO libspdk_jsonrpc.so.5.1 00:02:18.506 SYMLINK libspdk_jsonrpc.so 00:02:18.764 CC lib/rpc/rpc.o 00:02:18.764 LIB libspdk_trace_parser.a 00:02:18.764 SO libspdk_trace_parser.so.4.0 00:02:18.764 SYMLINK libspdk_trace_parser.so 00:02:18.764 LIB libspdk_rpc.a 00:02:18.764 SO libspdk_rpc.so.5.0 00:02:19.023 SYMLINK libspdk_rpc.so 00:02:19.023 CC lib/notify/notify.o 00:02:19.023 CC lib/notify/notify_rpc.o 00:02:19.023 CC lib/trace/trace.o 00:02:19.023 CC lib/sock/sock.o 00:02:19.023 CC lib/trace/trace_flags.o 00:02:19.023 CC lib/sock/sock_rpc.o 00:02:19.023 CC lib/trace/trace_rpc.o 00:02:19.283 LIB libspdk_notify.a 00:02:19.283 SO libspdk_notify.so.5.0 00:02:19.283 LIB libspdk_trace.a 00:02:19.283 SYMLINK libspdk_notify.so 00:02:19.283 SO libspdk_trace.so.9.0 00:02:19.283 SYMLINK libspdk_trace.so 00:02:19.283 LIB libspdk_sock.a 00:02:19.542 SO libspdk_sock.so.8.0 00:02:19.542 CC lib/thread/thread.o 00:02:19.542 CC lib/thread/iobuf.o 00:02:19.542 SYMLINK libspdk_sock.so 00:02:19.542 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:19.542 CC lib/nvme/nvme_ctrlr.o 00:02:19.542 CC lib/nvme/nvme_fabric.o 00:02:19.542 CC lib/nvme/nvme_ns_cmd.o 00:02:19.542 CC lib/nvme/nvme_ns.o 00:02:19.542 CC lib/nvme/nvme_pcie_common.o 00:02:19.542 CC lib/nvme/nvme_pcie.o 00:02:19.542 CC lib/nvme/nvme_qpair.o 00:02:19.542 CC lib/nvme/nvme.o 00:02:19.542 CC lib/nvme/nvme_quirks.o 00:02:19.542 CC lib/nvme/nvme_transport.o 00:02:19.542 CC lib/nvme/nvme_discovery.o 00:02:19.542 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:19.542 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:19.542 CC lib/nvme/nvme_tcp.o 00:02:19.542 CC lib/nvme/nvme_opal.o 00:02:19.542 CC lib/nvme/nvme_io_msg.o 00:02:19.542 CC lib/nvme/nvme_poll_group.o 00:02:19.542 CC lib/nvme/nvme_zns.o 00:02:19.542 CC lib/nvme/nvme_vfio_user.o 00:02:19.542 CC lib/nvme/nvme_cuse.o 00:02:19.542 CC lib/nvme/nvme_rdma.o 00:02:19.802 LIB libspdk_env_dpdk.a 00:02:19.802 SO libspdk_env_dpdk.so.13.0 00:02:20.062 SYMLINK libspdk_env_dpdk.so 00:02:20.999 LIB libspdk_thread.a 00:02:20.999 SO libspdk_thread.so.9.0 00:02:20.999 SYMLINK libspdk_thread.so 00:02:21.258 CC lib/accel/accel.o 00:02:21.258 CC lib/accel/accel_rpc.o 00:02:21.258 CC lib/accel/accel_sw.o 00:02:21.258 CC lib/virtio/virtio.o 00:02:21.258 CC lib/init/json_config.o 00:02:21.258 CC lib/blob/blobstore.o 00:02:21.258 CC lib/virtio/virtio_vhost_user.o 00:02:21.258 CC lib/init/subsystem.o 00:02:21.258 CC lib/blob/request.o 00:02:21.258 CC lib/virtio/virtio_vfio_user.o 00:02:21.258 CC lib/init/subsystem_rpc.o 00:02:21.258 CC lib/blob/zeroes.o 00:02:21.258 CC lib/init/rpc.o 00:02:21.258 CC lib/virtio/virtio_pci.o 00:02:21.258 CC lib/blob/blob_bs_dev.o 00:02:21.517 LIB libspdk_init.a 00:02:21.517 SO libspdk_init.so.4.0 00:02:21.517 SYMLINK libspdk_init.so 00:02:21.517 LIB libspdk_virtio.a 00:02:21.517 SO libspdk_virtio.so.6.0 00:02:21.777 SYMLINK libspdk_virtio.so 00:02:21.777 CC lib/event/app.o 00:02:21.777 CC lib/event/reactor.o 00:02:21.777 CC lib/event/log_rpc.o 00:02:21.777 CC lib/event/app_rpc.o 00:02:21.777 CC lib/event/scheduler_static.o 00:02:21.777 LIB libspdk_nvme.a 00:02:22.035 SO libspdk_nvme.so.12.0 00:02:22.035 LIB libspdk_event.a 00:02:22.035 SO libspdk_event.so.12.0 00:02:22.295 SYMLINK libspdk_nvme.so 00:02:22.295 SYMLINK libspdk_event.so 00:02:22.295 LIB libspdk_accel.a 00:02:22.295 SO libspdk_accel.so.14.0 00:02:22.295 SYMLINK libspdk_accel.so 00:02:22.554 CC lib/bdev/bdev.o 00:02:22.554 CC lib/bdev/bdev_rpc.o 00:02:22.554 CC lib/bdev/bdev_zone.o 00:02:22.554 CC lib/bdev/part.o 00:02:22.554 CC lib/bdev/scsi_nvme.o 00:02:23.930 LIB libspdk_blob.a 00:02:23.930 SO libspdk_blob.so.10.1 00:02:24.187 SYMLINK libspdk_blob.so 00:02:24.188 CC lib/lvol/lvol.o 00:02:24.188 CC lib/blobfs/blobfs.o 00:02:24.188 CC lib/blobfs/tree.o 00:02:25.124 LIB libspdk_blobfs.a 00:02:25.124 SO libspdk_blobfs.so.9.0 00:02:25.124 LIB libspdk_bdev.a 00:02:25.124 SYMLINK libspdk_blobfs.so 00:02:25.124 LIB libspdk_lvol.a 00:02:25.124 SO libspdk_bdev.so.14.0 00:02:25.124 SO libspdk_lvol.so.9.1 00:02:25.124 SYMLINK libspdk_lvol.so 00:02:25.124 SYMLINK libspdk_bdev.so 00:02:25.124 CC lib/nvmf/ctrlr.o 00:02:25.124 CC lib/nvmf/ctrlr_discovery.o 00:02:25.124 CC lib/nvmf/ctrlr_bdev.o 00:02:25.124 CC lib/nvmf/subsystem.o 00:02:25.124 CC lib/nbd/nbd.o 00:02:25.124 CC lib/nvmf/nvmf.o 00:02:25.124 CC lib/nbd/nbd_rpc.o 00:02:25.124 CC lib/nvmf/nvmf_rpc.o 00:02:25.124 CC lib/nvmf/transport.o 00:02:25.124 CC lib/ublk/ublk.o 00:02:25.124 CC lib/nvmf/tcp.o 00:02:25.124 CC lib/scsi/dev.o 00:02:25.124 CC lib/ublk/ublk_rpc.o 00:02:25.124 CC lib/scsi/lun.o 00:02:25.124 CC lib/ftl/ftl_core.o 00:02:25.124 CC lib/nvmf/rdma.o 00:02:25.124 CC lib/scsi/port.o 00:02:25.124 CC lib/ftl/ftl_init.o 00:02:25.124 CC lib/scsi/scsi.o 00:02:25.124 CC lib/scsi/scsi_bdev.o 00:02:25.124 CC lib/ftl/ftl_layout.o 00:02:25.124 CC lib/scsi/scsi_pr.o 00:02:25.124 CC lib/ftl/ftl_debug.o 00:02:25.391 CC lib/ftl/ftl_io.o 00:02:25.391 CC lib/scsi/task.o 00:02:25.391 CC lib/scsi/scsi_rpc.o 00:02:25.391 CC lib/ftl/ftl_l2p.o 00:02:25.391 CC lib/ftl/ftl_sb.o 00:02:25.391 CC lib/ftl/ftl_l2p_flat.o 00:02:25.391 CC lib/ftl/ftl_nv_cache.o 00:02:25.391 CC lib/ftl/ftl_band.o 00:02:25.391 CC lib/ftl/ftl_band_ops.o 00:02:25.391 CC lib/ftl/ftl_writer.o 00:02:25.391 CC lib/ftl/ftl_rq.o 00:02:25.391 CC lib/ftl/ftl_reloc.o 00:02:25.391 CC lib/ftl/ftl_l2p_cache.o 00:02:25.391 CC lib/ftl/ftl_p2l.o 00:02:25.391 CC lib/ftl/mngt/ftl_mngt.o 00:02:25.391 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:25.391 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:25.391 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:25.391 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:25.391 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:25.392 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:25.392 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:25.392 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:25.392 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:25.392 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:25.657 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:25.657 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:25.657 CC lib/ftl/utils/ftl_conf.o 00:02:25.657 CC lib/ftl/utils/ftl_md.o 00:02:25.657 CC lib/ftl/utils/ftl_mempool.o 00:02:25.657 CC lib/ftl/utils/ftl_bitmap.o 00:02:25.657 CC lib/ftl/utils/ftl_property.o 00:02:25.657 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:25.657 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:25.657 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:25.657 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:25.657 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:25.657 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:25.657 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:25.657 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:25.657 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:25.657 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:25.657 CC lib/ftl/base/ftl_base_dev.o 00:02:25.657 CC lib/ftl/base/ftl_base_bdev.o 00:02:25.657 CC lib/ftl/ftl_trace.o 00:02:25.917 LIB libspdk_nbd.a 00:02:25.917 SO libspdk_nbd.so.6.0 00:02:26.176 LIB libspdk_scsi.a 00:02:26.176 SYMLINK libspdk_nbd.so 00:02:26.176 SO libspdk_scsi.so.8.0 00:02:26.176 SYMLINK libspdk_scsi.so 00:02:26.176 LIB libspdk_ublk.a 00:02:26.176 SO libspdk_ublk.so.2.0 00:02:26.436 CC lib/iscsi/conn.o 00:02:26.436 CC lib/vhost/vhost.o 00:02:26.436 CC lib/iscsi/init_grp.o 00:02:26.436 CC lib/vhost/vhost_rpc.o 00:02:26.436 CC lib/iscsi/iscsi.o 00:02:26.436 CC lib/vhost/vhost_scsi.o 00:02:26.436 CC lib/vhost/vhost_blk.o 00:02:26.436 CC lib/iscsi/md5.o 00:02:26.436 CC lib/vhost/rte_vhost_user.o 00:02:26.436 CC lib/iscsi/param.o 00:02:26.436 CC lib/iscsi/portal_grp.o 00:02:26.436 CC lib/iscsi/tgt_node.o 00:02:26.436 CC lib/iscsi/iscsi_subsystem.o 00:02:26.436 CC lib/iscsi/iscsi_rpc.o 00:02:26.436 CC lib/iscsi/task.o 00:02:26.436 SYMLINK libspdk_ublk.so 00:02:26.695 LIB libspdk_ftl.a 00:02:26.695 SO libspdk_ftl.so.8.0 00:02:26.955 SYMLINK libspdk_ftl.so 00:02:27.522 LIB libspdk_vhost.a 00:02:27.522 SO libspdk_vhost.so.7.1 00:02:27.781 SYMLINK libspdk_vhost.so 00:02:27.781 LIB libspdk_nvmf.a 00:02:27.781 SO libspdk_nvmf.so.17.0 00:02:27.781 LIB libspdk_iscsi.a 00:02:27.781 SO libspdk_iscsi.so.7.0 00:02:27.781 SYMLINK libspdk_nvmf.so 00:02:28.040 SYMLINK libspdk_iscsi.so 00:02:28.040 CC module/env_dpdk/env_dpdk_rpc.o 00:02:28.040 CC module/accel/iaa/accel_iaa.o 00:02:28.299 CC module/accel/dsa/accel_dsa.o 00:02:28.299 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:28.299 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:28.299 CC module/sock/posix/posix.o 00:02:28.299 CC module/accel/dsa/accel_dsa_rpc.o 00:02:28.299 CC module/scheduler/gscheduler/gscheduler.o 00:02:28.299 CC module/accel/error/accel_error.o 00:02:28.300 CC module/blob/bdev/blob_bdev.o 00:02:28.300 CC module/accel/iaa/accel_iaa_rpc.o 00:02:28.300 CC module/accel/ioat/accel_ioat.o 00:02:28.300 CC module/accel/error/accel_error_rpc.o 00:02:28.300 CC module/accel/ioat/accel_ioat_rpc.o 00:02:28.300 LIB libspdk_env_dpdk_rpc.a 00:02:28.300 SO libspdk_env_dpdk_rpc.so.5.0 00:02:28.300 SYMLINK libspdk_env_dpdk_rpc.so 00:02:28.300 LIB libspdk_scheduler_gscheduler.a 00:02:28.300 LIB libspdk_scheduler_dpdk_governor.a 00:02:28.300 SO libspdk_scheduler_gscheduler.so.3.0 00:02:28.300 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:28.300 LIB libspdk_accel_error.a 00:02:28.300 LIB libspdk_accel_ioat.a 00:02:28.300 LIB libspdk_scheduler_dynamic.a 00:02:28.300 SO libspdk_accel_error.so.1.0 00:02:28.300 LIB libspdk_accel_iaa.a 00:02:28.300 SO libspdk_accel_ioat.so.5.0 00:02:28.300 SYMLINK libspdk_scheduler_gscheduler.so 00:02:28.300 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:28.300 SO libspdk_scheduler_dynamic.so.3.0 00:02:28.300 SO libspdk_accel_iaa.so.2.0 00:02:28.559 LIB libspdk_accel_dsa.a 00:02:28.559 SYMLINK libspdk_accel_error.so 00:02:28.559 SYMLINK libspdk_accel_ioat.so 00:02:28.559 SYMLINK libspdk_scheduler_dynamic.so 00:02:28.559 SO libspdk_accel_dsa.so.4.0 00:02:28.559 LIB libspdk_blob_bdev.a 00:02:28.559 SYMLINK libspdk_accel_iaa.so 00:02:28.559 SO libspdk_blob_bdev.so.10.1 00:02:28.559 SYMLINK libspdk_accel_dsa.so 00:02:28.559 SYMLINK libspdk_blob_bdev.so 00:02:28.818 CC module/bdev/null/bdev_null.o 00:02:28.818 CC module/bdev/null/bdev_null_rpc.o 00:02:28.818 CC module/blobfs/bdev/blobfs_bdev.o 00:02:28.818 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:28.818 CC module/bdev/gpt/gpt.o 00:02:28.818 CC module/bdev/gpt/vbdev_gpt.o 00:02:28.818 CC module/bdev/lvol/vbdev_lvol.o 00:02:28.818 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:28.818 CC module/bdev/aio/bdev_aio.o 00:02:28.818 CC module/bdev/delay/vbdev_delay.o 00:02:28.818 CC module/bdev/passthru/vbdev_passthru.o 00:02:28.818 CC module/bdev/aio/bdev_aio_rpc.o 00:02:28.818 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:28.818 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:28.818 CC module/bdev/error/vbdev_error.o 00:02:28.818 CC module/bdev/iscsi/bdev_iscsi.o 00:02:28.818 CC module/bdev/split/vbdev_split.o 00:02:28.818 CC module/bdev/raid/bdev_raid.o 00:02:28.818 CC module/bdev/raid/bdev_raid_rpc.o 00:02:28.818 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:28.818 CC module/bdev/error/vbdev_error_rpc.o 00:02:28.818 CC module/bdev/nvme/bdev_nvme.o 00:02:28.818 CC module/bdev/split/vbdev_split_rpc.o 00:02:28.818 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:28.818 CC module/bdev/raid/bdev_raid_sb.o 00:02:28.818 CC module/bdev/nvme/nvme_rpc.o 00:02:28.818 CC module/bdev/raid/raid0.o 00:02:28.818 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:28.818 CC module/bdev/malloc/bdev_malloc.o 00:02:28.818 CC module/bdev/raid/raid1.o 00:02:28.818 CC module/bdev/nvme/bdev_mdns_client.o 00:02:28.818 CC module/bdev/ftl/bdev_ftl.o 00:02:28.818 CC module/bdev/nvme/vbdev_opal.o 00:02:28.818 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:28.818 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:28.818 CC module/bdev/raid/concat.o 00:02:28.818 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:28.818 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:28.818 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:28.818 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:28.818 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:28.818 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:29.077 LIB libspdk_sock_posix.a 00:02:29.077 LIB libspdk_bdev_split.a 00:02:29.077 LIB libspdk_blobfs_bdev.a 00:02:29.077 SO libspdk_sock_posix.so.5.0 00:02:29.077 SO libspdk_bdev_split.so.5.0 00:02:29.077 SO libspdk_blobfs_bdev.so.5.0 00:02:29.077 LIB libspdk_bdev_error.a 00:02:29.077 LIB libspdk_bdev_ftl.a 00:02:29.077 SYMLINK libspdk_bdev_split.so 00:02:29.077 SO libspdk_bdev_error.so.5.0 00:02:29.077 LIB libspdk_bdev_gpt.a 00:02:29.077 SYMLINK libspdk_sock_posix.so 00:02:29.077 SO libspdk_bdev_ftl.so.5.0 00:02:29.077 SYMLINK libspdk_blobfs_bdev.so 00:02:29.077 SO libspdk_bdev_gpt.so.5.0 00:02:29.077 SYMLINK libspdk_bdev_error.so 00:02:29.077 LIB libspdk_bdev_null.a 00:02:29.077 SYMLINK libspdk_bdev_ftl.so 00:02:29.336 SO libspdk_bdev_null.so.5.0 00:02:29.336 SYMLINK libspdk_bdev_gpt.so 00:02:29.336 LIB libspdk_bdev_passthru.a 00:02:29.336 LIB libspdk_bdev_delay.a 00:02:29.336 LIB libspdk_bdev_malloc.a 00:02:29.336 SO libspdk_bdev_passthru.so.5.0 00:02:29.336 SYMLINK libspdk_bdev_null.so 00:02:29.336 SO libspdk_bdev_delay.so.5.0 00:02:29.336 LIB libspdk_bdev_aio.a 00:02:29.336 LIB libspdk_bdev_iscsi.a 00:02:29.336 SO libspdk_bdev_malloc.so.5.0 00:02:29.336 LIB libspdk_bdev_zone_block.a 00:02:29.336 SO libspdk_bdev_aio.so.5.0 00:02:29.336 SO libspdk_bdev_iscsi.so.5.0 00:02:29.336 SYMLINK libspdk_bdev_passthru.so 00:02:29.336 SO libspdk_bdev_zone_block.so.5.0 00:02:29.336 SYMLINK libspdk_bdev_delay.so 00:02:29.336 SYMLINK libspdk_bdev_malloc.so 00:02:29.336 SYMLINK libspdk_bdev_aio.so 00:02:29.336 SYMLINK libspdk_bdev_iscsi.so 00:02:29.336 SYMLINK libspdk_bdev_zone_block.so 00:02:29.336 LIB libspdk_bdev_virtio.a 00:02:29.336 SO libspdk_bdev_virtio.so.5.0 00:02:29.336 LIB libspdk_bdev_lvol.a 00:02:29.595 SO libspdk_bdev_lvol.so.5.0 00:02:29.595 SYMLINK libspdk_bdev_virtio.so 00:02:29.595 SYMLINK libspdk_bdev_lvol.so 00:02:29.854 LIB libspdk_bdev_raid.a 00:02:29.854 SO libspdk_bdev_raid.so.5.0 00:02:29.854 SYMLINK libspdk_bdev_raid.so 00:02:31.234 LIB libspdk_bdev_nvme.a 00:02:31.234 SO libspdk_bdev_nvme.so.6.0 00:02:31.234 SYMLINK libspdk_bdev_nvme.so 00:02:31.493 CC module/event/subsystems/vmd/vmd.o 00:02:31.493 CC module/event/subsystems/iobuf/iobuf.o 00:02:31.493 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:31.493 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:31.493 CC module/event/subsystems/sock/sock.o 00:02:31.493 CC module/event/subsystems/scheduler/scheduler.o 00:02:31.493 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:31.493 LIB libspdk_event_sock.a 00:02:31.493 LIB libspdk_event_vhost_blk.a 00:02:31.493 LIB libspdk_event_scheduler.a 00:02:31.493 LIB libspdk_event_vmd.a 00:02:31.493 SO libspdk_event_sock.so.4.0 00:02:31.493 SO libspdk_event_vhost_blk.so.2.0 00:02:31.493 LIB libspdk_event_iobuf.a 00:02:31.493 SO libspdk_event_scheduler.so.3.0 00:02:31.493 SO libspdk_event_vmd.so.5.0 00:02:31.493 SO libspdk_event_iobuf.so.2.0 00:02:31.752 SYMLINK libspdk_event_sock.so 00:02:31.752 SYMLINK libspdk_event_vhost_blk.so 00:02:31.752 SYMLINK libspdk_event_scheduler.so 00:02:31.752 SYMLINK libspdk_event_vmd.so 00:02:31.752 SYMLINK libspdk_event_iobuf.so 00:02:31.752 CC module/event/subsystems/accel/accel.o 00:02:32.011 LIB libspdk_event_accel.a 00:02:32.011 SO libspdk_event_accel.so.5.0 00:02:32.011 SYMLINK libspdk_event_accel.so 00:02:32.011 CC module/event/subsystems/bdev/bdev.o 00:02:32.270 LIB libspdk_event_bdev.a 00:02:32.270 SO libspdk_event_bdev.so.5.0 00:02:32.270 SYMLINK libspdk_event_bdev.so 00:02:32.528 CC module/event/subsystems/scsi/scsi.o 00:02:32.528 CC module/event/subsystems/nbd/nbd.o 00:02:32.528 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:32.528 CC module/event/subsystems/ublk/ublk.o 00:02:32.528 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:32.528 LIB libspdk_event_nbd.a 00:02:32.528 LIB libspdk_event_ublk.a 00:02:32.528 LIB libspdk_event_scsi.a 00:02:32.528 SO libspdk_event_nbd.so.5.0 00:02:32.528 SO libspdk_event_ublk.so.2.0 00:02:32.528 SO libspdk_event_scsi.so.5.0 00:02:32.787 SYMLINK libspdk_event_nbd.so 00:02:32.787 SYMLINK libspdk_event_ublk.so 00:02:32.787 SYMLINK libspdk_event_scsi.so 00:02:32.787 LIB libspdk_event_nvmf.a 00:02:32.787 SO libspdk_event_nvmf.so.5.0 00:02:32.787 SYMLINK libspdk_event_nvmf.so 00:02:32.787 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:32.787 CC module/event/subsystems/iscsi/iscsi.o 00:02:33.046 LIB libspdk_event_vhost_scsi.a 00:02:33.046 SO libspdk_event_vhost_scsi.so.2.0 00:02:33.046 LIB libspdk_event_iscsi.a 00:02:33.046 SO libspdk_event_iscsi.so.5.0 00:02:33.046 SYMLINK libspdk_event_vhost_scsi.so 00:02:33.046 SYMLINK libspdk_event_iscsi.so 00:02:33.046 SO libspdk.so.5.0 00:02:33.046 SYMLINK libspdk.so 00:02:33.311 CXX app/trace/trace.o 00:02:33.311 CC app/spdk_top/spdk_top.o 00:02:33.311 CC app/trace_record/trace_record.o 00:02:33.311 CC app/spdk_nvme_identify/identify.o 00:02:33.311 CC app/spdk_nvme_perf/perf.o 00:02:33.311 CC app/spdk_nvme_discover/discovery_aer.o 00:02:33.311 CC app/spdk_lspci/spdk_lspci.o 00:02:33.311 TEST_HEADER include/spdk/accel.h 00:02:33.311 CC test/rpc_client/rpc_client_test.o 00:02:33.311 TEST_HEADER include/spdk/accel_module.h 00:02:33.311 TEST_HEADER include/spdk/assert.h 00:02:33.311 TEST_HEADER include/spdk/barrier.h 00:02:33.311 TEST_HEADER include/spdk/base64.h 00:02:33.311 TEST_HEADER include/spdk/bdev.h 00:02:33.311 TEST_HEADER include/spdk/bdev_module.h 00:02:33.311 TEST_HEADER include/spdk/bdev_zone.h 00:02:33.311 TEST_HEADER include/spdk/bit_array.h 00:02:33.311 TEST_HEADER include/spdk/bit_pool.h 00:02:33.311 TEST_HEADER include/spdk/blob_bdev.h 00:02:33.311 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:33.311 TEST_HEADER include/spdk/blobfs.h 00:02:33.311 TEST_HEADER include/spdk/blob.h 00:02:33.311 TEST_HEADER include/spdk/conf.h 00:02:33.311 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:33.311 TEST_HEADER include/spdk/config.h 00:02:33.311 TEST_HEADER include/spdk/cpuset.h 00:02:33.311 TEST_HEADER include/spdk/crc16.h 00:02:33.311 CC app/nvmf_tgt/nvmf_main.o 00:02:33.311 CC app/spdk_dd/spdk_dd.o 00:02:33.311 TEST_HEADER include/spdk/crc32.h 00:02:33.311 TEST_HEADER include/spdk/crc64.h 00:02:33.311 TEST_HEADER include/spdk/dif.h 00:02:33.311 CC app/iscsi_tgt/iscsi_tgt.o 00:02:33.311 TEST_HEADER include/spdk/dma.h 00:02:33.311 CC app/vhost/vhost.o 00:02:33.311 TEST_HEADER include/spdk/endian.h 00:02:33.311 CC examples/ioat/verify/verify.o 00:02:33.311 CC examples/ioat/perf/perf.o 00:02:33.311 TEST_HEADER include/spdk/env_dpdk.h 00:02:33.311 CC examples/nvme/hotplug/hotplug.o 00:02:33.311 CC examples/nvme/hello_world/hello_world.o 00:02:33.311 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:33.311 CC examples/nvme/reconnect/reconnect.o 00:02:33.311 CC examples/nvme/arbitration/arbitration.o 00:02:33.311 CC app/fio/nvme/fio_plugin.o 00:02:33.311 TEST_HEADER include/spdk/env.h 00:02:33.311 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:33.311 CC examples/sock/hello_world/hello_sock.o 00:02:33.311 CC examples/vmd/lsvmd/lsvmd.o 00:02:33.311 CC examples/idxd/perf/perf.o 00:02:33.311 CC examples/nvme/abort/abort.o 00:02:33.311 CC examples/util/zipf/zipf.o 00:02:33.311 TEST_HEADER include/spdk/event.h 00:02:33.311 TEST_HEADER include/spdk/fd_group.h 00:02:33.311 CC examples/accel/perf/accel_perf.o 00:02:33.311 TEST_HEADER include/spdk/fd.h 00:02:33.311 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:33.311 TEST_HEADER include/spdk/file.h 00:02:33.311 TEST_HEADER include/spdk/ftl.h 00:02:33.311 CC test/nvme/aer/aer.o 00:02:33.311 CC test/event/event_perf/event_perf.o 00:02:33.311 TEST_HEADER include/spdk/gpt_spec.h 00:02:33.311 TEST_HEADER include/spdk/hexlify.h 00:02:33.311 TEST_HEADER include/spdk/histogram_data.h 00:02:33.311 CC app/spdk_tgt/spdk_tgt.o 00:02:33.311 TEST_HEADER include/spdk/idxd.h 00:02:33.311 CC test/thread/poller_perf/poller_perf.o 00:02:33.311 TEST_HEADER include/spdk/idxd_spec.h 00:02:33.311 TEST_HEADER include/spdk/init.h 00:02:33.311 TEST_HEADER include/spdk/ioat.h 00:02:33.311 TEST_HEADER include/spdk/ioat_spec.h 00:02:33.311 TEST_HEADER include/spdk/iscsi_spec.h 00:02:33.311 TEST_HEADER include/spdk/json.h 00:02:33.311 CC examples/blob/cli/blobcli.o 00:02:33.311 CC examples/bdev/hello_world/hello_bdev.o 00:02:33.311 TEST_HEADER include/spdk/jsonrpc.h 00:02:33.311 CC examples/nvmf/nvmf/nvmf.o 00:02:33.311 CC app/fio/bdev/fio_plugin.o 00:02:33.311 TEST_HEADER include/spdk/likely.h 00:02:33.575 CC examples/blob/hello_world/hello_blob.o 00:02:33.575 CC test/accel/dif/dif.o 00:02:33.575 CC examples/thread/thread/thread_ex.o 00:02:33.575 CC examples/bdev/bdevperf/bdevperf.o 00:02:33.575 TEST_HEADER include/spdk/log.h 00:02:33.575 TEST_HEADER include/spdk/lvol.h 00:02:33.575 CC test/app/bdev_svc/bdev_svc.o 00:02:33.575 CC test/blobfs/mkfs/mkfs.o 00:02:33.575 TEST_HEADER include/spdk/memory.h 00:02:33.575 CC test/dma/test_dma/test_dma.o 00:02:33.575 TEST_HEADER include/spdk/mmio.h 00:02:33.575 CC test/bdev/bdevio/bdevio.o 00:02:33.575 TEST_HEADER include/spdk/nbd.h 00:02:33.575 TEST_HEADER include/spdk/notify.h 00:02:33.575 TEST_HEADER include/spdk/nvme.h 00:02:33.575 TEST_HEADER include/spdk/nvme_intel.h 00:02:33.575 CC test/env/mem_callbacks/mem_callbacks.o 00:02:33.575 CC test/lvol/esnap/esnap.o 00:02:33.575 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:33.575 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:33.575 TEST_HEADER include/spdk/nvme_spec.h 00:02:33.575 TEST_HEADER include/spdk/nvme_zns.h 00:02:33.575 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:33.575 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:33.575 TEST_HEADER include/spdk/nvmf.h 00:02:33.575 TEST_HEADER include/spdk/nvmf_spec.h 00:02:33.575 TEST_HEADER include/spdk/nvmf_transport.h 00:02:33.575 TEST_HEADER include/spdk/opal.h 00:02:33.575 TEST_HEADER include/spdk/opal_spec.h 00:02:33.575 TEST_HEADER include/spdk/pci_ids.h 00:02:33.575 TEST_HEADER include/spdk/pipe.h 00:02:33.575 TEST_HEADER include/spdk/queue.h 00:02:33.575 TEST_HEADER include/spdk/reduce.h 00:02:33.575 TEST_HEADER include/spdk/rpc.h 00:02:33.575 TEST_HEADER include/spdk/scheduler.h 00:02:33.575 LINK spdk_lspci 00:02:33.575 TEST_HEADER include/spdk/scsi.h 00:02:33.575 TEST_HEADER include/spdk/scsi_spec.h 00:02:33.575 TEST_HEADER include/spdk/sock.h 00:02:33.575 TEST_HEADER include/spdk/stdinc.h 00:02:33.575 TEST_HEADER include/spdk/string.h 00:02:33.575 TEST_HEADER include/spdk/thread.h 00:02:33.575 TEST_HEADER include/spdk/trace.h 00:02:33.575 TEST_HEADER include/spdk/trace_parser.h 00:02:33.575 TEST_HEADER include/spdk/tree.h 00:02:33.575 TEST_HEADER include/spdk/ublk.h 00:02:33.575 TEST_HEADER include/spdk/util.h 00:02:33.575 TEST_HEADER include/spdk/uuid.h 00:02:33.575 TEST_HEADER include/spdk/version.h 00:02:33.575 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:33.575 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:33.575 TEST_HEADER include/spdk/vhost.h 00:02:33.575 TEST_HEADER include/spdk/vmd.h 00:02:33.575 TEST_HEADER include/spdk/xor.h 00:02:33.575 TEST_HEADER include/spdk/zipf.h 00:02:33.575 CXX test/cpp_headers/accel.o 00:02:33.575 LINK lsvmd 00:02:33.575 LINK rpc_client_test 00:02:33.575 LINK spdk_nvme_discover 00:02:33.575 LINK event_perf 00:02:33.575 LINK interrupt_tgt 00:02:33.575 LINK zipf 00:02:33.575 LINK nvmf_tgt 00:02:33.575 LINK poller_perf 00:02:33.856 LINK pmr_persistence 00:02:33.856 LINK vhost 00:02:33.856 LINK spdk_trace_record 00:02:33.856 LINK cmb_copy 00:02:33.856 LINK iscsi_tgt 00:02:33.856 LINK ioat_perf 00:02:33.856 LINK verify 00:02:33.856 LINK bdev_svc 00:02:33.856 LINK hello_world 00:02:33.856 LINK spdk_tgt 00:02:33.856 LINK hello_sock 00:02:33.856 LINK hotplug 00:02:33.856 LINK mkfs 00:02:33.856 LINK hello_blob 00:02:33.856 LINK hello_bdev 00:02:33.856 LINK thread 00:02:33.856 LINK aer 00:02:34.126 LINK arbitration 00:02:34.126 CXX test/cpp_headers/accel_module.o 00:02:34.126 LINK spdk_dd 00:02:34.126 CC test/nvme/reset/reset.o 00:02:34.126 CXX test/cpp_headers/assert.o 00:02:34.126 LINK nvmf 00:02:34.126 LINK idxd_perf 00:02:34.126 LINK reconnect 00:02:34.126 CC examples/vmd/led/led.o 00:02:34.126 CXX test/cpp_headers/barrier.o 00:02:34.126 CC test/app/histogram_perf/histogram_perf.o 00:02:34.126 CC test/event/reactor/reactor.o 00:02:34.126 CC test/nvme/sgl/sgl.o 00:02:34.126 LINK abort 00:02:34.126 CC test/app/jsoncat/jsoncat.o 00:02:34.126 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:34.126 CC test/app/stub/stub.o 00:02:34.126 CC test/env/vtophys/vtophys.o 00:02:34.126 CC test/nvme/e2edp/nvme_dp.o 00:02:34.126 LINK bdevio 00:02:34.126 CC test/event/reactor_perf/reactor_perf.o 00:02:34.126 LINK spdk_trace 00:02:34.126 LINK test_dma 00:02:34.126 LINK dif 00:02:34.126 CXX test/cpp_headers/base64.o 00:02:34.126 LINK accel_perf 00:02:34.126 CC test/nvme/overhead/overhead.o 00:02:34.126 CXX test/cpp_headers/bdev.o 00:02:34.126 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:34.391 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:34.391 CC test/nvme/err_injection/err_injection.o 00:02:34.391 CC test/event/app_repeat/app_repeat.o 00:02:34.391 CC test/nvme/startup/startup.o 00:02:34.391 CC test/event/scheduler/scheduler.o 00:02:34.391 LINK nvme_manage 00:02:34.391 CXX test/cpp_headers/bdev_module.o 00:02:34.391 LINK led 00:02:34.391 LINK histogram_perf 00:02:34.391 LINK reactor 00:02:34.391 CXX test/cpp_headers/bdev_zone.o 00:02:34.391 CC test/nvme/reserve/reserve.o 00:02:34.391 CC test/nvme/simple_copy/simple_copy.o 00:02:34.391 CC test/env/memory/memory_ut.o 00:02:34.391 LINK blobcli 00:02:34.391 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:34.391 LINK jsoncat 00:02:34.391 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:34.391 CC test/nvme/connect_stress/connect_stress.o 00:02:34.391 LINK vtophys 00:02:34.391 LINK reactor_perf 00:02:34.391 CC test/env/pci/pci_ut.o 00:02:34.391 CC test/nvme/boot_partition/boot_partition.o 00:02:34.391 LINK stub 00:02:34.391 CC test/nvme/compliance/nvme_compliance.o 00:02:34.391 CXX test/cpp_headers/bit_array.o 00:02:34.391 CC test/nvme/fused_ordering/fused_ordering.o 00:02:34.653 LINK reset 00:02:34.653 CXX test/cpp_headers/bit_pool.o 00:02:34.653 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:34.653 LINK env_dpdk_post_init 00:02:34.653 LINK spdk_bdev 00:02:34.653 LINK app_repeat 00:02:34.653 CXX test/cpp_headers/blob_bdev.o 00:02:34.653 CXX test/cpp_headers/blobfs_bdev.o 00:02:34.653 CXX test/cpp_headers/blobfs.o 00:02:34.653 CXX test/cpp_headers/blob.o 00:02:34.653 LINK err_injection 00:02:34.653 LINK sgl 00:02:34.653 LINK startup 00:02:34.653 CXX test/cpp_headers/conf.o 00:02:34.653 LINK spdk_nvme 00:02:34.653 CXX test/cpp_headers/config.o 00:02:34.653 CXX test/cpp_headers/cpuset.o 00:02:34.653 CC test/nvme/fdp/fdp.o 00:02:34.653 CXX test/cpp_headers/crc16.o 00:02:34.653 CC test/nvme/cuse/cuse.o 00:02:34.653 LINK nvme_dp 00:02:34.653 CXX test/cpp_headers/crc32.o 00:02:34.653 CXX test/cpp_headers/crc64.o 00:02:34.653 LINK mem_callbacks 00:02:34.653 CXX test/cpp_headers/dif.o 00:02:34.653 CXX test/cpp_headers/dma.o 00:02:34.653 CXX test/cpp_headers/endian.o 00:02:34.653 CXX test/cpp_headers/env_dpdk.o 00:02:34.653 LINK scheduler 00:02:34.915 LINK reserve 00:02:34.915 LINK overhead 00:02:34.915 CXX test/cpp_headers/env.o 00:02:34.915 LINK connect_stress 00:02:34.915 CXX test/cpp_headers/event.o 00:02:34.915 CXX test/cpp_headers/fd_group.o 00:02:34.915 LINK spdk_nvme_perf 00:02:34.915 CXX test/cpp_headers/fd.o 00:02:34.915 LINK boot_partition 00:02:34.915 CXX test/cpp_headers/file.o 00:02:34.915 CXX test/cpp_headers/ftl.o 00:02:34.915 LINK simple_copy 00:02:34.915 CXX test/cpp_headers/gpt_spec.o 00:02:34.915 LINK bdevperf 00:02:34.915 LINK doorbell_aers 00:02:34.915 CXX test/cpp_headers/hexlify.o 00:02:34.915 CXX test/cpp_headers/histogram_data.o 00:02:34.915 LINK fused_ordering 00:02:34.915 LINK spdk_nvme_identify 00:02:34.915 LINK nvme_fuzz 00:02:34.915 CXX test/cpp_headers/idxd.o 00:02:34.915 CXX test/cpp_headers/idxd_spec.o 00:02:34.915 CXX test/cpp_headers/init.o 00:02:34.915 CXX test/cpp_headers/ioat.o 00:02:34.915 CXX test/cpp_headers/ioat_spec.o 00:02:34.915 CXX test/cpp_headers/iscsi_spec.o 00:02:34.915 LINK spdk_top 00:02:34.915 CXX test/cpp_headers/json.o 00:02:34.915 CXX test/cpp_headers/jsonrpc.o 00:02:34.915 CXX test/cpp_headers/likely.o 00:02:34.915 CXX test/cpp_headers/log.o 00:02:35.180 CXX test/cpp_headers/lvol.o 00:02:35.180 CXX test/cpp_headers/memory.o 00:02:35.180 CXX test/cpp_headers/mmio.o 00:02:35.180 CXX test/cpp_headers/nbd.o 00:02:35.180 CXX test/cpp_headers/notify.o 00:02:35.180 CXX test/cpp_headers/nvme.o 00:02:35.180 CXX test/cpp_headers/nvme_intel.o 00:02:35.180 CXX test/cpp_headers/nvme_ocssd.o 00:02:35.180 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:35.180 CXX test/cpp_headers/nvme_spec.o 00:02:35.180 CXX test/cpp_headers/nvme_zns.o 00:02:35.180 LINK nvme_compliance 00:02:35.180 CXX test/cpp_headers/nvmf_cmd.o 00:02:35.180 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:35.180 CXX test/cpp_headers/nvmf.o 00:02:35.180 CXX test/cpp_headers/nvmf_spec.o 00:02:35.180 CXX test/cpp_headers/nvmf_transport.o 00:02:35.180 CXX test/cpp_headers/opal.o 00:02:35.180 CXX test/cpp_headers/opal_spec.o 00:02:35.180 CXX test/cpp_headers/pci_ids.o 00:02:35.180 CXX test/cpp_headers/pipe.o 00:02:35.180 CXX test/cpp_headers/queue.o 00:02:35.180 CXX test/cpp_headers/reduce.o 00:02:35.180 LINK pci_ut 00:02:35.180 CXX test/cpp_headers/rpc.o 00:02:35.180 CXX test/cpp_headers/scheduler.o 00:02:35.180 LINK vhost_fuzz 00:02:35.180 CXX test/cpp_headers/scsi.o 00:02:35.180 CXX test/cpp_headers/scsi_spec.o 00:02:35.180 CXX test/cpp_headers/sock.o 00:02:35.180 CXX test/cpp_headers/stdinc.o 00:02:35.180 CXX test/cpp_headers/string.o 00:02:35.180 CXX test/cpp_headers/thread.o 00:02:35.180 LINK fdp 00:02:35.180 CXX test/cpp_headers/trace.o 00:02:35.442 CXX test/cpp_headers/trace_parser.o 00:02:35.442 CXX test/cpp_headers/ublk.o 00:02:35.442 CXX test/cpp_headers/tree.o 00:02:35.442 CXX test/cpp_headers/util.o 00:02:35.442 CXX test/cpp_headers/uuid.o 00:02:35.442 CXX test/cpp_headers/version.o 00:02:35.442 CXX test/cpp_headers/vfio_user_pci.o 00:02:35.442 CXX test/cpp_headers/vfio_user_spec.o 00:02:35.442 CXX test/cpp_headers/vhost.o 00:02:35.442 CXX test/cpp_headers/vmd.o 00:02:35.442 CXX test/cpp_headers/xor.o 00:02:35.442 CXX test/cpp_headers/zipf.o 00:02:36.011 LINK memory_ut 00:02:36.272 LINK cuse 00:02:36.532 LINK iscsi_fuzz 00:02:39.069 LINK esnap 00:02:39.328 00:02:39.328 real 0m46.846s 00:02:39.328 user 9m37.528s 00:02:39.328 sys 2m11.328s 00:02:39.328 16:44:50 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:39.328 16:44:50 -- common/autotest_common.sh@10 -- $ set +x 00:02:39.328 ************************************ 00:02:39.328 END TEST make 00:02:39.328 ************************************ 00:02:39.328 16:44:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:39.328 16:44:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:39.328 16:44:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:39.328 16:44:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:39.328 16:44:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:39.328 16:44:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:39.328 16:44:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:39.329 16:44:50 -- scripts/common.sh@335 -- # IFS=.-: 00:02:39.329 16:44:50 -- scripts/common.sh@335 -- # read -ra ver1 00:02:39.329 16:44:50 -- scripts/common.sh@336 -- # IFS=.-: 00:02:39.329 16:44:50 -- scripts/common.sh@336 -- # read -ra ver2 00:02:39.329 16:44:50 -- scripts/common.sh@337 -- # local 'op=<' 00:02:39.329 16:44:50 -- scripts/common.sh@339 -- # ver1_l=2 00:02:39.329 16:44:50 -- scripts/common.sh@340 -- # ver2_l=1 00:02:39.329 16:44:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:39.329 16:44:50 -- scripts/common.sh@343 -- # case "$op" in 00:02:39.329 16:44:50 -- scripts/common.sh@344 -- # : 1 00:02:39.329 16:44:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:39.329 16:44:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:39.329 16:44:50 -- scripts/common.sh@364 -- # decimal 1 00:02:39.329 16:44:50 -- scripts/common.sh@352 -- # local d=1 00:02:39.329 16:44:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:39.329 16:44:50 -- scripts/common.sh@354 -- # echo 1 00:02:39.329 16:44:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:39.329 16:44:50 -- scripts/common.sh@365 -- # decimal 2 00:02:39.329 16:44:50 -- scripts/common.sh@352 -- # local d=2 00:02:39.329 16:44:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:39.329 16:44:50 -- scripts/common.sh@354 -- # echo 2 00:02:39.329 16:44:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:39.329 16:44:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:39.329 16:44:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:39.329 16:44:50 -- scripts/common.sh@367 -- # return 0 00:02:39.329 16:44:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:39.329 16:44:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:39.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.329 --rc genhtml_branch_coverage=1 00:02:39.329 --rc genhtml_function_coverage=1 00:02:39.329 --rc genhtml_legend=1 00:02:39.329 --rc geninfo_all_blocks=1 00:02:39.329 --rc geninfo_unexecuted_blocks=1 00:02:39.329 00:02:39.329 ' 00:02:39.329 16:44:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:39.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.329 --rc genhtml_branch_coverage=1 00:02:39.329 --rc genhtml_function_coverage=1 00:02:39.329 --rc genhtml_legend=1 00:02:39.329 --rc geninfo_all_blocks=1 00:02:39.329 --rc geninfo_unexecuted_blocks=1 00:02:39.329 00:02:39.329 ' 00:02:39.329 16:44:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:39.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.329 --rc genhtml_branch_coverage=1 00:02:39.329 --rc genhtml_function_coverage=1 00:02:39.329 --rc genhtml_legend=1 00:02:39.329 --rc geninfo_all_blocks=1 00:02:39.329 --rc geninfo_unexecuted_blocks=1 00:02:39.329 00:02:39.329 ' 00:02:39.329 16:44:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:39.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.329 --rc genhtml_branch_coverage=1 00:02:39.329 --rc genhtml_function_coverage=1 00:02:39.329 --rc genhtml_legend=1 00:02:39.329 --rc geninfo_all_blocks=1 00:02:39.329 --rc geninfo_unexecuted_blocks=1 00:02:39.329 00:02:39.329 ' 00:02:39.329 16:44:50 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:39.329 16:44:50 -- nvmf/common.sh@7 -- # uname -s 00:02:39.329 16:44:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:39.329 16:44:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:39.329 16:44:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:39.329 16:44:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:39.329 16:44:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:39.329 16:44:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:39.329 16:44:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:39.329 16:44:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:39.329 16:44:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:39.329 16:44:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:39.589 16:44:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:39.589 16:44:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:39.589 16:44:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:39.589 16:44:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:39.589 16:44:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:39.589 16:44:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:39.589 16:44:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:39.589 16:44:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:39.589 16:44:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:39.589 16:44:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:39.589 16:44:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:39.589 16:44:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:39.589 16:44:50 -- paths/export.sh@5 -- # export PATH 00:02:39.589 16:44:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:39.589 16:44:50 -- nvmf/common.sh@46 -- # : 0 00:02:39.589 16:44:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:39.589 16:44:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:39.589 16:44:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:39.589 16:44:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:39.589 16:44:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:39.589 16:44:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:39.589 16:44:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:39.589 16:44:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:39.589 16:44:50 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:39.589 16:44:50 -- spdk/autotest.sh@32 -- # uname -s 00:02:39.589 16:44:50 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:39.589 16:44:50 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:39.589 16:44:50 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:39.589 16:44:50 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:39.589 16:44:50 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:39.589 16:44:50 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:39.589 16:44:50 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:39.589 16:44:50 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:39.589 16:44:50 -- spdk/autotest.sh@48 -- # udevadm_pid=49670 00:02:39.589 16:44:50 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:39.589 16:44:50 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:39.589 16:44:50 -- spdk/autotest.sh@54 -- # echo 49672 00:02:39.589 16:44:50 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:39.589 16:44:50 -- spdk/autotest.sh@56 -- # echo 49673 00:02:39.589 16:44:50 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:39.589 16:44:50 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:39.589 16:44:50 -- spdk/autotest.sh@60 -- # echo 49674 00:02:39.589 16:44:50 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:39.589 16:44:50 -- spdk/autotest.sh@62 -- # echo 49675 00:02:39.589 16:44:50 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:39.589 16:44:50 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:39.589 16:44:50 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:39.589 16:44:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:39.589 16:44:50 -- common/autotest_common.sh@10 -- # set +x 00:02:39.589 16:44:50 -- spdk/autotest.sh@70 -- # create_test_list 00:02:39.589 16:44:50 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:39.589 16:44:50 -- common/autotest_common.sh@10 -- # set +x 00:02:39.589 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:39.589 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:39.589 16:44:50 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:39.589 16:44:50 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:39.589 16:44:50 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:39.589 16:44:50 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:39.589 16:44:50 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:39.589 16:44:50 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:39.589 16:44:50 -- common/autotest_common.sh@1450 -- # uname 00:02:39.589 16:44:50 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:39.589 16:44:50 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:39.589 16:44:50 -- common/autotest_common.sh@1470 -- # uname 00:02:39.589 16:44:50 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:39.589 16:44:50 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:39.589 16:44:50 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:39.589 lcov: LCOV version 1.15 00:02:39.589 16:44:50 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:43.795 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:43.795 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:43.795 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:43.795 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:43.795 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:43.795 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:15.899 16:45:23 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:15.899 16:45:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:15.899 16:45:23 -- common/autotest_common.sh@10 -- # set +x 00:03:15.899 16:45:23 -- spdk/autotest.sh@89 -- # rm -f 00:03:15.899 16:45:23 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:15.899 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:15.899 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:15.899 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:15.899 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:15.899 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:15.899 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:15.899 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:15.899 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:15.899 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:15.899 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:15.899 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:15.899 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:15.899 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:15.899 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:15.899 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:15.899 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:15.899 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:15.899 16:45:24 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:15.899 16:45:24 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:15.899 16:45:24 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:15.899 16:45:24 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:15.899 16:45:24 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:15.899 16:45:24 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:15.899 16:45:24 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:15.899 16:45:24 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:15.899 16:45:24 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:15.899 16:45:24 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:15.899 16:45:24 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:15.899 16:45:24 -- spdk/autotest.sh@108 -- # grep -v p 00:03:15.899 16:45:24 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:15.899 16:45:24 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:15.899 16:45:24 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:15.899 16:45:24 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:15.899 16:45:24 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:15.899 No valid GPT data, bailing 00:03:15.899 16:45:24 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:15.899 16:45:24 -- scripts/common.sh@393 -- # pt= 00:03:15.899 16:45:24 -- scripts/common.sh@394 -- # return 1 00:03:15.899 16:45:24 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:15.899 1+0 records in 00:03:15.899 1+0 records out 00:03:15.899 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00204904 s, 512 MB/s 00:03:15.899 16:45:24 -- spdk/autotest.sh@116 -- # sync 00:03:15.899 16:45:24 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:15.899 16:45:24 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:15.899 16:45:24 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:15.899 16:45:26 -- spdk/autotest.sh@122 -- # uname -s 00:03:15.899 16:45:26 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:15.899 16:45:26 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:15.899 16:45:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.899 16:45:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.899 16:45:26 -- common/autotest_common.sh@10 -- # set +x 00:03:15.899 ************************************ 00:03:15.899 START TEST setup.sh 00:03:15.899 ************************************ 00:03:15.899 16:45:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:15.899 * Looking for test storage... 00:03:15.899 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:15.899 16:45:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:15.899 16:45:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:15.900 16:45:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:15.900 16:45:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:15.900 16:45:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:15.900 16:45:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:15.900 16:45:27 -- scripts/common.sh@335 -- # IFS=.-: 00:03:15.900 16:45:27 -- scripts/common.sh@335 -- # read -ra ver1 00:03:15.900 16:45:27 -- scripts/common.sh@336 -- # IFS=.-: 00:03:15.900 16:45:27 -- scripts/common.sh@336 -- # read -ra ver2 00:03:15.900 16:45:27 -- scripts/common.sh@337 -- # local 'op=<' 00:03:15.900 16:45:27 -- scripts/common.sh@339 -- # ver1_l=2 00:03:15.900 16:45:27 -- scripts/common.sh@340 -- # ver2_l=1 00:03:15.900 16:45:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:15.900 16:45:27 -- scripts/common.sh@343 -- # case "$op" in 00:03:15.900 16:45:27 -- scripts/common.sh@344 -- # : 1 00:03:15.900 16:45:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:15.900 16:45:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:15.900 16:45:27 -- scripts/common.sh@364 -- # decimal 1 00:03:15.900 16:45:27 -- scripts/common.sh@352 -- # local d=1 00:03:15.900 16:45:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:15.900 16:45:27 -- scripts/common.sh@354 -- # echo 1 00:03:15.900 16:45:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:15.900 16:45:27 -- scripts/common.sh@365 -- # decimal 2 00:03:15.900 16:45:27 -- scripts/common.sh@352 -- # local d=2 00:03:15.900 16:45:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:15.900 16:45:27 -- scripts/common.sh@354 -- # echo 2 00:03:15.900 16:45:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:15.900 16:45:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:15.900 16:45:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:15.900 16:45:27 -- scripts/common.sh@367 -- # return 0 00:03:15.900 16:45:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:15.900 --rc genhtml_branch_coverage=1 00:03:15.900 --rc genhtml_function_coverage=1 00:03:15.900 --rc genhtml_legend=1 00:03:15.900 --rc geninfo_all_blocks=1 00:03:15.900 --rc geninfo_unexecuted_blocks=1 00:03:15.900 00:03:15.900 ' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:15.900 --rc genhtml_branch_coverage=1 00:03:15.900 --rc genhtml_function_coverage=1 00:03:15.900 --rc genhtml_legend=1 00:03:15.900 --rc geninfo_all_blocks=1 00:03:15.900 --rc geninfo_unexecuted_blocks=1 00:03:15.900 00:03:15.900 ' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:15.900 --rc genhtml_branch_coverage=1 00:03:15.900 --rc genhtml_function_coverage=1 00:03:15.900 --rc genhtml_legend=1 00:03:15.900 --rc geninfo_all_blocks=1 00:03:15.900 --rc geninfo_unexecuted_blocks=1 00:03:15.900 00:03:15.900 ' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:15.900 --rc genhtml_branch_coverage=1 00:03:15.900 --rc genhtml_function_coverage=1 00:03:15.900 --rc genhtml_legend=1 00:03:15.900 --rc geninfo_all_blocks=1 00:03:15.900 --rc geninfo_unexecuted_blocks=1 00:03:15.900 00:03:15.900 ' 00:03:15.900 16:45:27 -- setup/test-setup.sh@10 -- # uname -s 00:03:15.900 16:45:27 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:15.900 16:45:27 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:15.900 16:45:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.900 16:45:27 -- common/autotest_common.sh@10 -- # set +x 00:03:15.900 ************************************ 00:03:15.900 START TEST acl 00:03:15.900 ************************************ 00:03:15.900 16:45:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:15.900 * Looking for test storage... 00:03:15.900 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:15.900 16:45:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:15.900 16:45:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:15.900 16:45:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:15.900 16:45:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:15.900 16:45:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:15.900 16:45:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:15.900 16:45:27 -- scripts/common.sh@335 -- # IFS=.-: 00:03:15.900 16:45:27 -- scripts/common.sh@335 -- # read -ra ver1 00:03:15.900 16:45:27 -- scripts/common.sh@336 -- # IFS=.-: 00:03:15.900 16:45:27 -- scripts/common.sh@336 -- # read -ra ver2 00:03:15.900 16:45:27 -- scripts/common.sh@337 -- # local 'op=<' 00:03:15.900 16:45:27 -- scripts/common.sh@339 -- # ver1_l=2 00:03:15.900 16:45:27 -- scripts/common.sh@340 -- # ver2_l=1 00:03:15.900 16:45:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:15.900 16:45:27 -- scripts/common.sh@343 -- # case "$op" in 00:03:15.900 16:45:27 -- scripts/common.sh@344 -- # : 1 00:03:15.900 16:45:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:15.900 16:45:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:15.900 16:45:27 -- scripts/common.sh@364 -- # decimal 1 00:03:15.900 16:45:27 -- scripts/common.sh@352 -- # local d=1 00:03:15.900 16:45:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:15.900 16:45:27 -- scripts/common.sh@354 -- # echo 1 00:03:15.900 16:45:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:15.900 16:45:27 -- scripts/common.sh@365 -- # decimal 2 00:03:15.900 16:45:27 -- scripts/common.sh@352 -- # local d=2 00:03:15.900 16:45:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:15.900 16:45:27 -- scripts/common.sh@354 -- # echo 2 00:03:15.900 16:45:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:15.900 16:45:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:15.900 16:45:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:15.900 16:45:27 -- scripts/common.sh@367 -- # return 0 00:03:15.900 16:45:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:15.900 --rc genhtml_branch_coverage=1 00:03:15.900 --rc genhtml_function_coverage=1 00:03:15.900 --rc genhtml_legend=1 00:03:15.900 --rc geninfo_all_blocks=1 00:03:15.900 --rc geninfo_unexecuted_blocks=1 00:03:15.900 00:03:15.900 ' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:15.900 --rc genhtml_branch_coverage=1 00:03:15.900 --rc genhtml_function_coverage=1 00:03:15.900 --rc genhtml_legend=1 00:03:15.900 --rc geninfo_all_blocks=1 00:03:15.900 --rc geninfo_unexecuted_blocks=1 00:03:15.900 00:03:15.900 ' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:15.900 --rc genhtml_branch_coverage=1 00:03:15.900 --rc genhtml_function_coverage=1 00:03:15.900 --rc genhtml_legend=1 00:03:15.900 --rc geninfo_all_blocks=1 00:03:15.900 --rc geninfo_unexecuted_blocks=1 00:03:15.900 00:03:15.900 ' 00:03:15.900 16:45:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:15.900 --rc genhtml_branch_coverage=1 00:03:15.900 --rc genhtml_function_coverage=1 00:03:15.900 --rc genhtml_legend=1 00:03:15.900 --rc geninfo_all_blocks=1 00:03:15.900 --rc geninfo_unexecuted_blocks=1 00:03:15.900 00:03:15.900 ' 00:03:15.900 16:45:27 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:15.900 16:45:27 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:15.900 16:45:27 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:15.900 16:45:27 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:15.900 16:45:27 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:15.900 16:45:27 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:15.900 16:45:27 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:15.900 16:45:27 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:15.900 16:45:27 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:15.900 16:45:27 -- setup/acl.sh@12 -- # devs=() 00:03:15.900 16:45:27 -- setup/acl.sh@12 -- # declare -a devs 00:03:15.900 16:45:27 -- setup/acl.sh@13 -- # drivers=() 00:03:15.900 16:45:27 -- setup/acl.sh@13 -- # declare -A drivers 00:03:15.900 16:45:27 -- setup/acl.sh@51 -- # setup reset 00:03:15.900 16:45:27 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:15.900 16:45:27 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:17.810 16:45:28 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:17.810 16:45:28 -- setup/acl.sh@16 -- # local dev driver 00:03:17.810 16:45:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:17.810 16:45:28 -- setup/acl.sh@15 -- # setup output status 00:03:17.810 16:45:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.810 16:45:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:18.747 Hugepages 00:03:18.747 node hugesize free / total 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # continue 00:03:18.747 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # continue 00:03:18.747 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # continue 00:03:18.747 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.747 00:03:18.747 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # continue 00:03:18.747 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:18.747 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.747 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.747 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:18.747 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.747 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.747 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:18.747 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.747 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.747 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:18.747 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.747 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.747 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.747 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # continue 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:18.748 16:45:29 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:18.748 16:45:29 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:18.748 16:45:29 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:18.748 16:45:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:18.748 16:45:29 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:18.748 16:45:29 -- setup/acl.sh@54 -- # run_test denied denied 00:03:18.748 16:45:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:18.748 16:45:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:18.748 16:45:29 -- common/autotest_common.sh@10 -- # set +x 00:03:18.748 ************************************ 00:03:18.748 START TEST denied 00:03:18.748 ************************************ 00:03:18.748 16:45:29 -- common/autotest_common.sh@1114 -- # denied 00:03:18.748 16:45:29 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:18.748 16:45:29 -- setup/acl.sh@38 -- # setup output config 00:03:18.748 16:45:29 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:18.748 16:45:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:18.748 16:45:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:20.654 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:20.654 16:45:31 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:20.654 16:45:31 -- setup/acl.sh@28 -- # local dev driver 00:03:20.654 16:45:31 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:20.654 16:45:31 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:20.654 16:45:31 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:20.654 16:45:31 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:20.654 16:45:31 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:20.654 16:45:31 -- setup/acl.sh@41 -- # setup reset 00:03:20.654 16:45:31 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:20.654 16:45:31 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:23.197 00:03:23.197 real 0m4.107s 00:03:23.197 user 0m1.235s 00:03:23.197 sys 0m1.959s 00:03:23.197 16:45:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.197 16:45:34 -- common/autotest_common.sh@10 -- # set +x 00:03:23.197 ************************************ 00:03:23.197 END TEST denied 00:03:23.197 ************************************ 00:03:23.197 16:45:34 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:23.197 16:45:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:23.197 16:45:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:23.197 16:45:34 -- common/autotest_common.sh@10 -- # set +x 00:03:23.197 ************************************ 00:03:23.197 START TEST allowed 00:03:23.197 ************************************ 00:03:23.197 16:45:34 -- common/autotest_common.sh@1114 -- # allowed 00:03:23.197 16:45:34 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:23.197 16:45:34 -- setup/acl.sh@45 -- # setup output config 00:03:23.197 16:45:34 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:23.197 16:45:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.197 16:45:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:25.108 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:25.108 16:45:36 -- setup/acl.sh@47 -- # verify 00:03:25.108 16:45:36 -- setup/acl.sh@28 -- # local dev driver 00:03:25.108 16:45:36 -- setup/acl.sh@48 -- # setup reset 00:03:25.108 16:45:36 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:25.108 16:45:36 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:27.018 00:03:27.018 real 0m3.998s 00:03:27.018 user 0m1.084s 00:03:27.018 sys 0m1.837s 00:03:27.018 16:45:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:27.018 16:45:38 -- common/autotest_common.sh@10 -- # set +x 00:03:27.018 ************************************ 00:03:27.018 END TEST allowed 00:03:27.018 ************************************ 00:03:27.018 00:03:27.018 real 0m11.010s 00:03:27.018 user 0m3.445s 00:03:27.018 sys 0m5.677s 00:03:27.018 16:45:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:27.018 16:45:38 -- common/autotest_common.sh@10 -- # set +x 00:03:27.018 ************************************ 00:03:27.018 END TEST acl 00:03:27.018 ************************************ 00:03:27.018 16:45:38 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:27.018 16:45:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:27.018 16:45:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:27.018 16:45:38 -- common/autotest_common.sh@10 -- # set +x 00:03:27.018 ************************************ 00:03:27.018 START TEST hugepages 00:03:27.018 ************************************ 00:03:27.018 16:45:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:27.018 * Looking for test storage... 00:03:27.018 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:27.018 16:45:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:27.018 16:45:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:27.018 16:45:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:27.018 16:45:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:27.018 16:45:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:27.018 16:45:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:27.018 16:45:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:27.018 16:45:38 -- scripts/common.sh@335 -- # IFS=.-: 00:03:27.018 16:45:38 -- scripts/common.sh@335 -- # read -ra ver1 00:03:27.018 16:45:38 -- scripts/common.sh@336 -- # IFS=.-: 00:03:27.018 16:45:38 -- scripts/common.sh@336 -- # read -ra ver2 00:03:27.018 16:45:38 -- scripts/common.sh@337 -- # local 'op=<' 00:03:27.018 16:45:38 -- scripts/common.sh@339 -- # ver1_l=2 00:03:27.018 16:45:38 -- scripts/common.sh@340 -- # ver2_l=1 00:03:27.018 16:45:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:27.018 16:45:38 -- scripts/common.sh@343 -- # case "$op" in 00:03:27.018 16:45:38 -- scripts/common.sh@344 -- # : 1 00:03:27.018 16:45:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:27.018 16:45:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:27.018 16:45:38 -- scripts/common.sh@364 -- # decimal 1 00:03:27.018 16:45:38 -- scripts/common.sh@352 -- # local d=1 00:03:27.018 16:45:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:27.018 16:45:38 -- scripts/common.sh@354 -- # echo 1 00:03:27.018 16:45:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:27.018 16:45:38 -- scripts/common.sh@365 -- # decimal 2 00:03:27.018 16:45:38 -- scripts/common.sh@352 -- # local d=2 00:03:27.018 16:45:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:27.018 16:45:38 -- scripts/common.sh@354 -- # echo 2 00:03:27.018 16:45:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:27.018 16:45:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:27.018 16:45:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:27.018 16:45:38 -- scripts/common.sh@367 -- # return 0 00:03:27.018 16:45:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:27.018 16:45:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:27.018 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.018 --rc genhtml_branch_coverage=1 00:03:27.018 --rc genhtml_function_coverage=1 00:03:27.018 --rc genhtml_legend=1 00:03:27.018 --rc geninfo_all_blocks=1 00:03:27.018 --rc geninfo_unexecuted_blocks=1 00:03:27.018 00:03:27.018 ' 00:03:27.018 16:45:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:27.018 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.018 --rc genhtml_branch_coverage=1 00:03:27.018 --rc genhtml_function_coverage=1 00:03:27.018 --rc genhtml_legend=1 00:03:27.018 --rc geninfo_all_blocks=1 00:03:27.018 --rc geninfo_unexecuted_blocks=1 00:03:27.018 00:03:27.018 ' 00:03:27.018 16:45:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:27.018 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.018 --rc genhtml_branch_coverage=1 00:03:27.018 --rc genhtml_function_coverage=1 00:03:27.018 --rc genhtml_legend=1 00:03:27.018 --rc geninfo_all_blocks=1 00:03:27.018 --rc geninfo_unexecuted_blocks=1 00:03:27.018 00:03:27.018 ' 00:03:27.018 16:45:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:27.018 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.018 --rc genhtml_branch_coverage=1 00:03:27.018 --rc genhtml_function_coverage=1 00:03:27.018 --rc genhtml_legend=1 00:03:27.018 --rc geninfo_all_blocks=1 00:03:27.018 --rc geninfo_unexecuted_blocks=1 00:03:27.018 00:03:27.018 ' 00:03:27.018 16:45:38 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:27.019 16:45:38 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:27.019 16:45:38 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:27.019 16:45:38 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:27.019 16:45:38 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:27.019 16:45:38 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:27.019 16:45:38 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:27.019 16:45:38 -- setup/common.sh@18 -- # local node= 00:03:27.019 16:45:38 -- setup/common.sh@19 -- # local var val 00:03:27.019 16:45:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.019 16:45:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.019 16:45:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.019 16:45:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.019 16:45:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.019 16:45:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44715464 kB' 'MemAvailable: 48328520 kB' 'Buffers: 11580 kB' 'Cached: 9190396 kB' 'SwapCached: 0 kB' 'Active: 6103288 kB' 'Inactive: 3666228 kB' 'Active(anon): 5740636 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 570956 kB' 'Mapped: 141940 kB' 'Shmem: 5173096 kB' 'KReclaimable: 155996 kB' 'Slab: 519232 kB' 'SReclaimable: 155996 kB' 'SUnreclaim: 363236 kB' 'KernelStack: 12720 kB' 'PageTables: 7668 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 7508688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 194900 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.019 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.019 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # continue 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.020 16:45:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.020 16:45:38 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:27.020 16:45:38 -- setup/common.sh@33 -- # echo 2048 00:03:27.020 16:45:38 -- setup/common.sh@33 -- # return 0 00:03:27.020 16:45:38 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:27.020 16:45:38 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:27.020 16:45:38 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:27.020 16:45:38 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:27.020 16:45:38 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:27.020 16:45:38 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:27.020 16:45:38 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:27.020 16:45:38 -- setup/hugepages.sh@207 -- # get_nodes 00:03:27.020 16:45:38 -- setup/hugepages.sh@27 -- # local node 00:03:27.020 16:45:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:27.020 16:45:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:27.020 16:45:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:27.020 16:45:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:27.020 16:45:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:27.020 16:45:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:27.020 16:45:38 -- setup/hugepages.sh@208 -- # clear_hp 00:03:27.020 16:45:38 -- setup/hugepages.sh@37 -- # local node hp 00:03:27.020 16:45:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:27.020 16:45:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:27.020 16:45:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:27.020 16:45:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:27.020 16:45:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:27.020 16:45:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:27.020 16:45:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:27.020 16:45:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:27.020 16:45:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:27.020 16:45:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:27.020 16:45:38 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:27.020 16:45:38 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:27.020 16:45:38 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:27.020 16:45:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:27.020 16:45:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:27.020 16:45:38 -- common/autotest_common.sh@10 -- # set +x 00:03:27.020 ************************************ 00:03:27.020 START TEST default_setup 00:03:27.020 ************************************ 00:03:27.020 16:45:38 -- common/autotest_common.sh@1114 -- # default_setup 00:03:27.020 16:45:38 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:27.020 16:45:38 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:27.020 16:45:38 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:27.020 16:45:38 -- setup/hugepages.sh@51 -- # shift 00:03:27.020 16:45:38 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:27.020 16:45:38 -- setup/hugepages.sh@52 -- # local node_ids 00:03:27.020 16:45:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:27.020 16:45:38 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:27.020 16:45:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:27.020 16:45:38 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:27.020 16:45:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:27.020 16:45:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:27.020 16:45:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:27.020 16:45:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:27.020 16:45:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:27.020 16:45:38 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:27.020 16:45:38 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:27.020 16:45:38 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:27.020 16:45:38 -- setup/hugepages.sh@73 -- # return 0 00:03:27.020 16:45:38 -- setup/hugepages.sh@137 -- # setup output 00:03:27.020 16:45:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:27.020 16:45:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:28.402 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:28.402 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:28.402 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:28.402 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:28.402 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:28.402 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:28.402 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:28.402 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:28.402 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:28.402 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:28.402 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:28.402 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:28.402 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:28.402 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:28.402 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:28.402 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:29.341 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:29.604 16:45:40 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:29.604 16:45:40 -- setup/hugepages.sh@89 -- # local node 00:03:29.604 16:45:40 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.604 16:45:40 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.604 16:45:40 -- setup/hugepages.sh@92 -- # local surp 00:03:29.604 16:45:40 -- setup/hugepages.sh@93 -- # local resv 00:03:29.604 16:45:40 -- setup/hugepages.sh@94 -- # local anon 00:03:29.604 16:45:40 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.604 16:45:40 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.604 16:45:40 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.604 16:45:40 -- setup/common.sh@18 -- # local node= 00:03:29.604 16:45:40 -- setup/common.sh@19 -- # local var val 00:03:29.604 16:45:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.604 16:45:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.604 16:45:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.604 16:45:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.604 16:45:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.604 16:45:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.604 16:45:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46827180 kB' 'MemAvailable: 50440552 kB' 'Buffers: 11580 kB' 'Cached: 9190484 kB' 'SwapCached: 0 kB' 'Active: 6106860 kB' 'Inactive: 3666228 kB' 'Active(anon): 5744208 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 574380 kB' 'Mapped: 141524 kB' 'Shmem: 5173184 kB' 'KReclaimable: 156632 kB' 'Slab: 519884 kB' 'SReclaimable: 156632 kB' 'SUnreclaim: 363252 kB' 'KernelStack: 12544 kB' 'PageTables: 7496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511344 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195012 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.604 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.604 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.605 16:45:40 -- setup/common.sh@33 -- # echo 0 00:03:29.605 16:45:40 -- setup/common.sh@33 -- # return 0 00:03:29.605 16:45:40 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.605 16:45:40 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.605 16:45:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.605 16:45:40 -- setup/common.sh@18 -- # local node= 00:03:29.605 16:45:40 -- setup/common.sh@19 -- # local var val 00:03:29.605 16:45:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.605 16:45:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.605 16:45:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.605 16:45:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.605 16:45:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.605 16:45:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46827804 kB' 'MemAvailable: 50441160 kB' 'Buffers: 11580 kB' 'Cached: 9190488 kB' 'SwapCached: 0 kB' 'Active: 6107288 kB' 'Inactive: 3666228 kB' 'Active(anon): 5744636 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 574852 kB' 'Mapped: 141592 kB' 'Shmem: 5173188 kB' 'KReclaimable: 156600 kB' 'Slab: 519888 kB' 'SReclaimable: 156600 kB' 'SUnreclaim: 363288 kB' 'KernelStack: 12640 kB' 'PageTables: 7336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 194996 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.605 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.605 16:45:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.606 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.606 16:45:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.607 16:45:40 -- setup/common.sh@33 -- # echo 0 00:03:29.607 16:45:40 -- setup/common.sh@33 -- # return 0 00:03:29.607 16:45:40 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.607 16:45:40 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.607 16:45:40 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.607 16:45:40 -- setup/common.sh@18 -- # local node= 00:03:29.607 16:45:40 -- setup/common.sh@19 -- # local var val 00:03:29.607 16:45:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.607 16:45:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.607 16:45:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.607 16:45:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.607 16:45:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.607 16:45:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46831860 kB' 'MemAvailable: 50445216 kB' 'Buffers: 11580 kB' 'Cached: 9190496 kB' 'SwapCached: 0 kB' 'Active: 6106892 kB' 'Inactive: 3666228 kB' 'Active(anon): 5744240 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 574396 kB' 'Mapped: 141504 kB' 'Shmem: 5173196 kB' 'KReclaimable: 156600 kB' 'Slab: 519868 kB' 'SReclaimable: 156600 kB' 'SUnreclaim: 363268 kB' 'KernelStack: 12672 kB' 'PageTables: 7332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511372 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195028 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.607 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.607 16:45:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.608 16:45:40 -- setup/common.sh@33 -- # echo 0 00:03:29.608 16:45:40 -- setup/common.sh@33 -- # return 0 00:03:29.608 16:45:40 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.608 16:45:40 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:29.608 nr_hugepages=1024 00:03:29.608 16:45:40 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.608 resv_hugepages=0 00:03:29.608 16:45:40 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.608 surplus_hugepages=0 00:03:29.608 16:45:40 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.608 anon_hugepages=0 00:03:29.608 16:45:40 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.608 16:45:40 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:29.608 16:45:40 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.608 16:45:40 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.608 16:45:40 -- setup/common.sh@18 -- # local node= 00:03:29.608 16:45:40 -- setup/common.sh@19 -- # local var val 00:03:29.608 16:45:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.608 16:45:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.608 16:45:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.608 16:45:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.608 16:45:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.608 16:45:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46832200 kB' 'MemAvailable: 50445556 kB' 'Buffers: 11580 kB' 'Cached: 9190512 kB' 'SwapCached: 0 kB' 'Active: 6106828 kB' 'Inactive: 3666228 kB' 'Active(anon): 5744176 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 574272 kB' 'Mapped: 141504 kB' 'Shmem: 5173212 kB' 'KReclaimable: 156600 kB' 'Slab: 519868 kB' 'SReclaimable: 156600 kB' 'SUnreclaim: 363268 kB' 'KernelStack: 12688 kB' 'PageTables: 7380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511388 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195028 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.608 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.608 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.609 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.609 16:45:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.610 16:45:40 -- setup/common.sh@33 -- # echo 1024 00:03:29.610 16:45:40 -- setup/common.sh@33 -- # return 0 00:03:29.610 16:45:40 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.610 16:45:40 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.610 16:45:40 -- setup/hugepages.sh@27 -- # local node 00:03:29.610 16:45:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.610 16:45:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:29.610 16:45:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.610 16:45:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:29.610 16:45:40 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.610 16:45:40 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.610 16:45:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.610 16:45:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.610 16:45:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.610 16:45:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.610 16:45:40 -- setup/common.sh@18 -- # local node=0 00:03:29.610 16:45:40 -- setup/common.sh@19 -- # local var val 00:03:29.610 16:45:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.610 16:45:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.610 16:45:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.610 16:45:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.610 16:45:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.610 16:45:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21242536 kB' 'MemUsed: 11632388 kB' 'SwapCached: 0 kB' 'Active: 5009216 kB' 'Inactive: 3516972 kB' 'Active(anon): 4889872 kB' 'Inactive(anon): 0 kB' 'Active(file): 119344 kB' 'Inactive(file): 3516972 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8062204 kB' 'Mapped: 66996 kB' 'AnonPages: 467180 kB' 'Shmem: 4425888 kB' 'KernelStack: 8136 kB' 'PageTables: 4588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104804 kB' 'Slab: 328152 kB' 'SReclaimable: 104804 kB' 'SUnreclaim: 223348 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.610 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.610 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # continue 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.611 16:45:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.611 16:45:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.611 16:45:40 -- setup/common.sh@33 -- # echo 0 00:03:29.611 16:45:40 -- setup/common.sh@33 -- # return 0 00:03:29.611 16:45:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.611 16:45:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.611 16:45:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.611 16:45:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.611 16:45:40 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:29.611 node0=1024 expecting 1024 00:03:29.611 16:45:40 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:29.611 00:03:29.611 real 0m2.657s 00:03:29.611 user 0m0.718s 00:03:29.611 sys 0m1.028s 00:03:29.611 16:45:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:29.611 16:45:40 -- common/autotest_common.sh@10 -- # set +x 00:03:29.611 ************************************ 00:03:29.611 END TEST default_setup 00:03:29.611 ************************************ 00:03:29.611 16:45:41 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:29.611 16:45:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.611 16:45:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.611 16:45:41 -- common/autotest_common.sh@10 -- # set +x 00:03:29.611 ************************************ 00:03:29.611 START TEST per_node_1G_alloc 00:03:29.611 ************************************ 00:03:29.611 16:45:41 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:29.611 16:45:41 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:29.611 16:45:41 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:29.611 16:45:41 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:29.611 16:45:41 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:29.611 16:45:41 -- setup/hugepages.sh@51 -- # shift 00:03:29.611 16:45:41 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:29.611 16:45:41 -- setup/hugepages.sh@52 -- # local node_ids 00:03:29.611 16:45:41 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:29.611 16:45:41 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:29.611 16:45:41 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:29.611 16:45:41 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:29.611 16:45:41 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:29.611 16:45:41 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:29.611 16:45:41 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:29.611 16:45:41 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:29.611 16:45:41 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:29.611 16:45:41 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:29.611 16:45:41 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:29.611 16:45:41 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:29.611 16:45:41 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:29.611 16:45:41 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:29.611 16:45:41 -- setup/hugepages.sh@73 -- # return 0 00:03:29.611 16:45:41 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:29.611 16:45:41 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:29.611 16:45:41 -- setup/hugepages.sh@146 -- # setup output 00:03:29.611 16:45:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.611 16:45:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:30.990 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.990 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:30.990 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.990 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.990 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.990 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.990 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.990 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.990 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.990 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.990 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.990 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.990 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.990 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.990 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.990 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.990 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:31.253 16:45:42 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:31.253 16:45:42 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:31.253 16:45:42 -- setup/hugepages.sh@89 -- # local node 00:03:31.253 16:45:42 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:31.253 16:45:42 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:31.253 16:45:42 -- setup/hugepages.sh@92 -- # local surp 00:03:31.254 16:45:42 -- setup/hugepages.sh@93 -- # local resv 00:03:31.254 16:45:42 -- setup/hugepages.sh@94 -- # local anon 00:03:31.254 16:45:42 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:31.254 16:45:42 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:31.254 16:45:42 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:31.254 16:45:42 -- setup/common.sh@18 -- # local node= 00:03:31.254 16:45:42 -- setup/common.sh@19 -- # local var val 00:03:31.254 16:45:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.254 16:45:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.254 16:45:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.254 16:45:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.254 16:45:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.254 16:45:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46821748 kB' 'MemAvailable: 50435104 kB' 'Buffers: 11580 kB' 'Cached: 9190576 kB' 'SwapCached: 0 kB' 'Active: 6108152 kB' 'Inactive: 3666228 kB' 'Active(anon): 5745500 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 575632 kB' 'Mapped: 141632 kB' 'Shmem: 5173276 kB' 'KReclaimable: 156600 kB' 'Slab: 520524 kB' 'SReclaimable: 156600 kB' 'SUnreclaim: 363924 kB' 'KernelStack: 12704 kB' 'PageTables: 7388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511568 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195172 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.254 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.254 16:45:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.255 16:45:42 -- setup/common.sh@33 -- # echo 0 00:03:31.255 16:45:42 -- setup/common.sh@33 -- # return 0 00:03:31.255 16:45:42 -- setup/hugepages.sh@97 -- # anon=0 00:03:31.255 16:45:42 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:31.255 16:45:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.255 16:45:42 -- setup/common.sh@18 -- # local node= 00:03:31.255 16:45:42 -- setup/common.sh@19 -- # local var val 00:03:31.255 16:45:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.255 16:45:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.255 16:45:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.255 16:45:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.255 16:45:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.255 16:45:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46823336 kB' 'MemAvailable: 50436692 kB' 'Buffers: 11580 kB' 'Cached: 9190576 kB' 'SwapCached: 0 kB' 'Active: 6108112 kB' 'Inactive: 3666228 kB' 'Active(anon): 5745460 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 575592 kB' 'Mapped: 141588 kB' 'Shmem: 5173276 kB' 'KReclaimable: 156600 kB' 'Slab: 520544 kB' 'SReclaimable: 156600 kB' 'SUnreclaim: 363944 kB' 'KernelStack: 12704 kB' 'PageTables: 7364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511580 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195172 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.255 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.255 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.256 16:45:42 -- setup/common.sh@33 -- # echo 0 00:03:31.256 16:45:42 -- setup/common.sh@33 -- # return 0 00:03:31.256 16:45:42 -- setup/hugepages.sh@99 -- # surp=0 00:03:31.256 16:45:42 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:31.256 16:45:42 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:31.256 16:45:42 -- setup/common.sh@18 -- # local node= 00:03:31.256 16:45:42 -- setup/common.sh@19 -- # local var val 00:03:31.256 16:45:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.256 16:45:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.256 16:45:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.256 16:45:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.256 16:45:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.256 16:45:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46823916 kB' 'MemAvailable: 50437272 kB' 'Buffers: 11580 kB' 'Cached: 9190576 kB' 'SwapCached: 0 kB' 'Active: 6108120 kB' 'Inactive: 3666228 kB' 'Active(anon): 5745468 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 575568 kB' 'Mapped: 141512 kB' 'Shmem: 5173276 kB' 'KReclaimable: 156600 kB' 'Slab: 520472 kB' 'SReclaimable: 156600 kB' 'SUnreclaim: 363872 kB' 'KernelStack: 12704 kB' 'PageTables: 7348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195156 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.256 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.256 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.257 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.257 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.258 16:45:42 -- setup/common.sh@33 -- # echo 0 00:03:31.258 16:45:42 -- setup/common.sh@33 -- # return 0 00:03:31.258 16:45:42 -- setup/hugepages.sh@100 -- # resv=0 00:03:31.258 16:45:42 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:31.258 nr_hugepages=1024 00:03:31.258 16:45:42 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:31.258 resv_hugepages=0 00:03:31.258 16:45:42 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:31.258 surplus_hugepages=0 00:03:31.258 16:45:42 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:31.258 anon_hugepages=0 00:03:31.258 16:45:42 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.258 16:45:42 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:31.258 16:45:42 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:31.258 16:45:42 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:31.258 16:45:42 -- setup/common.sh@18 -- # local node= 00:03:31.258 16:45:42 -- setup/common.sh@19 -- # local var val 00:03:31.258 16:45:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.258 16:45:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.258 16:45:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.258 16:45:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.258 16:45:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.258 16:45:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46823916 kB' 'MemAvailable: 50437272 kB' 'Buffers: 11580 kB' 'Cached: 9190604 kB' 'SwapCached: 0 kB' 'Active: 6108232 kB' 'Inactive: 3666228 kB' 'Active(anon): 5745580 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 575680 kB' 'Mapped: 141512 kB' 'Shmem: 5173304 kB' 'KReclaimable: 156600 kB' 'Slab: 520456 kB' 'SReclaimable: 156600 kB' 'SUnreclaim: 363856 kB' 'KernelStack: 12704 kB' 'PageTables: 7360 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511608 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195140 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.258 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.258 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.259 16:45:42 -- setup/common.sh@33 -- # echo 1024 00:03:31.259 16:45:42 -- setup/common.sh@33 -- # return 0 00:03:31.259 16:45:42 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.259 16:45:42 -- setup/hugepages.sh@112 -- # get_nodes 00:03:31.259 16:45:42 -- setup/hugepages.sh@27 -- # local node 00:03:31.259 16:45:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.259 16:45:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:31.259 16:45:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.259 16:45:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:31.259 16:45:42 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:31.259 16:45:42 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:31.259 16:45:42 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:31.259 16:45:42 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:31.259 16:45:42 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:31.259 16:45:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.259 16:45:42 -- setup/common.sh@18 -- # local node=0 00:03:31.259 16:45:42 -- setup/common.sh@19 -- # local var val 00:03:31.259 16:45:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.259 16:45:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.259 16:45:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:31.259 16:45:42 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:31.259 16:45:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.259 16:45:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 22284528 kB' 'MemUsed: 10590396 kB' 'SwapCached: 0 kB' 'Active: 5011752 kB' 'Inactive: 3516972 kB' 'Active(anon): 4892408 kB' 'Inactive(anon): 0 kB' 'Active(file): 119344 kB' 'Inactive(file): 3516972 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8062268 kB' 'Mapped: 67004 kB' 'AnonPages: 469788 kB' 'Shmem: 4425952 kB' 'KernelStack: 8200 kB' 'PageTables: 4764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104804 kB' 'Slab: 328388 kB' 'SReclaimable: 104804 kB' 'SUnreclaim: 223584 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.259 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.259 16:45:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@33 -- # echo 0 00:03:31.260 16:45:42 -- setup/common.sh@33 -- # return 0 00:03:31.260 16:45:42 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:31.260 16:45:42 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:31.260 16:45:42 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:31.260 16:45:42 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:31.260 16:45:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.260 16:45:42 -- setup/common.sh@18 -- # local node=1 00:03:31.260 16:45:42 -- setup/common.sh@19 -- # local var val 00:03:31.260 16:45:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.260 16:45:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.260 16:45:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:31.260 16:45:42 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:31.260 16:45:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.260 16:45:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.260 16:45:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 24544688 kB' 'MemUsed: 3116060 kB' 'SwapCached: 0 kB' 'Active: 1097196 kB' 'Inactive: 149256 kB' 'Active(anon): 853888 kB' 'Inactive(anon): 0 kB' 'Active(file): 243308 kB' 'Inactive(file): 149256 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1139920 kB' 'Mapped: 74508 kB' 'AnonPages: 106712 kB' 'Shmem: 747356 kB' 'KernelStack: 4520 kB' 'PageTables: 2752 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 51796 kB' 'Slab: 192052 kB' 'SReclaimable: 51796 kB' 'SUnreclaim: 140256 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.260 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.260 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # continue 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.261 16:45:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.261 16:45:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.261 16:45:42 -- setup/common.sh@33 -- # echo 0 00:03:31.261 16:45:42 -- setup/common.sh@33 -- # return 0 00:03:31.261 16:45:42 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:31.261 16:45:42 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:31.261 16:45:42 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:31.261 16:45:42 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:31.261 16:45:42 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:31.261 node0=512 expecting 512 00:03:31.261 16:45:42 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:31.261 16:45:42 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:31.261 16:45:42 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:31.261 16:45:42 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:31.261 node1=512 expecting 512 00:03:31.261 16:45:42 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:31.261 00:03:31.261 real 0m1.569s 00:03:31.261 user 0m0.640s 00:03:31.261 sys 0m0.898s 00:03:31.261 16:45:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:31.261 16:45:42 -- common/autotest_common.sh@10 -- # set +x 00:03:31.261 ************************************ 00:03:31.261 END TEST per_node_1G_alloc 00:03:31.261 ************************************ 00:03:31.261 16:45:42 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:31.261 16:45:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:31.261 16:45:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:31.262 16:45:42 -- common/autotest_common.sh@10 -- # set +x 00:03:31.262 ************************************ 00:03:31.262 START TEST even_2G_alloc 00:03:31.262 ************************************ 00:03:31.262 16:45:42 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:31.262 16:45:42 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:31.262 16:45:42 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:31.262 16:45:42 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:31.262 16:45:42 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:31.262 16:45:42 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:31.262 16:45:42 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:31.262 16:45:42 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:31.262 16:45:42 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:31.262 16:45:42 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:31.262 16:45:42 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:31.262 16:45:42 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:31.262 16:45:42 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:31.262 16:45:42 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:31.262 16:45:42 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:31.262 16:45:42 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:31.262 16:45:42 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:31.262 16:45:42 -- setup/hugepages.sh@83 -- # : 512 00:03:31.262 16:45:42 -- setup/hugepages.sh@84 -- # : 1 00:03:31.262 16:45:42 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:31.262 16:45:42 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:31.262 16:45:42 -- setup/hugepages.sh@83 -- # : 0 00:03:31.262 16:45:42 -- setup/hugepages.sh@84 -- # : 0 00:03:31.262 16:45:42 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:31.262 16:45:42 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:31.262 16:45:42 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:31.262 16:45:42 -- setup/hugepages.sh@153 -- # setup output 00:03:31.262 16:45:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:31.262 16:45:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:32.658 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.658 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:32.658 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.658 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.658 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.658 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.658 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.658 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.658 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.658 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.658 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.658 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.658 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.658 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.658 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.658 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.658 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.658 16:45:44 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:32.658 16:45:44 -- setup/hugepages.sh@89 -- # local node 00:03:32.658 16:45:44 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:32.658 16:45:44 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:32.658 16:45:44 -- setup/hugepages.sh@92 -- # local surp 00:03:32.658 16:45:44 -- setup/hugepages.sh@93 -- # local resv 00:03:32.658 16:45:44 -- setup/hugepages.sh@94 -- # local anon 00:03:32.658 16:45:44 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:32.658 16:45:44 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:32.658 16:45:44 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:32.658 16:45:44 -- setup/common.sh@18 -- # local node= 00:03:32.658 16:45:44 -- setup/common.sh@19 -- # local var val 00:03:32.658 16:45:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.658 16:45:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.658 16:45:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.658 16:45:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.658 16:45:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.658 16:45:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46833232 kB' 'MemAvailable: 50446596 kB' 'Buffers: 11580 kB' 'Cached: 9190664 kB' 'SwapCached: 0 kB' 'Active: 6110364 kB' 'Inactive: 3666228 kB' 'Active(anon): 5747712 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 577608 kB' 'Mapped: 141524 kB' 'Shmem: 5173364 kB' 'KReclaimable: 156616 kB' 'Slab: 520704 kB' 'SReclaimable: 156616 kB' 'SUnreclaim: 364088 kB' 'KernelStack: 12688 kB' 'PageTables: 7300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511788 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195204 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.658 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.658 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.659 16:45:44 -- setup/common.sh@33 -- # echo 0 00:03:32.659 16:45:44 -- setup/common.sh@33 -- # return 0 00:03:32.659 16:45:44 -- setup/hugepages.sh@97 -- # anon=0 00:03:32.659 16:45:44 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:32.659 16:45:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.659 16:45:44 -- setup/common.sh@18 -- # local node= 00:03:32.659 16:45:44 -- setup/common.sh@19 -- # local var val 00:03:32.659 16:45:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.659 16:45:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.659 16:45:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.659 16:45:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.659 16:45:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.659 16:45:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46836248 kB' 'MemAvailable: 50449612 kB' 'Buffers: 11580 kB' 'Cached: 9190664 kB' 'SwapCached: 0 kB' 'Active: 6111356 kB' 'Inactive: 3666228 kB' 'Active(anon): 5748704 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 578688 kB' 'Mapped: 141600 kB' 'Shmem: 5173364 kB' 'KReclaimable: 156616 kB' 'Slab: 520856 kB' 'SReclaimable: 156616 kB' 'SUnreclaim: 364240 kB' 'KernelStack: 12736 kB' 'PageTables: 7448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511800 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195156 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.659 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.659 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.920 16:45:44 -- setup/common.sh@33 -- # echo 0 00:03:32.920 16:45:44 -- setup/common.sh@33 -- # return 0 00:03:32.920 16:45:44 -- setup/hugepages.sh@99 -- # surp=0 00:03:32.920 16:45:44 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:32.920 16:45:44 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:32.920 16:45:44 -- setup/common.sh@18 -- # local node= 00:03:32.920 16:45:44 -- setup/common.sh@19 -- # local var val 00:03:32.920 16:45:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.920 16:45:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.920 16:45:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.920 16:45:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.920 16:45:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.920 16:45:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46837644 kB' 'MemAvailable: 50451008 kB' 'Buffers: 11580 kB' 'Cached: 9190672 kB' 'SwapCached: 0 kB' 'Active: 6110268 kB' 'Inactive: 3666228 kB' 'Active(anon): 5747616 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 577612 kB' 'Mapped: 141520 kB' 'Shmem: 5173372 kB' 'KReclaimable: 156616 kB' 'Slab: 520784 kB' 'SReclaimable: 156616 kB' 'SUnreclaim: 364168 kB' 'KernelStack: 12736 kB' 'PageTables: 7380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7511816 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195156 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.920 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.920 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.921 16:45:44 -- setup/common.sh@33 -- # echo 0 00:03:32.921 16:45:44 -- setup/common.sh@33 -- # return 0 00:03:32.921 16:45:44 -- setup/hugepages.sh@100 -- # resv=0 00:03:32.921 16:45:44 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:32.921 nr_hugepages=1024 00:03:32.921 16:45:44 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:32.921 resv_hugepages=0 00:03:32.921 16:45:44 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:32.921 surplus_hugepages=0 00:03:32.921 16:45:44 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:32.921 anon_hugepages=0 00:03:32.921 16:45:44 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:32.921 16:45:44 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:32.921 16:45:44 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:32.921 16:45:44 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:32.921 16:45:44 -- setup/common.sh@18 -- # local node= 00:03:32.921 16:45:44 -- setup/common.sh@19 -- # local var val 00:03:32.921 16:45:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.921 16:45:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.921 16:45:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.921 16:45:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.921 16:45:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.921 16:45:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46838420 kB' 'MemAvailable: 50451784 kB' 'Buffers: 11580 kB' 'Cached: 9190692 kB' 'SwapCached: 0 kB' 'Active: 6111028 kB' 'Inactive: 3666228 kB' 'Active(anon): 5748376 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 578416 kB' 'Mapped: 141520 kB' 'Shmem: 5173392 kB' 'KReclaimable: 156616 kB' 'Slab: 520784 kB' 'SReclaimable: 156616 kB' 'SUnreclaim: 364168 kB' 'KernelStack: 12752 kB' 'PageTables: 7436 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7514736 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195156 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.921 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.921 16:45:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.922 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.922 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.922 16:45:44 -- setup/common.sh@33 -- # echo 1024 00:03:32.922 16:45:44 -- setup/common.sh@33 -- # return 0 00:03:32.922 16:45:44 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:32.922 16:45:44 -- setup/hugepages.sh@112 -- # get_nodes 00:03:32.922 16:45:44 -- setup/hugepages.sh@27 -- # local node 00:03:32.922 16:45:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.922 16:45:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:32.922 16:45:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.922 16:45:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:32.922 16:45:44 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:32.922 16:45:44 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:32.922 16:45:44 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:32.922 16:45:44 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:32.922 16:45:44 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:32.922 16:45:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.922 16:45:44 -- setup/common.sh@18 -- # local node=0 00:03:32.922 16:45:44 -- setup/common.sh@19 -- # local var val 00:03:32.922 16:45:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.922 16:45:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.922 16:45:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:32.923 16:45:44 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:32.923 16:45:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.923 16:45:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 22286120 kB' 'MemUsed: 10588804 kB' 'SwapCached: 0 kB' 'Active: 5012824 kB' 'Inactive: 3516972 kB' 'Active(anon): 4893480 kB' 'Inactive(anon): 0 kB' 'Active(file): 119344 kB' 'Inactive(file): 3516972 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8062360 kB' 'Mapped: 67012 kB' 'AnonPages: 470708 kB' 'Shmem: 4426044 kB' 'KernelStack: 8136 kB' 'PageTables: 4452 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104820 kB' 'Slab: 328632 kB' 'SReclaimable: 104820 kB' 'SUnreclaim: 223812 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.923 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.923 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.923 16:45:44 -- setup/common.sh@33 -- # echo 0 00:03:32.923 16:45:44 -- setup/common.sh@33 -- # return 0 00:03:32.924 16:45:44 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:32.924 16:45:44 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:32.924 16:45:44 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:32.924 16:45:44 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:32.924 16:45:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.924 16:45:44 -- setup/common.sh@18 -- # local node=1 00:03:32.924 16:45:44 -- setup/common.sh@19 -- # local var val 00:03:32.924 16:45:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.924 16:45:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.924 16:45:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:32.924 16:45:44 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:32.924 16:45:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.924 16:45:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 24556780 kB' 'MemUsed: 3103968 kB' 'SwapCached: 0 kB' 'Active: 1098840 kB' 'Inactive: 149256 kB' 'Active(anon): 855532 kB' 'Inactive(anon): 0 kB' 'Active(file): 243308 kB' 'Inactive(file): 149256 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1139928 kB' 'Mapped: 74508 kB' 'AnonPages: 108320 kB' 'Shmem: 747364 kB' 'KernelStack: 4888 kB' 'PageTables: 4080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 51796 kB' 'Slab: 192144 kB' 'SReclaimable: 51796 kB' 'SUnreclaim: 140348 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.924 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.924 16:45:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # continue 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.925 16:45:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.925 16:45:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.925 16:45:44 -- setup/common.sh@33 -- # echo 0 00:03:32.925 16:45:44 -- setup/common.sh@33 -- # return 0 00:03:32.925 16:45:44 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:32.925 16:45:44 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:32.925 16:45:44 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:32.925 16:45:44 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:32.925 16:45:44 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:32.925 node0=512 expecting 512 00:03:32.925 16:45:44 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:32.925 16:45:44 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:32.925 16:45:44 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:32.925 16:45:44 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:32.925 node1=512 expecting 512 00:03:32.925 16:45:44 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:32.925 00:03:32.925 real 0m1.576s 00:03:32.925 user 0m0.637s 00:03:32.925 sys 0m0.908s 00:03:32.925 16:45:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.925 16:45:44 -- common/autotest_common.sh@10 -- # set +x 00:03:32.925 ************************************ 00:03:32.925 END TEST even_2G_alloc 00:03:32.925 ************************************ 00:03:32.925 16:45:44 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:32.925 16:45:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:32.925 16:45:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.925 16:45:44 -- common/autotest_common.sh@10 -- # set +x 00:03:32.925 ************************************ 00:03:32.925 START TEST odd_alloc 00:03:32.925 ************************************ 00:03:32.925 16:45:44 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:32.925 16:45:44 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:32.925 16:45:44 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:32.925 16:45:44 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:32.925 16:45:44 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:32.925 16:45:44 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:32.925 16:45:44 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:32.925 16:45:44 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:32.925 16:45:44 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:32.925 16:45:44 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:32.925 16:45:44 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:32.925 16:45:44 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:32.925 16:45:44 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:32.925 16:45:44 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:32.925 16:45:44 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:32.925 16:45:44 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:32.925 16:45:44 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:32.925 16:45:44 -- setup/hugepages.sh@83 -- # : 513 00:03:32.925 16:45:44 -- setup/hugepages.sh@84 -- # : 1 00:03:32.925 16:45:44 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:32.925 16:45:44 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:32.925 16:45:44 -- setup/hugepages.sh@83 -- # : 0 00:03:32.925 16:45:44 -- setup/hugepages.sh@84 -- # : 0 00:03:32.925 16:45:44 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:32.925 16:45:44 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:32.925 16:45:44 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:32.925 16:45:44 -- setup/hugepages.sh@160 -- # setup output 00:03:32.925 16:45:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:32.925 16:45:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:34.312 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:34.312 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:34.312 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:34.312 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:34.312 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:34.312 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:34.312 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:34.312 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:34.312 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:34.312 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:34.312 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:34.312 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:34.312 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:34.312 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:34.312 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:34.312 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:34.313 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:34.313 16:45:45 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:34.313 16:45:45 -- setup/hugepages.sh@89 -- # local node 00:03:34.313 16:45:45 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:34.313 16:45:45 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:34.313 16:45:45 -- setup/hugepages.sh@92 -- # local surp 00:03:34.313 16:45:45 -- setup/hugepages.sh@93 -- # local resv 00:03:34.313 16:45:45 -- setup/hugepages.sh@94 -- # local anon 00:03:34.313 16:45:45 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:34.313 16:45:45 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:34.313 16:45:45 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:34.313 16:45:45 -- setup/common.sh@18 -- # local node= 00:03:34.313 16:45:45 -- setup/common.sh@19 -- # local var val 00:03:34.313 16:45:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.313 16:45:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.313 16:45:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:34.313 16:45:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:34.313 16:45:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.313 16:45:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46850228 kB' 'MemAvailable: 50463544 kB' 'Buffers: 11580 kB' 'Cached: 9190760 kB' 'SwapCached: 0 kB' 'Active: 6110428 kB' 'Inactive: 3666228 kB' 'Active(anon): 5747776 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 577560 kB' 'Mapped: 140912 kB' 'Shmem: 5173460 kB' 'KReclaimable: 156520 kB' 'Slab: 520264 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363744 kB' 'KernelStack: 12672 kB' 'PageTables: 7044 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 7499592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195124 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.313 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.313 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.314 16:45:45 -- setup/common.sh@33 -- # echo 0 00:03:34.314 16:45:45 -- setup/common.sh@33 -- # return 0 00:03:34.314 16:45:45 -- setup/hugepages.sh@97 -- # anon=0 00:03:34.314 16:45:45 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:34.314 16:45:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:34.314 16:45:45 -- setup/common.sh@18 -- # local node= 00:03:34.314 16:45:45 -- setup/common.sh@19 -- # local var val 00:03:34.314 16:45:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.314 16:45:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.314 16:45:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:34.314 16:45:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:34.314 16:45:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.314 16:45:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46850756 kB' 'MemAvailable: 50464072 kB' 'Buffers: 11580 kB' 'Cached: 9190760 kB' 'SwapCached: 0 kB' 'Active: 6111756 kB' 'Inactive: 3666228 kB' 'Active(anon): 5749104 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 578992 kB' 'Mapped: 140548 kB' 'Shmem: 5173460 kB' 'KReclaimable: 156520 kB' 'Slab: 520336 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363816 kB' 'KernelStack: 12688 kB' 'PageTables: 7124 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 7497536 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195060 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.314 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.314 16:45:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.315 16:45:45 -- setup/common.sh@33 -- # echo 0 00:03:34.315 16:45:45 -- setup/common.sh@33 -- # return 0 00:03:34.315 16:45:45 -- setup/hugepages.sh@99 -- # surp=0 00:03:34.315 16:45:45 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:34.315 16:45:45 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:34.315 16:45:45 -- setup/common.sh@18 -- # local node= 00:03:34.315 16:45:45 -- setup/common.sh@19 -- # local var val 00:03:34.315 16:45:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.315 16:45:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.315 16:45:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:34.315 16:45:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:34.315 16:45:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.315 16:45:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46850976 kB' 'MemAvailable: 50464292 kB' 'Buffers: 11580 kB' 'Cached: 9190776 kB' 'SwapCached: 0 kB' 'Active: 6110644 kB' 'Inactive: 3666228 kB' 'Active(anon): 5747992 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 577752 kB' 'Mapped: 140452 kB' 'Shmem: 5173476 kB' 'KReclaimable: 156520 kB' 'Slab: 520316 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363796 kB' 'KernelStack: 12624 kB' 'PageTables: 6908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 7497552 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195092 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.315 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.315 16:45:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.316 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.316 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.317 16:45:45 -- setup/common.sh@33 -- # echo 0 00:03:34.317 16:45:45 -- setup/common.sh@33 -- # return 0 00:03:34.317 16:45:45 -- setup/hugepages.sh@100 -- # resv=0 00:03:34.317 16:45:45 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:34.317 nr_hugepages=1025 00:03:34.317 16:45:45 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:34.317 resv_hugepages=0 00:03:34.317 16:45:45 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:34.317 surplus_hugepages=0 00:03:34.317 16:45:45 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:34.317 anon_hugepages=0 00:03:34.317 16:45:45 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:34.317 16:45:45 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:34.317 16:45:45 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:34.317 16:45:45 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:34.317 16:45:45 -- setup/common.sh@18 -- # local node= 00:03:34.317 16:45:45 -- setup/common.sh@19 -- # local var val 00:03:34.317 16:45:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.317 16:45:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.317 16:45:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:34.317 16:45:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:34.317 16:45:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.317 16:45:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46851636 kB' 'MemAvailable: 50464952 kB' 'Buffers: 11580 kB' 'Cached: 9190788 kB' 'SwapCached: 0 kB' 'Active: 6110592 kB' 'Inactive: 3666228 kB' 'Active(anon): 5747940 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 577724 kB' 'Mapped: 140452 kB' 'Shmem: 5173488 kB' 'KReclaimable: 156520 kB' 'Slab: 520316 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363796 kB' 'KernelStack: 12672 kB' 'PageTables: 7060 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 7497564 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195092 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.317 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.317 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.318 16:45:45 -- setup/common.sh@33 -- # echo 1025 00:03:34.318 16:45:45 -- setup/common.sh@33 -- # return 0 00:03:34.318 16:45:45 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:34.318 16:45:45 -- setup/hugepages.sh@112 -- # get_nodes 00:03:34.318 16:45:45 -- setup/hugepages.sh@27 -- # local node 00:03:34.318 16:45:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:34.318 16:45:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:34.318 16:45:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:34.318 16:45:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:34.318 16:45:45 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:34.318 16:45:45 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:34.318 16:45:45 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:34.318 16:45:45 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:34.318 16:45:45 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:34.318 16:45:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:34.318 16:45:45 -- setup/common.sh@18 -- # local node=0 00:03:34.318 16:45:45 -- setup/common.sh@19 -- # local var val 00:03:34.318 16:45:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.318 16:45:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.318 16:45:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:34.318 16:45:45 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:34.318 16:45:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.318 16:45:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 22295904 kB' 'MemUsed: 10579020 kB' 'SwapCached: 0 kB' 'Active: 5012196 kB' 'Inactive: 3516972 kB' 'Active(anon): 4892852 kB' 'Inactive(anon): 0 kB' 'Active(file): 119344 kB' 'Inactive(file): 3516972 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8062400 kB' 'Mapped: 65972 kB' 'AnonPages: 469908 kB' 'Shmem: 4426084 kB' 'KernelStack: 8136 kB' 'PageTables: 4268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104796 kB' 'Slab: 328364 kB' 'SReclaimable: 104796 kB' 'SUnreclaim: 223568 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.318 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.318 16:45:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.319 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.319 16:45:45 -- setup/common.sh@33 -- # echo 0 00:03:34.319 16:45:45 -- setup/common.sh@33 -- # return 0 00:03:34.319 16:45:45 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:34.319 16:45:45 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:34.319 16:45:45 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:34.319 16:45:45 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:34.319 16:45:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:34.319 16:45:45 -- setup/common.sh@18 -- # local node=1 00:03:34.319 16:45:45 -- setup/common.sh@19 -- # local var val 00:03:34.319 16:45:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.319 16:45:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.319 16:45:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:34.319 16:45:45 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:34.319 16:45:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.319 16:45:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.319 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 24555732 kB' 'MemUsed: 3105016 kB' 'SwapCached: 0 kB' 'Active: 1098208 kB' 'Inactive: 149256 kB' 'Active(anon): 854900 kB' 'Inactive(anon): 0 kB' 'Active(file): 243308 kB' 'Inactive(file): 149256 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1139996 kB' 'Mapped: 74480 kB' 'AnonPages: 107592 kB' 'Shmem: 747432 kB' 'KernelStack: 4520 kB' 'PageTables: 2736 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 51724 kB' 'Slab: 191952 kB' 'SReclaimable: 51724 kB' 'SUnreclaim: 140228 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # continue 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.320 16:45:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.320 16:45:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.320 16:45:45 -- setup/common.sh@33 -- # echo 0 00:03:34.320 16:45:45 -- setup/common.sh@33 -- # return 0 00:03:34.320 16:45:45 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:34.320 16:45:45 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:34.320 16:45:45 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:34.320 16:45:45 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:34.320 16:45:45 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:34.320 node0=512 expecting 513 00:03:34.320 16:45:45 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:34.320 16:45:45 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:34.320 16:45:45 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:34.320 16:45:45 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:34.320 node1=513 expecting 512 00:03:34.320 16:45:45 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:34.320 00:03:34.320 real 0m1.509s 00:03:34.321 user 0m0.638s 00:03:34.321 sys 0m0.828s 00:03:34.321 16:45:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:34.321 16:45:45 -- common/autotest_common.sh@10 -- # set +x 00:03:34.321 ************************************ 00:03:34.321 END TEST odd_alloc 00:03:34.321 ************************************ 00:03:34.582 16:45:45 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:34.582 16:45:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:34.582 16:45:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:34.582 16:45:45 -- common/autotest_common.sh@10 -- # set +x 00:03:34.582 ************************************ 00:03:34.582 START TEST custom_alloc 00:03:34.582 ************************************ 00:03:34.582 16:45:45 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:34.582 16:45:45 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:34.582 16:45:45 -- setup/hugepages.sh@169 -- # local node 00:03:34.582 16:45:45 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:34.582 16:45:45 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:34.582 16:45:45 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:34.582 16:45:45 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:34.582 16:45:45 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:34.582 16:45:45 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:34.582 16:45:45 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:34.582 16:45:45 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:34.582 16:45:45 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:34.582 16:45:45 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:34.582 16:45:45 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:34.582 16:45:45 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:34.582 16:45:45 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:34.582 16:45:45 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:34.582 16:45:45 -- setup/hugepages.sh@83 -- # : 256 00:03:34.582 16:45:45 -- setup/hugepages.sh@84 -- # : 1 00:03:34.582 16:45:45 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:34.582 16:45:45 -- setup/hugepages.sh@83 -- # : 0 00:03:34.582 16:45:45 -- setup/hugepages.sh@84 -- # : 0 00:03:34.582 16:45:45 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:34.582 16:45:45 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:34.582 16:45:45 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:34.582 16:45:45 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:34.582 16:45:45 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:34.582 16:45:45 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:34.582 16:45:45 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:34.582 16:45:45 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:34.582 16:45:45 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:34.582 16:45:45 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:34.582 16:45:45 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:34.582 16:45:45 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:34.582 16:45:45 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:34.582 16:45:45 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:34.582 16:45:45 -- setup/hugepages.sh@78 -- # return 0 00:03:34.582 16:45:45 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:34.582 16:45:45 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:34.582 16:45:45 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:34.583 16:45:45 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:34.583 16:45:45 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:34.583 16:45:45 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:34.583 16:45:45 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:34.583 16:45:45 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:34.583 16:45:45 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:34.583 16:45:45 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:34.583 16:45:45 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:34.583 16:45:45 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:34.583 16:45:45 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:34.583 16:45:45 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:34.583 16:45:45 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:34.583 16:45:45 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:34.583 16:45:45 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:34.583 16:45:45 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:34.583 16:45:45 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:34.583 16:45:45 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:34.583 16:45:45 -- setup/hugepages.sh@78 -- # return 0 00:03:34.583 16:45:45 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:34.583 16:45:45 -- setup/hugepages.sh@187 -- # setup output 00:03:34.583 16:45:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:34.583 16:45:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:35.968 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:35.968 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:35.968 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:35.968 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:35.968 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:35.968 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:35.968 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:35.968 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:35.968 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:35.968 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:35.968 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:35.968 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:35.968 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:35.968 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:35.968 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:35.968 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:35.968 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:35.968 16:45:47 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:35.968 16:45:47 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:35.968 16:45:47 -- setup/hugepages.sh@89 -- # local node 00:03:35.968 16:45:47 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:35.968 16:45:47 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:35.968 16:45:47 -- setup/hugepages.sh@92 -- # local surp 00:03:35.968 16:45:47 -- setup/hugepages.sh@93 -- # local resv 00:03:35.968 16:45:47 -- setup/hugepages.sh@94 -- # local anon 00:03:35.968 16:45:47 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:35.968 16:45:47 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:35.968 16:45:47 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:35.968 16:45:47 -- setup/common.sh@18 -- # local node= 00:03:35.968 16:45:47 -- setup/common.sh@19 -- # local var val 00:03:35.968 16:45:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.968 16:45:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.968 16:45:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.968 16:45:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.968 16:45:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.968 16:45:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 45796392 kB' 'MemAvailable: 49409708 kB' 'Buffers: 11580 kB' 'Cached: 9190860 kB' 'SwapCached: 0 kB' 'Active: 6113468 kB' 'Inactive: 3666228 kB' 'Active(anon): 5750816 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 580484 kB' 'Mapped: 140456 kB' 'Shmem: 5173560 kB' 'KReclaimable: 156520 kB' 'Slab: 520420 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363900 kB' 'KernelStack: 12672 kB' 'PageTables: 7008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 7497756 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195220 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.968 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.968 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.969 16:45:47 -- setup/common.sh@33 -- # echo 0 00:03:35.969 16:45:47 -- setup/common.sh@33 -- # return 0 00:03:35.969 16:45:47 -- setup/hugepages.sh@97 -- # anon=0 00:03:35.969 16:45:47 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:35.969 16:45:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:35.969 16:45:47 -- setup/common.sh@18 -- # local node= 00:03:35.969 16:45:47 -- setup/common.sh@19 -- # local var val 00:03:35.969 16:45:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.969 16:45:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.969 16:45:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.969 16:45:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.969 16:45:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.969 16:45:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 45801792 kB' 'MemAvailable: 49415108 kB' 'Buffers: 11580 kB' 'Cached: 9190864 kB' 'SwapCached: 0 kB' 'Active: 6113400 kB' 'Inactive: 3666228 kB' 'Active(anon): 5750748 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 580472 kB' 'Mapped: 140456 kB' 'Shmem: 5173564 kB' 'KReclaimable: 156520 kB' 'Slab: 520420 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363900 kB' 'KernelStack: 12656 kB' 'PageTables: 6944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 7497768 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.969 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.969 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.970 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.970 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.971 16:45:47 -- setup/common.sh@33 -- # echo 0 00:03:35.971 16:45:47 -- setup/common.sh@33 -- # return 0 00:03:35.971 16:45:47 -- setup/hugepages.sh@99 -- # surp=0 00:03:35.971 16:45:47 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:35.971 16:45:47 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:35.971 16:45:47 -- setup/common.sh@18 -- # local node= 00:03:35.971 16:45:47 -- setup/common.sh@19 -- # local var val 00:03:35.971 16:45:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.971 16:45:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.971 16:45:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.971 16:45:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.971 16:45:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.971 16:45:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 45802204 kB' 'MemAvailable: 49415520 kB' 'Buffers: 11580 kB' 'Cached: 9190868 kB' 'SwapCached: 0 kB' 'Active: 6112620 kB' 'Inactive: 3666228 kB' 'Active(anon): 5749968 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 579632 kB' 'Mapped: 140460 kB' 'Shmem: 5173568 kB' 'KReclaimable: 156520 kB' 'Slab: 520500 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363980 kB' 'KernelStack: 12688 kB' 'PageTables: 7048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 7497784 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.971 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.971 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.972 16:45:47 -- setup/common.sh@33 -- # echo 0 00:03:35.972 16:45:47 -- setup/common.sh@33 -- # return 0 00:03:35.972 16:45:47 -- setup/hugepages.sh@100 -- # resv=0 00:03:35.972 16:45:47 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:35.972 nr_hugepages=1536 00:03:35.972 16:45:47 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:35.972 resv_hugepages=0 00:03:35.972 16:45:47 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:35.972 surplus_hugepages=0 00:03:35.972 16:45:47 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:35.972 anon_hugepages=0 00:03:35.972 16:45:47 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:35.972 16:45:47 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:35.972 16:45:47 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:35.972 16:45:47 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:35.972 16:45:47 -- setup/common.sh@18 -- # local node= 00:03:35.972 16:45:47 -- setup/common.sh@19 -- # local var val 00:03:35.972 16:45:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.972 16:45:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.972 16:45:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.972 16:45:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.972 16:45:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.972 16:45:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 45804836 kB' 'MemAvailable: 49418152 kB' 'Buffers: 11580 kB' 'Cached: 9190888 kB' 'SwapCached: 0 kB' 'Active: 6112696 kB' 'Inactive: 3666228 kB' 'Active(anon): 5750044 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 579668 kB' 'Mapped: 140460 kB' 'Shmem: 5173588 kB' 'KReclaimable: 156520 kB' 'Slab: 520500 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363980 kB' 'KernelStack: 12672 kB' 'PageTables: 6992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 7497796 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.972 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.972 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.973 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.973 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.974 16:45:47 -- setup/common.sh@33 -- # echo 1536 00:03:35.974 16:45:47 -- setup/common.sh@33 -- # return 0 00:03:35.974 16:45:47 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:35.974 16:45:47 -- setup/hugepages.sh@112 -- # get_nodes 00:03:35.974 16:45:47 -- setup/hugepages.sh@27 -- # local node 00:03:35.974 16:45:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:35.974 16:45:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:35.974 16:45:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:35.974 16:45:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:35.974 16:45:47 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:35.974 16:45:47 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:35.974 16:45:47 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:35.974 16:45:47 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:35.974 16:45:47 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:35.974 16:45:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:35.974 16:45:47 -- setup/common.sh@18 -- # local node=0 00:03:35.974 16:45:47 -- setup/common.sh@19 -- # local var val 00:03:35.974 16:45:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.974 16:45:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.974 16:45:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:35.974 16:45:47 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:35.974 16:45:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.974 16:45:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 22297356 kB' 'MemUsed: 10577568 kB' 'SwapCached: 0 kB' 'Active: 5014076 kB' 'Inactive: 3516972 kB' 'Active(anon): 4894732 kB' 'Inactive(anon): 0 kB' 'Active(file): 119344 kB' 'Inactive(file): 3516972 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8062400 kB' 'Mapped: 65980 kB' 'AnonPages: 471776 kB' 'Shmem: 4426084 kB' 'KernelStack: 8152 kB' 'PageTables: 4212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104796 kB' 'Slab: 328372 kB' 'SReclaimable: 104796 kB' 'SUnreclaim: 223576 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.974 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.974 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.975 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.975 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.975 16:45:47 -- setup/common.sh@33 -- # echo 0 00:03:35.975 16:45:47 -- setup/common.sh@33 -- # return 0 00:03:35.975 16:45:47 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:35.975 16:45:47 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:35.975 16:45:47 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:35.975 16:45:47 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:35.975 16:45:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:35.975 16:45:47 -- setup/common.sh@18 -- # local node=1 00:03:35.975 16:45:47 -- setup/common.sh@19 -- # local var val 00:03:35.975 16:45:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.975 16:45:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.976 16:45:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:35.976 16:45:47 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:35.976 16:45:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.976 16:45:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23508676 kB' 'MemUsed: 4152072 kB' 'SwapCached: 0 kB' 'Active: 1098788 kB' 'Inactive: 149256 kB' 'Active(anon): 855480 kB' 'Inactive(anon): 0 kB' 'Active(file): 243308 kB' 'Inactive(file): 149256 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1140096 kB' 'Mapped: 74480 kB' 'AnonPages: 108084 kB' 'Shmem: 747532 kB' 'KernelStack: 4520 kB' 'PageTables: 2784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 51724 kB' 'Slab: 192104 kB' 'SReclaimable: 51724 kB' 'SUnreclaim: 140380 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.976 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.976 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.977 16:45:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.977 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.977 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.977 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.977 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.977 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.977 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.977 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.977 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.977 16:45:47 -- setup/common.sh@32 -- # continue 00:03:35.977 16:45:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.977 16:45:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.977 16:45:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.977 16:45:47 -- setup/common.sh@33 -- # echo 0 00:03:35.977 16:45:47 -- setup/common.sh@33 -- # return 0 00:03:35.977 16:45:47 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:35.977 16:45:47 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:35.977 16:45:47 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:35.977 16:45:47 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:35.977 16:45:47 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:35.977 node0=512 expecting 512 00:03:35.977 16:45:47 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:35.977 16:45:47 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:35.977 16:45:47 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:35.977 16:45:47 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:35.977 node1=1024 expecting 1024 00:03:35.977 16:45:47 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:35.977 00:03:35.977 real 0m1.555s 00:03:35.977 user 0m0.635s 00:03:35.977 sys 0m0.877s 00:03:35.977 16:45:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:35.977 16:45:47 -- common/autotest_common.sh@10 -- # set +x 00:03:35.977 ************************************ 00:03:35.977 END TEST custom_alloc 00:03:35.977 ************************************ 00:03:35.977 16:45:47 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:35.977 16:45:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.977 16:45:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.977 16:45:47 -- common/autotest_common.sh@10 -- # set +x 00:03:35.977 ************************************ 00:03:35.977 START TEST no_shrink_alloc 00:03:35.977 ************************************ 00:03:35.977 16:45:47 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:35.977 16:45:47 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:35.977 16:45:47 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:35.977 16:45:47 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:35.977 16:45:47 -- setup/hugepages.sh@51 -- # shift 00:03:35.977 16:45:47 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:35.977 16:45:47 -- setup/hugepages.sh@52 -- # local node_ids 00:03:35.977 16:45:47 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:35.977 16:45:47 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:35.977 16:45:47 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:35.977 16:45:47 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:35.977 16:45:47 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:35.977 16:45:47 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:35.977 16:45:47 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:35.977 16:45:47 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:35.977 16:45:47 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:35.977 16:45:47 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:35.977 16:45:47 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:35.977 16:45:47 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:35.977 16:45:47 -- setup/hugepages.sh@73 -- # return 0 00:03:35.977 16:45:47 -- setup/hugepages.sh@198 -- # setup output 00:03:35.977 16:45:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:35.977 16:45:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:37.359 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:37.360 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:37.360 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:37.360 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:37.360 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:37.360 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:37.360 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:37.360 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:37.360 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:37.360 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:37.360 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:37.360 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:37.360 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:37.360 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:37.360 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:37.360 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:37.360 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:37.360 16:45:48 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:37.360 16:45:48 -- setup/hugepages.sh@89 -- # local node 00:03:37.360 16:45:48 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:37.360 16:45:48 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:37.360 16:45:48 -- setup/hugepages.sh@92 -- # local surp 00:03:37.360 16:45:48 -- setup/hugepages.sh@93 -- # local resv 00:03:37.360 16:45:48 -- setup/hugepages.sh@94 -- # local anon 00:03:37.360 16:45:48 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:37.360 16:45:48 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:37.360 16:45:48 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:37.360 16:45:48 -- setup/common.sh@18 -- # local node= 00:03:37.360 16:45:48 -- setup/common.sh@19 -- # local var val 00:03:37.360 16:45:48 -- setup/common.sh@20 -- # local mem_f mem 00:03:37.360 16:45:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:37.360 16:45:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:37.360 16:45:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:37.360 16:45:48 -- setup/common.sh@28 -- # mapfile -t mem 00:03:37.360 16:45:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46777568 kB' 'MemAvailable: 50390884 kB' 'Buffers: 11580 kB' 'Cached: 9190948 kB' 'SwapCached: 0 kB' 'Active: 6116048 kB' 'Inactive: 3666228 kB' 'Active(anon): 5753396 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 583164 kB' 'Mapped: 140476 kB' 'Shmem: 5173648 kB' 'KReclaimable: 156520 kB' 'Slab: 520424 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363904 kB' 'KernelStack: 12800 kB' 'PageTables: 7088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7500500 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195284 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.360 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.360 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:37.361 16:45:48 -- setup/common.sh@33 -- # echo 0 00:03:37.361 16:45:48 -- setup/common.sh@33 -- # return 0 00:03:37.361 16:45:48 -- setup/hugepages.sh@97 -- # anon=0 00:03:37.361 16:45:48 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:37.361 16:45:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:37.361 16:45:48 -- setup/common.sh@18 -- # local node= 00:03:37.361 16:45:48 -- setup/common.sh@19 -- # local var val 00:03:37.361 16:45:48 -- setup/common.sh@20 -- # local mem_f mem 00:03:37.361 16:45:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:37.361 16:45:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:37.361 16:45:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:37.361 16:45:48 -- setup/common.sh@28 -- # mapfile -t mem 00:03:37.361 16:45:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46783568 kB' 'MemAvailable: 50396884 kB' 'Buffers: 11580 kB' 'Cached: 9190948 kB' 'SwapCached: 0 kB' 'Active: 6117360 kB' 'Inactive: 3666228 kB' 'Active(anon): 5754708 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 584428 kB' 'Mapped: 140552 kB' 'Shmem: 5173648 kB' 'KReclaimable: 156520 kB' 'Slab: 520424 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363904 kB' 'KernelStack: 13152 kB' 'PageTables: 8444 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7501900 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195444 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.361 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.361 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.362 16:45:48 -- setup/common.sh@33 -- # echo 0 00:03:37.362 16:45:48 -- setup/common.sh@33 -- # return 0 00:03:37.362 16:45:48 -- setup/hugepages.sh@99 -- # surp=0 00:03:37.362 16:45:48 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:37.362 16:45:48 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:37.362 16:45:48 -- setup/common.sh@18 -- # local node= 00:03:37.362 16:45:48 -- setup/common.sh@19 -- # local var val 00:03:37.362 16:45:48 -- setup/common.sh@20 -- # local mem_f mem 00:03:37.362 16:45:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:37.362 16:45:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:37.362 16:45:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:37.362 16:45:48 -- setup/common.sh@28 -- # mapfile -t mem 00:03:37.362 16:45:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.362 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.362 16:45:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46781544 kB' 'MemAvailable: 50394860 kB' 'Buffers: 11580 kB' 'Cached: 9190964 kB' 'SwapCached: 0 kB' 'Active: 6116800 kB' 'Inactive: 3666228 kB' 'Active(anon): 5754148 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 583796 kB' 'Mapped: 140464 kB' 'Shmem: 5173664 kB' 'KReclaimable: 156520 kB' 'Slab: 520372 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363852 kB' 'KernelStack: 13008 kB' 'PageTables: 8872 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7500900 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195348 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:37.362 16:45:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.363 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.363 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.623 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.623 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:37.624 16:45:48 -- setup/common.sh@33 -- # echo 0 00:03:37.624 16:45:48 -- setup/common.sh@33 -- # return 0 00:03:37.624 16:45:48 -- setup/hugepages.sh@100 -- # resv=0 00:03:37.624 16:45:48 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:37.624 nr_hugepages=1024 00:03:37.624 16:45:48 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:37.624 resv_hugepages=0 00:03:37.624 16:45:48 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:37.624 surplus_hugepages=0 00:03:37.624 16:45:48 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:37.624 anon_hugepages=0 00:03:37.624 16:45:48 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:37.624 16:45:48 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:37.624 16:45:48 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:37.624 16:45:48 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:37.624 16:45:48 -- setup/common.sh@18 -- # local node= 00:03:37.624 16:45:48 -- setup/common.sh@19 -- # local var val 00:03:37.624 16:45:48 -- setup/common.sh@20 -- # local mem_f mem 00:03:37.624 16:45:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:37.624 16:45:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:37.624 16:45:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:37.624 16:45:48 -- setup/common.sh@28 -- # mapfile -t mem 00:03:37.624 16:45:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46795548 kB' 'MemAvailable: 50408864 kB' 'Buffers: 11580 kB' 'Cached: 9190964 kB' 'SwapCached: 0 kB' 'Active: 6116732 kB' 'Inactive: 3666228 kB' 'Active(anon): 5754080 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 583712 kB' 'Mapped: 140464 kB' 'Shmem: 5173664 kB' 'KReclaimable: 156520 kB' 'Slab: 520372 kB' 'SReclaimable: 156520 kB' 'SUnreclaim: 363852 kB' 'KernelStack: 13008 kB' 'PageTables: 7716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7501564 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195668 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.624 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.624 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.625 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.625 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:37.626 16:45:48 -- setup/common.sh@33 -- # echo 1024 00:03:37.626 16:45:48 -- setup/common.sh@33 -- # return 0 00:03:37.626 16:45:48 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:37.626 16:45:48 -- setup/hugepages.sh@112 -- # get_nodes 00:03:37.626 16:45:48 -- setup/hugepages.sh@27 -- # local node 00:03:37.626 16:45:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:37.626 16:45:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:37.626 16:45:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:37.626 16:45:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:37.626 16:45:48 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:37.626 16:45:48 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:37.626 16:45:48 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:37.626 16:45:48 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:37.626 16:45:48 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:37.626 16:45:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:37.626 16:45:48 -- setup/common.sh@18 -- # local node=0 00:03:37.626 16:45:48 -- setup/common.sh@19 -- # local var val 00:03:37.626 16:45:48 -- setup/common.sh@20 -- # local mem_f mem 00:03:37.626 16:45:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:37.626 16:45:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:37.626 16:45:48 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:37.626 16:45:48 -- setup/common.sh@28 -- # mapfile -t mem 00:03:37.626 16:45:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21267640 kB' 'MemUsed: 11607284 kB' 'SwapCached: 0 kB' 'Active: 5017176 kB' 'Inactive: 3516972 kB' 'Active(anon): 4897832 kB' 'Inactive(anon): 0 kB' 'Active(file): 119344 kB' 'Inactive(file): 3516972 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8062464 kB' 'Mapped: 65984 kB' 'AnonPages: 474792 kB' 'Shmem: 4426148 kB' 'KernelStack: 8232 kB' 'PageTables: 4468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104796 kB' 'Slab: 328172 kB' 'SReclaimable: 104796 kB' 'SUnreclaim: 223376 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.626 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.626 16:45:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # continue 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:37.627 16:45:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:37.627 16:45:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:37.627 16:45:48 -- setup/common.sh@33 -- # echo 0 00:03:37.627 16:45:48 -- setup/common.sh@33 -- # return 0 00:03:37.627 16:45:48 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:37.627 16:45:48 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:37.627 16:45:48 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:37.627 16:45:48 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:37.627 16:45:48 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:37.627 node0=1024 expecting 1024 00:03:37.627 16:45:48 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:37.627 16:45:48 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:37.627 16:45:48 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:37.627 16:45:48 -- setup/hugepages.sh@202 -- # setup output 00:03:37.627 16:45:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:37.627 16:45:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:39.013 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:39.013 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:39.013 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:39.013 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:39.013 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:39.013 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:39.013 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:39.013 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:39.013 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:39.013 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:39.013 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:39.013 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:39.013 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:39.013 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:39.013 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:39.013 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:39.013 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:39.013 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:39.013 16:45:50 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:39.013 16:45:50 -- setup/hugepages.sh@89 -- # local node 00:03:39.013 16:45:50 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:39.013 16:45:50 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:39.013 16:45:50 -- setup/hugepages.sh@92 -- # local surp 00:03:39.013 16:45:50 -- setup/hugepages.sh@93 -- # local resv 00:03:39.013 16:45:50 -- setup/hugepages.sh@94 -- # local anon 00:03:39.013 16:45:50 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:39.013 16:45:50 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:39.013 16:45:50 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:39.013 16:45:50 -- setup/common.sh@18 -- # local node= 00:03:39.013 16:45:50 -- setup/common.sh@19 -- # local var val 00:03:39.013 16:45:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:39.013 16:45:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:39.013 16:45:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:39.013 16:45:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:39.013 16:45:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:39.013 16:45:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46794820 kB' 'MemAvailable: 50408280 kB' 'Buffers: 11580 kB' 'Cached: 9191032 kB' 'SwapCached: 0 kB' 'Active: 6118496 kB' 'Inactive: 3666228 kB' 'Active(anon): 5755844 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 585512 kB' 'Mapped: 140484 kB' 'Shmem: 5173732 kB' 'KReclaimable: 156808 kB' 'Slab: 520836 kB' 'SReclaimable: 156808 kB' 'SUnreclaim: 364028 kB' 'KernelStack: 12688 kB' 'PageTables: 7028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7498060 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195236 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.013 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.013 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:39.014 16:45:50 -- setup/common.sh@33 -- # echo 0 00:03:39.014 16:45:50 -- setup/common.sh@33 -- # return 0 00:03:39.014 16:45:50 -- setup/hugepages.sh@97 -- # anon=0 00:03:39.014 16:45:50 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:39.014 16:45:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:39.014 16:45:50 -- setup/common.sh@18 -- # local node= 00:03:39.014 16:45:50 -- setup/common.sh@19 -- # local var val 00:03:39.014 16:45:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:39.014 16:45:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:39.014 16:45:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:39.014 16:45:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:39.014 16:45:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:39.014 16:45:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46795876 kB' 'MemAvailable: 50409336 kB' 'Buffers: 11580 kB' 'Cached: 9191032 kB' 'SwapCached: 0 kB' 'Active: 6118636 kB' 'Inactive: 3666228 kB' 'Active(anon): 5755984 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 585580 kB' 'Mapped: 140544 kB' 'Shmem: 5173732 kB' 'KReclaimable: 156808 kB' 'Slab: 520852 kB' 'SReclaimable: 156808 kB' 'SUnreclaim: 364044 kB' 'KernelStack: 12704 kB' 'PageTables: 7076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7498072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195204 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.014 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.014 16:45:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.015 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.015 16:45:50 -- setup/common.sh@33 -- # echo 0 00:03:39.015 16:45:50 -- setup/common.sh@33 -- # return 0 00:03:39.015 16:45:50 -- setup/hugepages.sh@99 -- # surp=0 00:03:39.015 16:45:50 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:39.015 16:45:50 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:39.015 16:45:50 -- setup/common.sh@18 -- # local node= 00:03:39.015 16:45:50 -- setup/common.sh@19 -- # local var val 00:03:39.015 16:45:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:39.015 16:45:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:39.015 16:45:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:39.015 16:45:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:39.015 16:45:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:39.015 16:45:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.015 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46796352 kB' 'MemAvailable: 50409812 kB' 'Buffers: 11580 kB' 'Cached: 9191048 kB' 'SwapCached: 0 kB' 'Active: 6118324 kB' 'Inactive: 3666228 kB' 'Active(anon): 5755672 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 585228 kB' 'Mapped: 140468 kB' 'Shmem: 5173748 kB' 'KReclaimable: 156808 kB' 'Slab: 520844 kB' 'SReclaimable: 156808 kB' 'SUnreclaim: 364036 kB' 'KernelStack: 12704 kB' 'PageTables: 7020 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7498088 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195220 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.016 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.016 16:45:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:39.017 16:45:50 -- setup/common.sh@33 -- # echo 0 00:03:39.017 16:45:50 -- setup/common.sh@33 -- # return 0 00:03:39.017 16:45:50 -- setup/hugepages.sh@100 -- # resv=0 00:03:39.017 16:45:50 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:39.017 nr_hugepages=1024 00:03:39.017 16:45:50 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:39.017 resv_hugepages=0 00:03:39.017 16:45:50 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:39.017 surplus_hugepages=0 00:03:39.017 16:45:50 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:39.017 anon_hugepages=0 00:03:39.017 16:45:50 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:39.017 16:45:50 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:39.017 16:45:50 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:39.017 16:45:50 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:39.017 16:45:50 -- setup/common.sh@18 -- # local node= 00:03:39.017 16:45:50 -- setup/common.sh@19 -- # local var val 00:03:39.017 16:45:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:39.017 16:45:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:39.017 16:45:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:39.017 16:45:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:39.017 16:45:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:39.017 16:45:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 46796840 kB' 'MemAvailable: 50410300 kB' 'Buffers: 11580 kB' 'Cached: 9191060 kB' 'SwapCached: 0 kB' 'Active: 6118020 kB' 'Inactive: 3666228 kB' 'Active(anon): 5755368 kB' 'Inactive(anon): 0 kB' 'Active(file): 362652 kB' 'Inactive(file): 3666228 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 584932 kB' 'Mapped: 140468 kB' 'Shmem: 5173760 kB' 'KReclaimable: 156808 kB' 'Slab: 520844 kB' 'SReclaimable: 156808 kB' 'SUnreclaim: 364036 kB' 'KernelStack: 12720 kB' 'PageTables: 7068 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 7498104 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195220 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 405084 kB' 'DirectMap2M: 7903232 kB' 'DirectMap1G: 61865984 kB' 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.017 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.017 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.018 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.018 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:39.018 16:45:50 -- setup/common.sh@33 -- # echo 1024 00:03:39.018 16:45:50 -- setup/common.sh@33 -- # return 0 00:03:39.018 16:45:50 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:39.018 16:45:50 -- setup/hugepages.sh@112 -- # get_nodes 00:03:39.018 16:45:50 -- setup/hugepages.sh@27 -- # local node 00:03:39.018 16:45:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:39.018 16:45:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:39.018 16:45:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:39.018 16:45:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:39.018 16:45:50 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:39.018 16:45:50 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:39.018 16:45:50 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:39.018 16:45:50 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:39.018 16:45:50 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:39.018 16:45:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:39.019 16:45:50 -- setup/common.sh@18 -- # local node=0 00:03:39.019 16:45:50 -- setup/common.sh@19 -- # local var val 00:03:39.019 16:45:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:39.019 16:45:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:39.019 16:45:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:39.019 16:45:50 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:39.019 16:45:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:39.019 16:45:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21261048 kB' 'MemUsed: 11613876 kB' 'SwapCached: 0 kB' 'Active: 5018444 kB' 'Inactive: 3516972 kB' 'Active(anon): 4899100 kB' 'Inactive(anon): 0 kB' 'Active(file): 119344 kB' 'Inactive(file): 3516972 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8062532 kB' 'Mapped: 65988 kB' 'AnonPages: 476104 kB' 'Shmem: 4426216 kB' 'KernelStack: 8184 kB' 'PageTables: 4224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 105084 kB' 'Slab: 328600 kB' 'SReclaimable: 105084 kB' 'SUnreclaim: 223516 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.019 16:45:50 -- setup/common.sh@32 -- # continue 00:03:39.019 16:45:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.020 16:45:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.020 16:45:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:39.020 16:45:50 -- setup/common.sh@33 -- # echo 0 00:03:39.020 16:45:50 -- setup/common.sh@33 -- # return 0 00:03:39.020 16:45:50 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:39.020 16:45:50 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:39.020 16:45:50 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:39.020 16:45:50 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:39.020 16:45:50 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:39.020 node0=1024 expecting 1024 00:03:39.020 16:45:50 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:39.020 00:03:39.020 real 0m3.024s 00:03:39.020 user 0m1.177s 00:03:39.020 sys 0m1.781s 00:03:39.020 16:45:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.020 16:45:50 -- common/autotest_common.sh@10 -- # set +x 00:03:39.020 ************************************ 00:03:39.020 END TEST no_shrink_alloc 00:03:39.020 ************************************ 00:03:39.020 16:45:50 -- setup/hugepages.sh@217 -- # clear_hp 00:03:39.020 16:45:50 -- setup/hugepages.sh@37 -- # local node hp 00:03:39.020 16:45:50 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:39.020 16:45:50 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:39.020 16:45:50 -- setup/hugepages.sh@41 -- # echo 0 00:03:39.020 16:45:50 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:39.020 16:45:50 -- setup/hugepages.sh@41 -- # echo 0 00:03:39.020 16:45:50 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:39.020 16:45:50 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:39.020 16:45:50 -- setup/hugepages.sh@41 -- # echo 0 00:03:39.020 16:45:50 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:39.020 16:45:50 -- setup/hugepages.sh@41 -- # echo 0 00:03:39.020 16:45:50 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:39.020 16:45:50 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:39.020 00:03:39.020 real 0m12.251s 00:03:39.020 user 0m4.643s 00:03:39.020 sys 0m6.518s 00:03:39.020 16:45:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.020 16:45:50 -- common/autotest_common.sh@10 -- # set +x 00:03:39.020 ************************************ 00:03:39.020 END TEST hugepages 00:03:39.020 ************************************ 00:03:39.020 16:45:50 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:39.020 16:45:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.020 16:45:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.020 16:45:50 -- common/autotest_common.sh@10 -- # set +x 00:03:39.020 ************************************ 00:03:39.020 START TEST driver 00:03:39.020 ************************************ 00:03:39.020 16:45:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:39.279 * Looking for test storage... 00:03:39.279 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:39.279 16:45:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:39.279 16:45:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:39.279 16:45:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:39.279 16:45:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:39.279 16:45:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:39.279 16:45:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:39.279 16:45:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:39.279 16:45:50 -- scripts/common.sh@335 -- # IFS=.-: 00:03:39.279 16:45:50 -- scripts/common.sh@335 -- # read -ra ver1 00:03:39.279 16:45:50 -- scripts/common.sh@336 -- # IFS=.-: 00:03:39.279 16:45:50 -- scripts/common.sh@336 -- # read -ra ver2 00:03:39.279 16:45:50 -- scripts/common.sh@337 -- # local 'op=<' 00:03:39.279 16:45:50 -- scripts/common.sh@339 -- # ver1_l=2 00:03:39.279 16:45:50 -- scripts/common.sh@340 -- # ver2_l=1 00:03:39.279 16:45:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:39.279 16:45:50 -- scripts/common.sh@343 -- # case "$op" in 00:03:39.279 16:45:50 -- scripts/common.sh@344 -- # : 1 00:03:39.279 16:45:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:39.280 16:45:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:39.280 16:45:50 -- scripts/common.sh@364 -- # decimal 1 00:03:39.280 16:45:50 -- scripts/common.sh@352 -- # local d=1 00:03:39.280 16:45:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:39.280 16:45:50 -- scripts/common.sh@354 -- # echo 1 00:03:39.280 16:45:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:39.280 16:45:50 -- scripts/common.sh@365 -- # decimal 2 00:03:39.280 16:45:50 -- scripts/common.sh@352 -- # local d=2 00:03:39.280 16:45:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:39.280 16:45:50 -- scripts/common.sh@354 -- # echo 2 00:03:39.280 16:45:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:39.280 16:45:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:39.280 16:45:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:39.280 16:45:50 -- scripts/common.sh@367 -- # return 0 00:03:39.280 16:45:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:39.280 16:45:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:39.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.280 --rc genhtml_branch_coverage=1 00:03:39.280 --rc genhtml_function_coverage=1 00:03:39.280 --rc genhtml_legend=1 00:03:39.280 --rc geninfo_all_blocks=1 00:03:39.280 --rc geninfo_unexecuted_blocks=1 00:03:39.280 00:03:39.280 ' 00:03:39.280 16:45:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:39.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.280 --rc genhtml_branch_coverage=1 00:03:39.280 --rc genhtml_function_coverage=1 00:03:39.280 --rc genhtml_legend=1 00:03:39.280 --rc geninfo_all_blocks=1 00:03:39.280 --rc geninfo_unexecuted_blocks=1 00:03:39.280 00:03:39.280 ' 00:03:39.280 16:45:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:39.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.280 --rc genhtml_branch_coverage=1 00:03:39.280 --rc genhtml_function_coverage=1 00:03:39.280 --rc genhtml_legend=1 00:03:39.280 --rc geninfo_all_blocks=1 00:03:39.280 --rc geninfo_unexecuted_blocks=1 00:03:39.280 00:03:39.280 ' 00:03:39.280 16:45:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:39.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.280 --rc genhtml_branch_coverage=1 00:03:39.280 --rc genhtml_function_coverage=1 00:03:39.280 --rc genhtml_legend=1 00:03:39.280 --rc geninfo_all_blocks=1 00:03:39.280 --rc geninfo_unexecuted_blocks=1 00:03:39.280 00:03:39.280 ' 00:03:39.280 16:45:50 -- setup/driver.sh@68 -- # setup reset 00:03:39.280 16:45:50 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:39.280 16:45:50 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:41.818 16:45:53 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:41.818 16:45:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:41.818 16:45:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:41.818 16:45:53 -- common/autotest_common.sh@10 -- # set +x 00:03:41.818 ************************************ 00:03:41.818 START TEST guess_driver 00:03:41.818 ************************************ 00:03:41.818 16:45:53 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:41.818 16:45:53 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:41.818 16:45:53 -- setup/driver.sh@47 -- # local fail=0 00:03:41.818 16:45:53 -- setup/driver.sh@49 -- # pick_driver 00:03:41.818 16:45:53 -- setup/driver.sh@36 -- # vfio 00:03:41.818 16:45:53 -- setup/driver.sh@21 -- # local iommu_grups 00:03:41.818 16:45:53 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:41.818 16:45:53 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:41.818 16:45:53 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:41.818 16:45:53 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:41.818 16:45:53 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:41.818 16:45:53 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:41.818 16:45:53 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:41.818 16:45:53 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:41.818 16:45:53 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:41.818 16:45:53 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:41.818 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:41.818 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:41.818 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:41.818 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:41.818 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:41.818 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:41.818 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:41.818 16:45:53 -- setup/driver.sh@30 -- # return 0 00:03:41.818 16:45:53 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:41.818 16:45:53 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:41.818 16:45:53 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:41.818 16:45:53 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:41.818 Looking for driver=vfio-pci 00:03:41.818 16:45:53 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:41.818 16:45:53 -- setup/driver.sh@45 -- # setup output config 00:03:41.818 16:45:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:41.818 16:45:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.195 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.195 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.195 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.196 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.196 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.196 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.196 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.196 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.196 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.196 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.196 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.196 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.196 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.196 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.196 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.196 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.196 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:43.196 16:45:54 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.196 16:45:54 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.196 16:45:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.136 16:45:55 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.136 16:45:55 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.136 16:45:55 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.394 16:45:55 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:44.394 16:45:55 -- setup/driver.sh@65 -- # setup reset 00:03:44.394 16:45:55 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:44.394 16:45:55 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:46.929 00:03:46.929 real 0m5.144s 00:03:46.929 user 0m1.213s 00:03:46.929 sys 0m2.038s 00:03:46.929 16:45:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.929 16:45:58 -- common/autotest_common.sh@10 -- # set +x 00:03:46.929 ************************************ 00:03:46.929 END TEST guess_driver 00:03:46.929 ************************************ 00:03:46.929 00:03:46.929 real 0m7.893s 00:03:46.929 user 0m1.877s 00:03:46.929 sys 0m3.134s 00:03:46.929 16:45:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.929 16:45:58 -- common/autotest_common.sh@10 -- # set +x 00:03:46.929 ************************************ 00:03:46.929 END TEST driver 00:03:46.929 ************************************ 00:03:46.929 16:45:58 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:46.929 16:45:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:46.929 16:45:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:46.929 16:45:58 -- common/autotest_common.sh@10 -- # set +x 00:03:46.929 ************************************ 00:03:46.929 START TEST devices 00:03:46.929 ************************************ 00:03:46.929 16:45:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:47.188 * Looking for test storage... 00:03:47.188 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:47.188 16:45:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:47.188 16:45:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:47.188 16:45:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:47.188 16:45:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:47.188 16:45:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:47.188 16:45:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:47.188 16:45:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:47.188 16:45:58 -- scripts/common.sh@335 -- # IFS=.-: 00:03:47.188 16:45:58 -- scripts/common.sh@335 -- # read -ra ver1 00:03:47.188 16:45:58 -- scripts/common.sh@336 -- # IFS=.-: 00:03:47.188 16:45:58 -- scripts/common.sh@336 -- # read -ra ver2 00:03:47.188 16:45:58 -- scripts/common.sh@337 -- # local 'op=<' 00:03:47.188 16:45:58 -- scripts/common.sh@339 -- # ver1_l=2 00:03:47.188 16:45:58 -- scripts/common.sh@340 -- # ver2_l=1 00:03:47.188 16:45:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:47.188 16:45:58 -- scripts/common.sh@343 -- # case "$op" in 00:03:47.188 16:45:58 -- scripts/common.sh@344 -- # : 1 00:03:47.188 16:45:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:47.188 16:45:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:47.188 16:45:58 -- scripts/common.sh@364 -- # decimal 1 00:03:47.188 16:45:58 -- scripts/common.sh@352 -- # local d=1 00:03:47.188 16:45:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:47.188 16:45:58 -- scripts/common.sh@354 -- # echo 1 00:03:47.188 16:45:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:47.188 16:45:58 -- scripts/common.sh@365 -- # decimal 2 00:03:47.188 16:45:58 -- scripts/common.sh@352 -- # local d=2 00:03:47.188 16:45:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:47.188 16:45:58 -- scripts/common.sh@354 -- # echo 2 00:03:47.188 16:45:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:47.188 16:45:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:47.188 16:45:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:47.188 16:45:58 -- scripts/common.sh@367 -- # return 0 00:03:47.188 16:45:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:47.188 16:45:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:47.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.188 --rc genhtml_branch_coverage=1 00:03:47.188 --rc genhtml_function_coverage=1 00:03:47.188 --rc genhtml_legend=1 00:03:47.188 --rc geninfo_all_blocks=1 00:03:47.188 --rc geninfo_unexecuted_blocks=1 00:03:47.188 00:03:47.188 ' 00:03:47.188 16:45:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:47.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.188 --rc genhtml_branch_coverage=1 00:03:47.188 --rc genhtml_function_coverage=1 00:03:47.188 --rc genhtml_legend=1 00:03:47.188 --rc geninfo_all_blocks=1 00:03:47.188 --rc geninfo_unexecuted_blocks=1 00:03:47.188 00:03:47.188 ' 00:03:47.188 16:45:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:47.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.188 --rc genhtml_branch_coverage=1 00:03:47.188 --rc genhtml_function_coverage=1 00:03:47.188 --rc genhtml_legend=1 00:03:47.188 --rc geninfo_all_blocks=1 00:03:47.188 --rc geninfo_unexecuted_blocks=1 00:03:47.188 00:03:47.188 ' 00:03:47.188 16:45:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:47.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.188 --rc genhtml_branch_coverage=1 00:03:47.188 --rc genhtml_function_coverage=1 00:03:47.188 --rc genhtml_legend=1 00:03:47.188 --rc geninfo_all_blocks=1 00:03:47.188 --rc geninfo_unexecuted_blocks=1 00:03:47.188 00:03:47.188 ' 00:03:47.188 16:45:58 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:47.189 16:45:58 -- setup/devices.sh@192 -- # setup reset 00:03:47.189 16:45:58 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:47.189 16:45:58 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:48.570 16:45:59 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:48.570 16:45:59 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:48.570 16:45:59 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:48.570 16:45:59 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:48.570 16:45:59 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:48.570 16:45:59 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:48.570 16:45:59 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:48.570 16:45:59 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:48.570 16:45:59 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:48.570 16:45:59 -- setup/devices.sh@196 -- # blocks=() 00:03:48.570 16:45:59 -- setup/devices.sh@196 -- # declare -a blocks 00:03:48.570 16:45:59 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:48.570 16:45:59 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:48.570 16:45:59 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:48.570 16:45:59 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:48.570 16:45:59 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:48.570 16:45:59 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:48.570 16:45:59 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:48.570 16:45:59 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:48.570 16:45:59 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:48.570 16:45:59 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:48.570 16:45:59 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:48.570 No valid GPT data, bailing 00:03:48.570 16:45:59 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:48.830 16:46:00 -- scripts/common.sh@393 -- # pt= 00:03:48.830 16:46:00 -- scripts/common.sh@394 -- # return 1 00:03:48.830 16:46:00 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:48.830 16:46:00 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:48.830 16:46:00 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:48.830 16:46:00 -- setup/common.sh@80 -- # echo 1000204886016 00:03:48.830 16:46:00 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:48.830 16:46:00 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:48.830 16:46:00 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:48.830 16:46:00 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:48.830 16:46:00 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:48.830 16:46:00 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:48.830 16:46:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:48.830 16:46:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:48.830 16:46:00 -- common/autotest_common.sh@10 -- # set +x 00:03:48.830 ************************************ 00:03:48.830 START TEST nvme_mount 00:03:48.830 ************************************ 00:03:48.830 16:46:00 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:48.830 16:46:00 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:48.830 16:46:00 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:48.830 16:46:00 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:48.830 16:46:00 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:48.830 16:46:00 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:48.830 16:46:00 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:48.830 16:46:00 -- setup/common.sh@40 -- # local part_no=1 00:03:48.830 16:46:00 -- setup/common.sh@41 -- # local size=1073741824 00:03:48.830 16:46:00 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:48.830 16:46:00 -- setup/common.sh@44 -- # parts=() 00:03:48.830 16:46:00 -- setup/common.sh@44 -- # local parts 00:03:48.830 16:46:00 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:48.830 16:46:00 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:48.830 16:46:00 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:48.830 16:46:00 -- setup/common.sh@46 -- # (( part++ )) 00:03:48.830 16:46:00 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:48.830 16:46:00 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:48.830 16:46:00 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:48.830 16:46:00 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:49.771 Creating new GPT entries in memory. 00:03:49.771 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:49.771 other utilities. 00:03:49.771 16:46:01 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:49.771 16:46:01 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:49.771 16:46:01 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:49.771 16:46:01 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:49.771 16:46:01 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:50.711 Creating new GPT entries in memory. 00:03:50.711 The operation has completed successfully. 00:03:50.711 16:46:02 -- setup/common.sh@57 -- # (( part++ )) 00:03:50.711 16:46:02 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:50.711 16:46:02 -- setup/common.sh@62 -- # wait 70461 00:03:50.711 16:46:02 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:50.711 16:46:02 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:50.711 16:46:02 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:50.711 16:46:02 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:50.711 16:46:02 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:50.971 16:46:02 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:50.971 16:46:02 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:50.971 16:46:02 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:50.971 16:46:02 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:50.971 16:46:02 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:50.971 16:46:02 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:50.972 16:46:02 -- setup/devices.sh@53 -- # local found=0 00:03:50.972 16:46:02 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:50.972 16:46:02 -- setup/devices.sh@56 -- # : 00:03:50.972 16:46:02 -- setup/devices.sh@59 -- # local pci status 00:03:50.972 16:46:02 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:50.972 16:46:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.972 16:46:02 -- setup/devices.sh@47 -- # setup output config 00:03:50.972 16:46:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:50.972 16:46:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:51.909 16:46:03 -- setup/devices.sh@63 -- # found=1 00:03:51.909 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.909 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.909 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.909 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.909 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.909 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.909 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.909 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.909 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.909 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.168 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.168 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.168 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.168 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.168 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.168 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.168 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.168 16:46:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.168 16:46:03 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:52.168 16:46:03 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:52.168 16:46:03 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.168 16:46:03 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:52.168 16:46:03 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:52.168 16:46:03 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:52.168 16:46:03 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.168 16:46:03 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.168 16:46:03 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:52.168 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:52.168 16:46:03 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:52.168 16:46:03 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:52.427 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:52.427 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:52.427 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:52.427 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:52.427 16:46:03 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:52.427 16:46:03 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:52.427 16:46:03 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.427 16:46:03 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:52.427 16:46:03 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:52.687 16:46:03 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.687 16:46:03 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:52.687 16:46:03 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:52.687 16:46:03 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:52.687 16:46:03 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.687 16:46:03 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:52.687 16:46:03 -- setup/devices.sh@53 -- # local found=0 00:03:52.687 16:46:03 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:52.687 16:46:03 -- setup/devices.sh@56 -- # : 00:03:52.687 16:46:03 -- setup/devices.sh@59 -- # local pci status 00:03:52.687 16:46:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.687 16:46:03 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:52.687 16:46:03 -- setup/devices.sh@47 -- # setup output config 00:03:52.687 16:46:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:52.687 16:46:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:53.628 16:46:04 -- setup/devices.sh@63 -- # found=1 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.628 16:46:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.628 16:46:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.629 16:46:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.629 16:46:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.889 16:46:05 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:53.889 16:46:05 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:53.889 16:46:05 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:53.889 16:46:05 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:53.889 16:46:05 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:53.889 16:46:05 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:53.889 16:46:05 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:53.889 16:46:05 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:53.889 16:46:05 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:53.889 16:46:05 -- setup/devices.sh@50 -- # local mount_point= 00:03:53.889 16:46:05 -- setup/devices.sh@51 -- # local test_file= 00:03:53.889 16:46:05 -- setup/devices.sh@53 -- # local found=0 00:03:53.889 16:46:05 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:53.889 16:46:05 -- setup/devices.sh@59 -- # local pci status 00:03:53.889 16:46:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.889 16:46:05 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:53.889 16:46:05 -- setup/devices.sh@47 -- # setup output config 00:03:53.889 16:46:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:53.889 16:46:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:55.268 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.268 16:46:06 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:55.268 16:46:06 -- setup/devices.sh@63 -- # found=1 00:03:55.268 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.268 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.268 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.268 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.268 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.268 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.269 16:46:06 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:55.269 16:46:06 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:55.269 16:46:06 -- setup/devices.sh@68 -- # return 0 00:03:55.269 16:46:06 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:55.269 16:46:06 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:55.269 16:46:06 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:55.269 16:46:06 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:55.269 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:55.269 00:03:55.269 real 0m6.560s 00:03:55.269 user 0m1.492s 00:03:55.269 sys 0m2.644s 00:03:55.269 16:46:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:55.269 16:46:06 -- common/autotest_common.sh@10 -- # set +x 00:03:55.269 ************************************ 00:03:55.269 END TEST nvme_mount 00:03:55.269 ************************************ 00:03:55.269 16:46:06 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:55.269 16:46:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:55.269 16:46:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:55.269 16:46:06 -- common/autotest_common.sh@10 -- # set +x 00:03:55.269 ************************************ 00:03:55.269 START TEST dm_mount 00:03:55.269 ************************************ 00:03:55.269 16:46:06 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:55.269 16:46:06 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:55.269 16:46:06 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:55.269 16:46:06 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:55.269 16:46:06 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:55.269 16:46:06 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:55.269 16:46:06 -- setup/common.sh@40 -- # local part_no=2 00:03:55.269 16:46:06 -- setup/common.sh@41 -- # local size=1073741824 00:03:55.269 16:46:06 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:55.269 16:46:06 -- setup/common.sh@44 -- # parts=() 00:03:55.269 16:46:06 -- setup/common.sh@44 -- # local parts 00:03:55.269 16:46:06 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:55.269 16:46:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:55.269 16:46:06 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:55.269 16:46:06 -- setup/common.sh@46 -- # (( part++ )) 00:03:55.269 16:46:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:55.269 16:46:06 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:55.269 16:46:06 -- setup/common.sh@46 -- # (( part++ )) 00:03:55.269 16:46:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:55.269 16:46:06 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:55.269 16:46:06 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:55.269 16:46:06 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:56.211 Creating new GPT entries in memory. 00:03:56.211 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:56.211 other utilities. 00:03:56.211 16:46:07 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:56.211 16:46:07 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:56.211 16:46:07 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:56.211 16:46:07 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:56.211 16:46:07 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:57.594 Creating new GPT entries in memory. 00:03:57.594 The operation has completed successfully. 00:03:57.594 16:46:08 -- setup/common.sh@57 -- # (( part++ )) 00:03:57.594 16:46:08 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:57.594 16:46:08 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:57.594 16:46:08 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:57.594 16:46:08 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:58.534 The operation has completed successfully. 00:03:58.534 16:46:09 -- setup/common.sh@57 -- # (( part++ )) 00:03:58.534 16:46:09 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:58.534 16:46:09 -- setup/common.sh@62 -- # wait 72917 00:03:58.534 16:46:09 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:58.534 16:46:09 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:58.534 16:46:09 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:58.534 16:46:09 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:58.534 16:46:09 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:58.534 16:46:09 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:58.534 16:46:09 -- setup/devices.sh@161 -- # break 00:03:58.534 16:46:09 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:58.534 16:46:09 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:58.534 16:46:09 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:58.534 16:46:09 -- setup/devices.sh@166 -- # dm=dm-0 00:03:58.534 16:46:09 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:58.534 16:46:09 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:58.534 16:46:09 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:58.534 16:46:09 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:58.534 16:46:09 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:58.534 16:46:09 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:58.534 16:46:09 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:58.534 16:46:09 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:58.534 16:46:09 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:58.534 16:46:09 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:58.534 16:46:09 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:58.534 16:46:09 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:58.534 16:46:09 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:58.534 16:46:09 -- setup/devices.sh@53 -- # local found=0 00:03:58.534 16:46:09 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:58.534 16:46:09 -- setup/devices.sh@56 -- # : 00:03:58.534 16:46:09 -- setup/devices.sh@59 -- # local pci status 00:03:58.534 16:46:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.534 16:46:09 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:58.534 16:46:09 -- setup/devices.sh@47 -- # setup output config 00:03:58.534 16:46:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:58.534 16:46:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:59.471 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.471 16:46:10 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:59.471 16:46:10 -- setup/devices.sh@63 -- # found=1 00:03:59.471 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.471 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.471 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.471 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.471 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:59.732 16:46:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:11 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:59.732 16:46:11 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:59.732 16:46:11 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:59.732 16:46:11 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:59.732 16:46:11 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:59.732 16:46:11 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:59.732 16:46:11 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:59.732 16:46:11 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:59.732 16:46:11 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:59.732 16:46:11 -- setup/devices.sh@50 -- # local mount_point= 00:03:59.732 16:46:11 -- setup/devices.sh@51 -- # local test_file= 00:03:59.732 16:46:11 -- setup/devices.sh@53 -- # local found=0 00:03:59.732 16:46:11 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:59.732 16:46:11 -- setup/devices.sh@59 -- # local pci status 00:03:59.732 16:46:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.732 16:46:11 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:59.732 16:46:11 -- setup/devices.sh@47 -- # setup output config 00:03:59.732 16:46:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:59.732 16:46:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:01.111 16:46:12 -- setup/devices.sh@63 -- # found=1 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:01.111 16:46:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.111 16:46:12 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:01.111 16:46:12 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:01.111 16:46:12 -- setup/devices.sh@68 -- # return 0 00:04:01.111 16:46:12 -- setup/devices.sh@187 -- # cleanup_dm 00:04:01.111 16:46:12 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:01.111 16:46:12 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:01.111 16:46:12 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:01.369 16:46:12 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:01.369 16:46:12 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:01.369 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:01.369 16:46:12 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:01.369 16:46:12 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:01.369 00:04:01.369 real 0m5.987s 00:04:01.369 user 0m1.004s 00:04:01.369 sys 0m1.819s 00:04:01.369 16:46:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:01.369 16:46:12 -- common/autotest_common.sh@10 -- # set +x 00:04:01.369 ************************************ 00:04:01.369 END TEST dm_mount 00:04:01.369 ************************************ 00:04:01.369 16:46:12 -- setup/devices.sh@1 -- # cleanup 00:04:01.369 16:46:12 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:01.369 16:46:12 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:01.369 16:46:12 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:01.369 16:46:12 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:01.369 16:46:12 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:01.369 16:46:12 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:01.628 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:01.628 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:01.628 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:01.628 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:01.628 16:46:12 -- setup/devices.sh@12 -- # cleanup_dm 00:04:01.628 16:46:12 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:01.628 16:46:12 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:01.628 16:46:12 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:01.628 16:46:12 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:01.628 16:46:12 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:01.628 16:46:12 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:01.628 00:04:01.628 real 0m14.545s 00:04:01.628 user 0m3.228s 00:04:01.628 sys 0m5.495s 00:04:01.628 16:46:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:01.628 16:46:12 -- common/autotest_common.sh@10 -- # set +x 00:04:01.628 ************************************ 00:04:01.628 END TEST devices 00:04:01.628 ************************************ 00:04:01.628 00:04:01.628 real 0m45.953s 00:04:01.628 user 0m13.337s 00:04:01.628 sys 0m20.960s 00:04:01.628 16:46:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:01.628 16:46:12 -- common/autotest_common.sh@10 -- # set +x 00:04:01.628 ************************************ 00:04:01.628 END TEST setup.sh 00:04:01.628 ************************************ 00:04:01.628 16:46:12 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:03.006 Hugepages 00:04:03.006 node hugesize free / total 00:04:03.006 node0 1048576kB 0 / 0 00:04:03.006 node0 2048kB 2048 / 2048 00:04:03.006 node1 1048576kB 0 / 0 00:04:03.006 node1 2048kB 0 / 0 00:04:03.006 00:04:03.006 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:03.006 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:04:03.006 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:04:03.006 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:04:03.006 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:04:03.006 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:04:03.006 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:04:03.006 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:04:03.006 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:04:03.006 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:04:03.006 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:04:03.006 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:04:03.006 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:04:03.006 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:04:03.006 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:04:03.006 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:04:03.006 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:04:03.006 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:04:03.006 16:46:14 -- spdk/autotest.sh@128 -- # uname -s 00:04:03.006 16:46:14 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:04:03.006 16:46:14 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:04:03.006 16:46:14 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:03.945 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:03.945 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:03.945 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:04.204 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:04.204 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:04.204 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:04.204 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:04.204 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:04.204 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:04.204 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:04.204 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:04.204 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:04.204 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:04.204 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:04.204 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:04.204 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:05.145 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:05.145 16:46:16 -- common/autotest_common.sh@1527 -- # sleep 1 00:04:06.085 16:46:17 -- common/autotest_common.sh@1528 -- # bdfs=() 00:04:06.085 16:46:17 -- common/autotest_common.sh@1528 -- # local bdfs 00:04:06.085 16:46:17 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:04:06.085 16:46:17 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:04:06.085 16:46:17 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:06.344 16:46:17 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:06.344 16:46:17 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:06.344 16:46:17 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:06.344 16:46:17 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:06.344 16:46:17 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:06.344 16:46:17 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:06.344 16:46:17 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:07.723 Waiting for block devices as requested 00:04:07.723 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:04:07.723 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:07.723 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:07.984 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:07.984 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:07.984 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:07.984 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:07.984 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:08.245 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:08.245 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:08.245 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:08.507 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:08.507 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:08.507 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:08.507 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:08.767 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:08.767 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:08.767 16:46:20 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:08.767 16:46:20 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:08.767 16:46:20 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:08.767 16:46:20 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:04:08.767 16:46:20 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:08.767 16:46:20 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:08.767 16:46:20 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:08.767 16:46:20 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:08.767 16:46:20 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:08.767 16:46:20 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:08.767 16:46:20 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:08.767 16:46:20 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:08.767 16:46:20 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:08.767 16:46:20 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:08.767 16:46:20 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:08.767 16:46:20 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:08.767 16:46:20 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:08.767 16:46:20 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:08.767 16:46:20 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:08.767 16:46:20 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:08.767 16:46:20 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:08.767 16:46:20 -- common/autotest_common.sh@1552 -- # continue 00:04:08.767 16:46:20 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:08.767 16:46:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:08.767 16:46:20 -- common/autotest_common.sh@10 -- # set +x 00:04:09.026 16:46:20 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:09.026 16:46:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:09.026 16:46:20 -- common/autotest_common.sh@10 -- # set +x 00:04:09.026 16:46:20 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:10.410 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:10.410 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:10.410 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:10.410 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:10.410 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:10.410 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:10.410 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:10.410 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:10.410 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:10.410 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:10.410 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:10.410 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:10.410 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:10.410 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:10.410 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:10.410 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:11.351 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:11.351 16:46:22 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:11.351 16:46:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:11.351 16:46:22 -- common/autotest_common.sh@10 -- # set +x 00:04:11.351 16:46:22 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:11.351 16:46:22 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:11.351 16:46:22 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:11.351 16:46:22 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:11.351 16:46:22 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:11.351 16:46:22 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:11.351 16:46:22 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:11.351 16:46:22 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:11.351 16:46:22 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:11.351 16:46:22 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:11.351 16:46:22 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:11.351 16:46:22 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:11.351 16:46:22 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:11.351 16:46:22 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:11.351 16:46:22 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:11.351 16:46:22 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:11.351 16:46:22 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:11.351 16:46:22 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:11.351 16:46:22 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:11.351 16:46:22 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:11.351 16:46:22 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=78348 00:04:11.351 16:46:22 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:11.351 16:46:22 -- common/autotest_common.sh@1593 -- # waitforlisten 78348 00:04:11.351 16:46:22 -- common/autotest_common.sh@829 -- # '[' -z 78348 ']' 00:04:11.351 16:46:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:11.351 16:46:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:11.351 16:46:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:11.351 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:11.351 16:46:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:11.351 16:46:22 -- common/autotest_common.sh@10 -- # set +x 00:04:11.610 [2024-11-29 16:46:22.839314] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:11.610 [2024-11-29 16:46:22.839389] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid78348 ] 00:04:11.610 EAL: No free 2048 kB hugepages reported on node 1 00:04:11.610 [2024-11-29 16:46:22.899628] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:11.610 [2024-11-29 16:46:23.006608] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:11.610 [2024-11-29 16:46:23.006800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:12.545 16:46:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:12.545 16:46:23 -- common/autotest_common.sh@862 -- # return 0 00:04:12.545 16:46:23 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:12.545 16:46:23 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:12.545 16:46:23 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:15.829 nvme0n1 00:04:15.829 16:46:26 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:15.829 [2024-11-29 16:46:27.104377] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:15.829 [2024-11-29 16:46:27.104417] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:15.829 request: 00:04:15.829 { 00:04:15.829 "nvme_ctrlr_name": "nvme0", 00:04:15.829 "password": "test", 00:04:15.829 "method": "bdev_nvme_opal_revert", 00:04:15.829 "req_id": 1 00:04:15.829 } 00:04:15.829 Got JSON-RPC error response 00:04:15.829 response: 00:04:15.829 { 00:04:15.829 "code": -32603, 00:04:15.829 "message": "Internal error" 00:04:15.829 } 00:04:15.829 16:46:27 -- common/autotest_common.sh@1599 -- # true 00:04:15.829 16:46:27 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:15.829 16:46:27 -- common/autotest_common.sh@1603 -- # killprocess 78348 00:04:15.829 16:46:27 -- common/autotest_common.sh@936 -- # '[' -z 78348 ']' 00:04:15.829 16:46:27 -- common/autotest_common.sh@940 -- # kill -0 78348 00:04:15.829 16:46:27 -- common/autotest_common.sh@941 -- # uname 00:04:15.830 16:46:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:15.830 16:46:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 78348 00:04:15.830 16:46:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:15.830 16:46:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:15.830 16:46:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 78348' 00:04:15.830 killing process with pid 78348 00:04:15.830 16:46:27 -- common/autotest_common.sh@955 -- # kill 78348 00:04:15.830 16:46:27 -- common/autotest_common.sh@960 -- # wait 78348 00:04:17.733 16:46:28 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:17.733 16:46:28 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:17.733 16:46:28 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:17.733 16:46:28 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:17.733 16:46:28 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:17.733 16:46:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:17.733 16:46:28 -- common/autotest_common.sh@10 -- # set +x 00:04:17.733 16:46:29 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:17.733 16:46:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.733 16:46:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.733 16:46:29 -- common/autotest_common.sh@10 -- # set +x 00:04:17.733 ************************************ 00:04:17.733 START TEST env 00:04:17.733 ************************************ 00:04:17.733 16:46:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:17.733 * Looking for test storage... 00:04:17.733 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:17.733 16:46:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:17.733 16:46:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:17.733 16:46:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:17.733 16:46:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:17.733 16:46:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:17.733 16:46:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:17.733 16:46:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:17.733 16:46:29 -- scripts/common.sh@335 -- # IFS=.-: 00:04:17.733 16:46:29 -- scripts/common.sh@335 -- # read -ra ver1 00:04:17.733 16:46:29 -- scripts/common.sh@336 -- # IFS=.-: 00:04:17.733 16:46:29 -- scripts/common.sh@336 -- # read -ra ver2 00:04:17.733 16:46:29 -- scripts/common.sh@337 -- # local 'op=<' 00:04:17.733 16:46:29 -- scripts/common.sh@339 -- # ver1_l=2 00:04:17.733 16:46:29 -- scripts/common.sh@340 -- # ver2_l=1 00:04:17.733 16:46:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:17.733 16:46:29 -- scripts/common.sh@343 -- # case "$op" in 00:04:17.733 16:46:29 -- scripts/common.sh@344 -- # : 1 00:04:17.733 16:46:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:17.733 16:46:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:17.733 16:46:29 -- scripts/common.sh@364 -- # decimal 1 00:04:17.733 16:46:29 -- scripts/common.sh@352 -- # local d=1 00:04:17.733 16:46:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:17.733 16:46:29 -- scripts/common.sh@354 -- # echo 1 00:04:17.733 16:46:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:17.733 16:46:29 -- scripts/common.sh@365 -- # decimal 2 00:04:17.733 16:46:29 -- scripts/common.sh@352 -- # local d=2 00:04:17.733 16:46:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:17.733 16:46:29 -- scripts/common.sh@354 -- # echo 2 00:04:17.733 16:46:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:17.733 16:46:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:17.733 16:46:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:17.733 16:46:29 -- scripts/common.sh@367 -- # return 0 00:04:17.733 16:46:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:17.733 16:46:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:17.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.733 --rc genhtml_branch_coverage=1 00:04:17.733 --rc genhtml_function_coverage=1 00:04:17.733 --rc genhtml_legend=1 00:04:17.733 --rc geninfo_all_blocks=1 00:04:17.733 --rc geninfo_unexecuted_blocks=1 00:04:17.733 00:04:17.733 ' 00:04:17.733 16:46:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:17.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.733 --rc genhtml_branch_coverage=1 00:04:17.733 --rc genhtml_function_coverage=1 00:04:17.733 --rc genhtml_legend=1 00:04:17.733 --rc geninfo_all_blocks=1 00:04:17.733 --rc geninfo_unexecuted_blocks=1 00:04:17.733 00:04:17.733 ' 00:04:17.733 16:46:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:17.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.733 --rc genhtml_branch_coverage=1 00:04:17.733 --rc genhtml_function_coverage=1 00:04:17.733 --rc genhtml_legend=1 00:04:17.733 --rc geninfo_all_blocks=1 00:04:17.733 --rc geninfo_unexecuted_blocks=1 00:04:17.733 00:04:17.733 ' 00:04:17.733 16:46:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:17.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.733 --rc genhtml_branch_coverage=1 00:04:17.733 --rc genhtml_function_coverage=1 00:04:17.733 --rc genhtml_legend=1 00:04:17.733 --rc geninfo_all_blocks=1 00:04:17.733 --rc geninfo_unexecuted_blocks=1 00:04:17.733 00:04:17.733 ' 00:04:17.733 16:46:29 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:17.733 16:46:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.733 16:46:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.733 16:46:29 -- common/autotest_common.sh@10 -- # set +x 00:04:17.733 ************************************ 00:04:17.733 START TEST env_memory 00:04:17.733 ************************************ 00:04:17.733 16:46:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:17.733 00:04:17.733 00:04:17.733 CUnit - A unit testing framework for C - Version 2.1-3 00:04:17.733 http://cunit.sourceforge.net/ 00:04:17.733 00:04:17.733 00:04:17.733 Suite: memory 00:04:17.992 Test: alloc and free memory map ...[2024-11-29 16:46:29.186881] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:17.992 passed 00:04:17.992 Test: mem map translation ...[2024-11-29 16:46:29.207915] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:17.992 [2024-11-29 16:46:29.207951] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:17.992 [2024-11-29 16:46:29.208015] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:17.992 [2024-11-29 16:46:29.208029] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:17.992 passed 00:04:17.992 Test: mem map registration ...[2024-11-29 16:46:29.252565] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:17.992 [2024-11-29 16:46:29.252584] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:17.992 passed 00:04:17.992 Test: mem map adjacent registrations ...passed 00:04:17.992 00:04:17.992 Run Summary: Type Total Ran Passed Failed Inactive 00:04:17.992 suites 1 1 n/a 0 0 00:04:17.992 tests 4 4 4 0 0 00:04:17.992 asserts 152 152 152 0 n/a 00:04:17.992 00:04:17.992 Elapsed time = 0.147 seconds 00:04:17.992 00:04:17.992 real 0m0.156s 00:04:17.992 user 0m0.148s 00:04:17.992 sys 0m0.007s 00:04:17.992 16:46:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.992 16:46:29 -- common/autotest_common.sh@10 -- # set +x 00:04:17.992 ************************************ 00:04:17.992 END TEST env_memory 00:04:17.992 ************************************ 00:04:17.992 16:46:29 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:17.992 16:46:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.992 16:46:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.992 16:46:29 -- common/autotest_common.sh@10 -- # set +x 00:04:17.992 ************************************ 00:04:17.992 START TEST env_vtophys 00:04:17.992 ************************************ 00:04:17.992 16:46:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:17.992 EAL: lib.eal log level changed from notice to debug 00:04:17.992 EAL: Detected lcore 0 as core 0 on socket 0 00:04:17.992 EAL: Detected lcore 1 as core 1 on socket 0 00:04:17.992 EAL: Detected lcore 2 as core 2 on socket 0 00:04:17.992 EAL: Detected lcore 3 as core 3 on socket 0 00:04:17.992 EAL: Detected lcore 4 as core 4 on socket 0 00:04:17.992 EAL: Detected lcore 5 as core 5 on socket 0 00:04:17.992 EAL: Detected lcore 6 as core 8 on socket 0 00:04:17.992 EAL: Detected lcore 7 as core 9 on socket 0 00:04:17.992 EAL: Detected lcore 8 as core 10 on socket 0 00:04:17.992 EAL: Detected lcore 9 as core 11 on socket 0 00:04:17.992 EAL: Detected lcore 10 as core 12 on socket 0 00:04:17.992 EAL: Detected lcore 11 as core 13 on socket 0 00:04:17.992 EAL: Detected lcore 12 as core 0 on socket 1 00:04:17.992 EAL: Detected lcore 13 as core 1 on socket 1 00:04:17.992 EAL: Detected lcore 14 as core 2 on socket 1 00:04:17.992 EAL: Detected lcore 15 as core 3 on socket 1 00:04:17.992 EAL: Detected lcore 16 as core 4 on socket 1 00:04:17.993 EAL: Detected lcore 17 as core 5 on socket 1 00:04:17.993 EAL: Detected lcore 18 as core 8 on socket 1 00:04:17.993 EAL: Detected lcore 19 as core 9 on socket 1 00:04:17.993 EAL: Detected lcore 20 as core 10 on socket 1 00:04:17.993 EAL: Detected lcore 21 as core 11 on socket 1 00:04:17.993 EAL: Detected lcore 22 as core 12 on socket 1 00:04:17.993 EAL: Detected lcore 23 as core 13 on socket 1 00:04:17.993 EAL: Detected lcore 24 as core 0 on socket 0 00:04:17.993 EAL: Detected lcore 25 as core 1 on socket 0 00:04:17.993 EAL: Detected lcore 26 as core 2 on socket 0 00:04:17.993 EAL: Detected lcore 27 as core 3 on socket 0 00:04:17.993 EAL: Detected lcore 28 as core 4 on socket 0 00:04:17.993 EAL: Detected lcore 29 as core 5 on socket 0 00:04:17.993 EAL: Detected lcore 30 as core 8 on socket 0 00:04:17.993 EAL: Detected lcore 31 as core 9 on socket 0 00:04:17.993 EAL: Detected lcore 32 as core 10 on socket 0 00:04:17.993 EAL: Detected lcore 33 as core 11 on socket 0 00:04:17.993 EAL: Detected lcore 34 as core 12 on socket 0 00:04:17.993 EAL: Detected lcore 35 as core 13 on socket 0 00:04:17.993 EAL: Detected lcore 36 as core 0 on socket 1 00:04:17.993 EAL: Detected lcore 37 as core 1 on socket 1 00:04:17.993 EAL: Detected lcore 38 as core 2 on socket 1 00:04:17.993 EAL: Detected lcore 39 as core 3 on socket 1 00:04:17.993 EAL: Detected lcore 40 as core 4 on socket 1 00:04:17.993 EAL: Detected lcore 41 as core 5 on socket 1 00:04:17.993 EAL: Detected lcore 42 as core 8 on socket 1 00:04:17.993 EAL: Detected lcore 43 as core 9 on socket 1 00:04:17.993 EAL: Detected lcore 44 as core 10 on socket 1 00:04:17.993 EAL: Detected lcore 45 as core 11 on socket 1 00:04:17.993 EAL: Detected lcore 46 as core 12 on socket 1 00:04:17.993 EAL: Detected lcore 47 as core 13 on socket 1 00:04:17.993 EAL: Maximum logical cores by configuration: 128 00:04:17.993 EAL: Detected CPU lcores: 48 00:04:17.993 EAL: Detected NUMA nodes: 2 00:04:17.993 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:17.993 EAL: Detected shared linkage of DPDK 00:04:17.993 EAL: No shared files mode enabled, IPC will be disabled 00:04:17.993 EAL: Bus pci wants IOVA as 'DC' 00:04:17.993 EAL: Buses did not request a specific IOVA mode. 00:04:17.993 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:17.993 EAL: Selected IOVA mode 'VA' 00:04:17.993 EAL: No free 2048 kB hugepages reported on node 1 00:04:17.993 EAL: Probing VFIO support... 00:04:17.993 EAL: IOMMU type 1 (Type 1) is supported 00:04:17.993 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:17.993 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:17.993 EAL: VFIO support initialized 00:04:17.993 EAL: Ask a virtual area of 0x2e000 bytes 00:04:17.993 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:17.993 EAL: Setting up physically contiguous memory... 00:04:17.993 EAL: Setting maximum number of open files to 524288 00:04:17.993 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:17.993 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:17.993 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:17.993 EAL: Ask a virtual area of 0x61000 bytes 00:04:17.993 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:17.993 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:17.993 EAL: Ask a virtual area of 0x400000000 bytes 00:04:17.993 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:17.993 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:17.993 EAL: Ask a virtual area of 0x61000 bytes 00:04:17.993 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:17.993 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:17.993 EAL: Ask a virtual area of 0x400000000 bytes 00:04:17.993 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:17.993 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:17.993 EAL: Ask a virtual area of 0x61000 bytes 00:04:17.993 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:17.993 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:17.993 EAL: Ask a virtual area of 0x400000000 bytes 00:04:17.993 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:17.993 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:17.993 EAL: Ask a virtual area of 0x61000 bytes 00:04:17.993 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:17.993 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:17.993 EAL: Ask a virtual area of 0x400000000 bytes 00:04:17.993 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:17.993 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:17.993 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:17.993 EAL: Ask a virtual area of 0x61000 bytes 00:04:17.993 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:17.993 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:17.993 EAL: Ask a virtual area of 0x400000000 bytes 00:04:17.993 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:17.993 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:17.993 EAL: Ask a virtual area of 0x61000 bytes 00:04:17.993 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:17.993 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:17.993 EAL: Ask a virtual area of 0x400000000 bytes 00:04:17.993 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:17.993 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:17.993 EAL: Ask a virtual area of 0x61000 bytes 00:04:17.993 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:17.993 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:17.993 EAL: Ask a virtual area of 0x400000000 bytes 00:04:17.993 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:17.993 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:17.993 EAL: Ask a virtual area of 0x61000 bytes 00:04:17.993 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:17.993 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:17.993 EAL: Ask a virtual area of 0x400000000 bytes 00:04:17.993 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:17.993 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:17.993 EAL: Hugepages will be freed exactly as allocated. 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: TSC frequency is ~2700000 KHz 00:04:17.993 EAL: Main lcore 0 is ready (tid=7fbb43c55a00;cpuset=[0]) 00:04:17.993 EAL: Trying to obtain current memory policy. 00:04:17.993 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:17.993 EAL: Restoring previous memory policy: 0 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was expanded by 2MB 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:17.993 EAL: Mem event callback 'spdk:(nil)' registered 00:04:17.993 00:04:17.993 00:04:17.993 CUnit - A unit testing framework for C - Version 2.1-3 00:04:17.993 http://cunit.sourceforge.net/ 00:04:17.993 00:04:17.993 00:04:17.993 Suite: components_suite 00:04:17.993 Test: vtophys_malloc_test ...passed 00:04:17.993 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:17.993 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:17.993 EAL: Restoring previous memory policy: 4 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was expanded by 4MB 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was shrunk by 4MB 00:04:17.993 EAL: Trying to obtain current memory policy. 00:04:17.993 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:17.993 EAL: Restoring previous memory policy: 4 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was expanded by 6MB 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was shrunk by 6MB 00:04:17.993 EAL: Trying to obtain current memory policy. 00:04:17.993 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:17.993 EAL: Restoring previous memory policy: 4 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was expanded by 10MB 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was shrunk by 10MB 00:04:17.993 EAL: Trying to obtain current memory policy. 00:04:17.993 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:17.993 EAL: Restoring previous memory policy: 4 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was expanded by 18MB 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was shrunk by 18MB 00:04:17.993 EAL: Trying to obtain current memory policy. 00:04:17.993 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:17.993 EAL: Restoring previous memory policy: 4 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:17.993 EAL: request: mp_malloc_sync 00:04:17.993 EAL: No shared files mode enabled, IPC is disabled 00:04:17.993 EAL: Heap on socket 0 was expanded by 34MB 00:04:17.993 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.252 EAL: request: mp_malloc_sync 00:04:18.252 EAL: No shared files mode enabled, IPC is disabled 00:04:18.252 EAL: Heap on socket 0 was shrunk by 34MB 00:04:18.252 EAL: Trying to obtain current memory policy. 00:04:18.252 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.252 EAL: Restoring previous memory policy: 4 00:04:18.252 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.252 EAL: request: mp_malloc_sync 00:04:18.252 EAL: No shared files mode enabled, IPC is disabled 00:04:18.252 EAL: Heap on socket 0 was expanded by 66MB 00:04:18.252 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.252 EAL: request: mp_malloc_sync 00:04:18.252 EAL: No shared files mode enabled, IPC is disabled 00:04:18.252 EAL: Heap on socket 0 was shrunk by 66MB 00:04:18.252 EAL: Trying to obtain current memory policy. 00:04:18.252 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.252 EAL: Restoring previous memory policy: 4 00:04:18.252 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.252 EAL: request: mp_malloc_sync 00:04:18.252 EAL: No shared files mode enabled, IPC is disabled 00:04:18.252 EAL: Heap on socket 0 was expanded by 130MB 00:04:18.252 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.252 EAL: request: mp_malloc_sync 00:04:18.252 EAL: No shared files mode enabled, IPC is disabled 00:04:18.252 EAL: Heap on socket 0 was shrunk by 130MB 00:04:18.252 EAL: Trying to obtain current memory policy. 00:04:18.252 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.252 EAL: Restoring previous memory policy: 4 00:04:18.252 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.252 EAL: request: mp_malloc_sync 00:04:18.252 EAL: No shared files mode enabled, IPC is disabled 00:04:18.252 EAL: Heap on socket 0 was expanded by 258MB 00:04:18.252 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.510 EAL: request: mp_malloc_sync 00:04:18.510 EAL: No shared files mode enabled, IPC is disabled 00:04:18.510 EAL: Heap on socket 0 was shrunk by 258MB 00:04:18.510 EAL: Trying to obtain current memory policy. 00:04:18.510 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.510 EAL: Restoring previous memory policy: 4 00:04:18.510 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.510 EAL: request: mp_malloc_sync 00:04:18.510 EAL: No shared files mode enabled, IPC is disabled 00:04:18.510 EAL: Heap on socket 0 was expanded by 514MB 00:04:18.768 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.768 EAL: request: mp_malloc_sync 00:04:18.768 EAL: No shared files mode enabled, IPC is disabled 00:04:18.768 EAL: Heap on socket 0 was shrunk by 514MB 00:04:18.768 EAL: Trying to obtain current memory policy. 00:04:18.768 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:19.027 EAL: Restoring previous memory policy: 4 00:04:19.027 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.027 EAL: request: mp_malloc_sync 00:04:19.027 EAL: No shared files mode enabled, IPC is disabled 00:04:19.027 EAL: Heap on socket 0 was expanded by 1026MB 00:04:19.286 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.546 EAL: request: mp_malloc_sync 00:04:19.546 EAL: No shared files mode enabled, IPC is disabled 00:04:19.546 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:19.546 passed 00:04:19.546 00:04:19.546 Run Summary: Type Total Ran Passed Failed Inactive 00:04:19.546 suites 1 1 n/a 0 0 00:04:19.546 tests 2 2 2 0 0 00:04:19.546 asserts 497 497 497 0 n/a 00:04:19.546 00:04:19.546 Elapsed time = 1.336 seconds 00:04:19.546 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.546 EAL: request: mp_malloc_sync 00:04:19.546 EAL: No shared files mode enabled, IPC is disabled 00:04:19.546 EAL: Heap on socket 0 was shrunk by 2MB 00:04:19.546 EAL: No shared files mode enabled, IPC is disabled 00:04:19.546 EAL: No shared files mode enabled, IPC is disabled 00:04:19.546 EAL: No shared files mode enabled, IPC is disabled 00:04:19.546 00:04:19.546 real 0m1.442s 00:04:19.546 user 0m0.842s 00:04:19.546 sys 0m0.566s 00:04:19.546 16:46:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.546 16:46:30 -- common/autotest_common.sh@10 -- # set +x 00:04:19.546 ************************************ 00:04:19.546 END TEST env_vtophys 00:04:19.546 ************************************ 00:04:19.546 16:46:30 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:19.546 16:46:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.546 16:46:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.546 16:46:30 -- common/autotest_common.sh@10 -- # set +x 00:04:19.546 ************************************ 00:04:19.546 START TEST env_pci 00:04:19.546 ************************************ 00:04:19.546 16:46:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:19.546 00:04:19.546 00:04:19.546 CUnit - A unit testing framework for C - Version 2.1-3 00:04:19.546 http://cunit.sourceforge.net/ 00:04:19.546 00:04:19.546 00:04:19.546 Suite: pci 00:04:19.546 Test: pci_hook ...[2024-11-29 16:46:30.812438] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 79391 has claimed it 00:04:19.546 EAL: Cannot find device (10000:00:01.0) 00:04:19.546 EAL: Failed to attach device on primary process 00:04:19.546 passed 00:04:19.546 00:04:19.546 Run Summary: Type Total Ran Passed Failed Inactive 00:04:19.546 suites 1 1 n/a 0 0 00:04:19.546 tests 1 1 1 0 0 00:04:19.546 asserts 25 25 25 0 n/a 00:04:19.546 00:04:19.546 Elapsed time = 0.021 seconds 00:04:19.546 00:04:19.546 real 0m0.035s 00:04:19.546 user 0m0.012s 00:04:19.546 sys 0m0.022s 00:04:19.546 16:46:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.546 16:46:30 -- common/autotest_common.sh@10 -- # set +x 00:04:19.546 ************************************ 00:04:19.546 END TEST env_pci 00:04:19.546 ************************************ 00:04:19.546 16:46:30 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:19.546 16:46:30 -- env/env.sh@15 -- # uname 00:04:19.546 16:46:30 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:19.546 16:46:30 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:19.546 16:46:30 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:19.546 16:46:30 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:19.546 16:46:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.546 16:46:30 -- common/autotest_common.sh@10 -- # set +x 00:04:19.546 ************************************ 00:04:19.546 START TEST env_dpdk_post_init 00:04:19.546 ************************************ 00:04:19.546 16:46:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:19.546 EAL: Detected CPU lcores: 48 00:04:19.546 EAL: Detected NUMA nodes: 2 00:04:19.546 EAL: Detected shared linkage of DPDK 00:04:19.546 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:19.546 EAL: Selected IOVA mode 'VA' 00:04:19.546 EAL: No free 2048 kB hugepages reported on node 1 00:04:19.546 EAL: VFIO support initialized 00:04:19.546 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:19.546 EAL: Using IOMMU type 1 (Type 1) 00:04:19.546 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:19.807 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:20.745 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:24.029 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:24.029 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:24.029 Starting DPDK initialization... 00:04:24.029 Starting SPDK post initialization... 00:04:24.029 SPDK NVMe probe 00:04:24.029 Attaching to 0000:88:00.0 00:04:24.029 Attached to 0000:88:00.0 00:04:24.029 Cleaning up... 00:04:24.029 00:04:24.029 real 0m4.377s 00:04:24.029 user 0m3.268s 00:04:24.029 sys 0m0.164s 00:04:24.029 16:46:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:24.029 16:46:35 -- common/autotest_common.sh@10 -- # set +x 00:04:24.029 ************************************ 00:04:24.029 END TEST env_dpdk_post_init 00:04:24.029 ************************************ 00:04:24.029 16:46:35 -- env/env.sh@26 -- # uname 00:04:24.029 16:46:35 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:24.029 16:46:35 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:24.029 16:46:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:24.029 16:46:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:24.029 16:46:35 -- common/autotest_common.sh@10 -- # set +x 00:04:24.029 ************************************ 00:04:24.029 START TEST env_mem_callbacks 00:04:24.029 ************************************ 00:04:24.029 16:46:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:24.029 EAL: Detected CPU lcores: 48 00:04:24.029 EAL: Detected NUMA nodes: 2 00:04:24.029 EAL: Detected shared linkage of DPDK 00:04:24.029 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:24.029 EAL: Selected IOVA mode 'VA' 00:04:24.029 EAL: No free 2048 kB hugepages reported on node 1 00:04:24.029 EAL: VFIO support initialized 00:04:24.029 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:24.029 00:04:24.029 00:04:24.029 CUnit - A unit testing framework for C - Version 2.1-3 00:04:24.029 http://cunit.sourceforge.net/ 00:04:24.029 00:04:24.029 00:04:24.029 Suite: memory 00:04:24.029 Test: test ... 00:04:24.029 register 0x200000200000 2097152 00:04:24.029 malloc 3145728 00:04:24.029 register 0x200000400000 4194304 00:04:24.029 buf 0x200000500000 len 3145728 PASSED 00:04:24.029 malloc 64 00:04:24.029 buf 0x2000004fff40 len 64 PASSED 00:04:24.029 malloc 4194304 00:04:24.029 register 0x200000800000 6291456 00:04:24.029 buf 0x200000a00000 len 4194304 PASSED 00:04:24.029 free 0x200000500000 3145728 00:04:24.029 free 0x2000004fff40 64 00:04:24.029 unregister 0x200000400000 4194304 PASSED 00:04:24.029 free 0x200000a00000 4194304 00:04:24.029 unregister 0x200000800000 6291456 PASSED 00:04:24.029 malloc 8388608 00:04:24.029 register 0x200000400000 10485760 00:04:24.029 buf 0x200000600000 len 8388608 PASSED 00:04:24.029 free 0x200000600000 8388608 00:04:24.029 unregister 0x200000400000 10485760 PASSED 00:04:24.029 passed 00:04:24.029 00:04:24.029 Run Summary: Type Total Ran Passed Failed Inactive 00:04:24.029 suites 1 1 n/a 0 0 00:04:24.029 tests 1 1 1 0 0 00:04:24.029 asserts 15 15 15 0 n/a 00:04:24.029 00:04:24.029 Elapsed time = 0.005 seconds 00:04:24.029 00:04:24.029 real 0m0.049s 00:04:24.029 user 0m0.015s 00:04:24.029 sys 0m0.034s 00:04:24.029 16:46:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:24.029 16:46:35 -- common/autotest_common.sh@10 -- # set +x 00:04:24.029 ************************************ 00:04:24.029 END TEST env_mem_callbacks 00:04:24.029 ************************************ 00:04:24.029 00:04:24.029 real 0m6.340s 00:04:24.029 user 0m4.430s 00:04:24.029 sys 0m0.962s 00:04:24.029 16:46:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:24.029 16:46:35 -- common/autotest_common.sh@10 -- # set +x 00:04:24.029 ************************************ 00:04:24.029 END TEST env 00:04:24.029 ************************************ 00:04:24.029 16:46:35 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:24.029 16:46:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:24.029 16:46:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:24.029 16:46:35 -- common/autotest_common.sh@10 -- # set +x 00:04:24.029 ************************************ 00:04:24.029 START TEST rpc 00:04:24.029 ************************************ 00:04:24.029 16:46:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:24.029 * Looking for test storage... 00:04:24.029 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:24.029 16:46:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:24.029 16:46:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:24.029 16:46:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:24.288 16:46:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:24.288 16:46:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:24.288 16:46:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:24.288 16:46:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:24.288 16:46:35 -- scripts/common.sh@335 -- # IFS=.-: 00:04:24.288 16:46:35 -- scripts/common.sh@335 -- # read -ra ver1 00:04:24.288 16:46:35 -- scripts/common.sh@336 -- # IFS=.-: 00:04:24.289 16:46:35 -- scripts/common.sh@336 -- # read -ra ver2 00:04:24.289 16:46:35 -- scripts/common.sh@337 -- # local 'op=<' 00:04:24.289 16:46:35 -- scripts/common.sh@339 -- # ver1_l=2 00:04:24.289 16:46:35 -- scripts/common.sh@340 -- # ver2_l=1 00:04:24.289 16:46:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:24.289 16:46:35 -- scripts/common.sh@343 -- # case "$op" in 00:04:24.289 16:46:35 -- scripts/common.sh@344 -- # : 1 00:04:24.289 16:46:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:24.289 16:46:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:24.289 16:46:35 -- scripts/common.sh@364 -- # decimal 1 00:04:24.289 16:46:35 -- scripts/common.sh@352 -- # local d=1 00:04:24.289 16:46:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:24.289 16:46:35 -- scripts/common.sh@354 -- # echo 1 00:04:24.289 16:46:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:24.289 16:46:35 -- scripts/common.sh@365 -- # decimal 2 00:04:24.289 16:46:35 -- scripts/common.sh@352 -- # local d=2 00:04:24.289 16:46:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:24.289 16:46:35 -- scripts/common.sh@354 -- # echo 2 00:04:24.289 16:46:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:24.289 16:46:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:24.289 16:46:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:24.289 16:46:35 -- scripts/common.sh@367 -- # return 0 00:04:24.289 16:46:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:24.289 16:46:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:24.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.289 --rc genhtml_branch_coverage=1 00:04:24.289 --rc genhtml_function_coverage=1 00:04:24.289 --rc genhtml_legend=1 00:04:24.289 --rc geninfo_all_blocks=1 00:04:24.289 --rc geninfo_unexecuted_blocks=1 00:04:24.289 00:04:24.289 ' 00:04:24.289 16:46:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:24.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.289 --rc genhtml_branch_coverage=1 00:04:24.289 --rc genhtml_function_coverage=1 00:04:24.289 --rc genhtml_legend=1 00:04:24.289 --rc geninfo_all_blocks=1 00:04:24.289 --rc geninfo_unexecuted_blocks=1 00:04:24.289 00:04:24.289 ' 00:04:24.289 16:46:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:24.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.289 --rc genhtml_branch_coverage=1 00:04:24.289 --rc genhtml_function_coverage=1 00:04:24.289 --rc genhtml_legend=1 00:04:24.289 --rc geninfo_all_blocks=1 00:04:24.289 --rc geninfo_unexecuted_blocks=1 00:04:24.289 00:04:24.289 ' 00:04:24.289 16:46:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:24.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.289 --rc genhtml_branch_coverage=1 00:04:24.289 --rc genhtml_function_coverage=1 00:04:24.289 --rc genhtml_legend=1 00:04:24.289 --rc geninfo_all_blocks=1 00:04:24.289 --rc geninfo_unexecuted_blocks=1 00:04:24.289 00:04:24.289 ' 00:04:24.289 16:46:35 -- rpc/rpc.sh@65 -- # spdk_pid=80069 00:04:24.289 16:46:35 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:24.289 16:46:35 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:24.289 16:46:35 -- rpc/rpc.sh@67 -- # waitforlisten 80069 00:04:24.289 16:46:35 -- common/autotest_common.sh@829 -- # '[' -z 80069 ']' 00:04:24.289 16:46:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:24.289 16:46:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:24.289 16:46:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:24.289 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:24.289 16:46:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:24.289 16:46:35 -- common/autotest_common.sh@10 -- # set +x 00:04:24.289 [2024-11-29 16:46:35.556480] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:24.289 [2024-11-29 16:46:35.556574] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid80069 ] 00:04:24.289 EAL: No free 2048 kB hugepages reported on node 1 00:04:24.289 [2024-11-29 16:46:35.612679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:24.289 [2024-11-29 16:46:35.713226] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:24.289 [2024-11-29 16:46:35.713383] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:24.289 [2024-11-29 16:46:35.713404] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 80069' to capture a snapshot of events at runtime. 00:04:24.289 [2024-11-29 16:46:35.713416] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid80069 for offline analysis/debug. 00:04:24.289 [2024-11-29 16:46:35.713443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:25.224 16:46:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:25.224 16:46:36 -- common/autotest_common.sh@862 -- # return 0 00:04:25.224 16:46:36 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:25.224 16:46:36 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:25.224 16:46:36 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:25.225 16:46:36 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:25.225 16:46:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.225 16:46:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.225 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.225 ************************************ 00:04:25.225 START TEST rpc_integrity 00:04:25.225 ************************************ 00:04:25.225 16:46:36 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:25.225 16:46:36 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:25.225 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.225 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.225 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.225 16:46:36 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:25.225 16:46:36 -- rpc/rpc.sh@13 -- # jq length 00:04:25.225 16:46:36 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:25.225 16:46:36 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:25.225 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.225 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.225 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.225 16:46:36 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:25.225 16:46:36 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:25.225 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.225 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.225 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.225 16:46:36 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:25.225 { 00:04:25.225 "name": "Malloc0", 00:04:25.225 "aliases": [ 00:04:25.225 "3be26625-dccb-42c7-a08b-53cdd0dc9e0b" 00:04:25.225 ], 00:04:25.225 "product_name": "Malloc disk", 00:04:25.225 "block_size": 512, 00:04:25.225 "num_blocks": 16384, 00:04:25.225 "uuid": "3be26625-dccb-42c7-a08b-53cdd0dc9e0b", 00:04:25.225 "assigned_rate_limits": { 00:04:25.225 "rw_ios_per_sec": 0, 00:04:25.225 "rw_mbytes_per_sec": 0, 00:04:25.225 "r_mbytes_per_sec": 0, 00:04:25.225 "w_mbytes_per_sec": 0 00:04:25.225 }, 00:04:25.225 "claimed": false, 00:04:25.225 "zoned": false, 00:04:25.225 "supported_io_types": { 00:04:25.225 "read": true, 00:04:25.225 "write": true, 00:04:25.225 "unmap": true, 00:04:25.225 "write_zeroes": true, 00:04:25.225 "flush": true, 00:04:25.225 "reset": true, 00:04:25.225 "compare": false, 00:04:25.225 "compare_and_write": false, 00:04:25.225 "abort": true, 00:04:25.225 "nvme_admin": false, 00:04:25.225 "nvme_io": false 00:04:25.225 }, 00:04:25.225 "memory_domains": [ 00:04:25.225 { 00:04:25.225 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:25.225 "dma_device_type": 2 00:04:25.225 } 00:04:25.225 ], 00:04:25.225 "driver_specific": {} 00:04:25.225 } 00:04:25.225 ]' 00:04:25.225 16:46:36 -- rpc/rpc.sh@17 -- # jq length 00:04:25.225 16:46:36 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:25.225 16:46:36 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:25.225 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.225 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.225 [2024-11-29 16:46:36.601788] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:25.225 [2024-11-29 16:46:36.601841] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:25.225 [2024-11-29 16:46:36.601862] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x237fcb0 00:04:25.225 [2024-11-29 16:46:36.601875] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:25.225 [2024-11-29 16:46:36.603197] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:25.225 [2024-11-29 16:46:36.603228] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:25.225 Passthru0 00:04:25.225 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.225 16:46:36 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:25.225 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.225 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.225 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.225 16:46:36 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:25.225 { 00:04:25.225 "name": "Malloc0", 00:04:25.225 "aliases": [ 00:04:25.225 "3be26625-dccb-42c7-a08b-53cdd0dc9e0b" 00:04:25.225 ], 00:04:25.225 "product_name": "Malloc disk", 00:04:25.225 "block_size": 512, 00:04:25.225 "num_blocks": 16384, 00:04:25.225 "uuid": "3be26625-dccb-42c7-a08b-53cdd0dc9e0b", 00:04:25.225 "assigned_rate_limits": { 00:04:25.225 "rw_ios_per_sec": 0, 00:04:25.225 "rw_mbytes_per_sec": 0, 00:04:25.225 "r_mbytes_per_sec": 0, 00:04:25.225 "w_mbytes_per_sec": 0 00:04:25.225 }, 00:04:25.225 "claimed": true, 00:04:25.225 "claim_type": "exclusive_write", 00:04:25.225 "zoned": false, 00:04:25.225 "supported_io_types": { 00:04:25.225 "read": true, 00:04:25.225 "write": true, 00:04:25.225 "unmap": true, 00:04:25.225 "write_zeroes": true, 00:04:25.225 "flush": true, 00:04:25.225 "reset": true, 00:04:25.225 "compare": false, 00:04:25.225 "compare_and_write": false, 00:04:25.225 "abort": true, 00:04:25.225 "nvme_admin": false, 00:04:25.225 "nvme_io": false 00:04:25.225 }, 00:04:25.225 "memory_domains": [ 00:04:25.225 { 00:04:25.225 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:25.225 "dma_device_type": 2 00:04:25.225 } 00:04:25.225 ], 00:04:25.225 "driver_specific": {} 00:04:25.225 }, 00:04:25.225 { 00:04:25.225 "name": "Passthru0", 00:04:25.225 "aliases": [ 00:04:25.225 "f3f80752-aef4-53d2-9072-af8ce4633d8a" 00:04:25.225 ], 00:04:25.225 "product_name": "passthru", 00:04:25.225 "block_size": 512, 00:04:25.225 "num_blocks": 16384, 00:04:25.225 "uuid": "f3f80752-aef4-53d2-9072-af8ce4633d8a", 00:04:25.225 "assigned_rate_limits": { 00:04:25.225 "rw_ios_per_sec": 0, 00:04:25.225 "rw_mbytes_per_sec": 0, 00:04:25.225 "r_mbytes_per_sec": 0, 00:04:25.225 "w_mbytes_per_sec": 0 00:04:25.225 }, 00:04:25.225 "claimed": false, 00:04:25.225 "zoned": false, 00:04:25.225 "supported_io_types": { 00:04:25.225 "read": true, 00:04:25.225 "write": true, 00:04:25.225 "unmap": true, 00:04:25.225 "write_zeroes": true, 00:04:25.225 "flush": true, 00:04:25.225 "reset": true, 00:04:25.225 "compare": false, 00:04:25.225 "compare_and_write": false, 00:04:25.225 "abort": true, 00:04:25.225 "nvme_admin": false, 00:04:25.225 "nvme_io": false 00:04:25.225 }, 00:04:25.225 "memory_domains": [ 00:04:25.225 { 00:04:25.225 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:25.225 "dma_device_type": 2 00:04:25.225 } 00:04:25.225 ], 00:04:25.225 "driver_specific": { 00:04:25.225 "passthru": { 00:04:25.225 "name": "Passthru0", 00:04:25.225 "base_bdev_name": "Malloc0" 00:04:25.225 } 00:04:25.225 } 00:04:25.225 } 00:04:25.225 ]' 00:04:25.225 16:46:36 -- rpc/rpc.sh@21 -- # jq length 00:04:25.225 16:46:36 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:25.225 16:46:36 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:25.225 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.225 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.484 16:46:36 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:25.484 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.484 16:46:36 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:25.484 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.484 16:46:36 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:25.484 16:46:36 -- rpc/rpc.sh@26 -- # jq length 00:04:25.484 16:46:36 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:25.484 00:04:25.484 real 0m0.219s 00:04:25.484 user 0m0.149s 00:04:25.484 sys 0m0.011s 00:04:25.484 16:46:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 ************************************ 00:04:25.484 END TEST rpc_integrity 00:04:25.484 ************************************ 00:04:25.484 16:46:36 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:25.484 16:46:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.484 16:46:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 ************************************ 00:04:25.484 START TEST rpc_plugins 00:04:25.484 ************************************ 00:04:25.484 16:46:36 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:25.484 16:46:36 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:25.484 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.484 16:46:36 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:25.484 16:46:36 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:25.484 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.484 16:46:36 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:25.484 { 00:04:25.484 "name": "Malloc1", 00:04:25.484 "aliases": [ 00:04:25.484 "cc01cd22-3831-42c3-a426-6b48875da2c2" 00:04:25.484 ], 00:04:25.484 "product_name": "Malloc disk", 00:04:25.484 "block_size": 4096, 00:04:25.484 "num_blocks": 256, 00:04:25.484 "uuid": "cc01cd22-3831-42c3-a426-6b48875da2c2", 00:04:25.484 "assigned_rate_limits": { 00:04:25.484 "rw_ios_per_sec": 0, 00:04:25.484 "rw_mbytes_per_sec": 0, 00:04:25.484 "r_mbytes_per_sec": 0, 00:04:25.484 "w_mbytes_per_sec": 0 00:04:25.484 }, 00:04:25.484 "claimed": false, 00:04:25.484 "zoned": false, 00:04:25.484 "supported_io_types": { 00:04:25.484 "read": true, 00:04:25.484 "write": true, 00:04:25.484 "unmap": true, 00:04:25.484 "write_zeroes": true, 00:04:25.484 "flush": true, 00:04:25.484 "reset": true, 00:04:25.484 "compare": false, 00:04:25.484 "compare_and_write": false, 00:04:25.484 "abort": true, 00:04:25.484 "nvme_admin": false, 00:04:25.484 "nvme_io": false 00:04:25.484 }, 00:04:25.484 "memory_domains": [ 00:04:25.484 { 00:04:25.484 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:25.484 "dma_device_type": 2 00:04:25.484 } 00:04:25.484 ], 00:04:25.484 "driver_specific": {} 00:04:25.484 } 00:04:25.484 ]' 00:04:25.484 16:46:36 -- rpc/rpc.sh@32 -- # jq length 00:04:25.484 16:46:36 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:25.484 16:46:36 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:25.484 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.484 16:46:36 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:25.484 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.484 16:46:36 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:25.484 16:46:36 -- rpc/rpc.sh@36 -- # jq length 00:04:25.484 16:46:36 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:25.484 00:04:25.484 real 0m0.104s 00:04:25.484 user 0m0.067s 00:04:25.484 sys 0m0.010s 00:04:25.484 16:46:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 ************************************ 00:04:25.484 END TEST rpc_plugins 00:04:25.484 ************************************ 00:04:25.484 16:46:36 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:25.484 16:46:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.484 16:46:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 ************************************ 00:04:25.484 START TEST rpc_trace_cmd_test 00:04:25.484 ************************************ 00:04:25.484 16:46:36 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:25.484 16:46:36 -- rpc/rpc.sh@40 -- # local info 00:04:25.484 16:46:36 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:25.484 16:46:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.484 16:46:36 -- common/autotest_common.sh@10 -- # set +x 00:04:25.484 16:46:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.484 16:46:36 -- rpc/rpc.sh@42 -- # info='{ 00:04:25.484 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid80069", 00:04:25.484 "tpoint_group_mask": "0x8", 00:04:25.484 "iscsi_conn": { 00:04:25.484 "mask": "0x2", 00:04:25.484 "tpoint_mask": "0x0" 00:04:25.484 }, 00:04:25.484 "scsi": { 00:04:25.484 "mask": "0x4", 00:04:25.484 "tpoint_mask": "0x0" 00:04:25.484 }, 00:04:25.484 "bdev": { 00:04:25.484 "mask": "0x8", 00:04:25.484 "tpoint_mask": "0xffffffffffffffff" 00:04:25.484 }, 00:04:25.484 "nvmf_rdma": { 00:04:25.484 "mask": "0x10", 00:04:25.484 "tpoint_mask": "0x0" 00:04:25.484 }, 00:04:25.484 "nvmf_tcp": { 00:04:25.484 "mask": "0x20", 00:04:25.484 "tpoint_mask": "0x0" 00:04:25.484 }, 00:04:25.484 "ftl": { 00:04:25.484 "mask": "0x40", 00:04:25.484 "tpoint_mask": "0x0" 00:04:25.484 }, 00:04:25.484 "blobfs": { 00:04:25.484 "mask": "0x80", 00:04:25.484 "tpoint_mask": "0x0" 00:04:25.484 }, 00:04:25.484 "dsa": { 00:04:25.484 "mask": "0x200", 00:04:25.484 "tpoint_mask": "0x0" 00:04:25.484 }, 00:04:25.484 "thread": { 00:04:25.485 "mask": "0x400", 00:04:25.485 "tpoint_mask": "0x0" 00:04:25.485 }, 00:04:25.485 "nvme_pcie": { 00:04:25.485 "mask": "0x800", 00:04:25.485 "tpoint_mask": "0x0" 00:04:25.485 }, 00:04:25.485 "iaa": { 00:04:25.485 "mask": "0x1000", 00:04:25.485 "tpoint_mask": "0x0" 00:04:25.485 }, 00:04:25.485 "nvme_tcp": { 00:04:25.485 "mask": "0x2000", 00:04:25.485 "tpoint_mask": "0x0" 00:04:25.485 }, 00:04:25.485 "bdev_nvme": { 00:04:25.485 "mask": "0x4000", 00:04:25.485 "tpoint_mask": "0x0" 00:04:25.485 } 00:04:25.485 }' 00:04:25.485 16:46:36 -- rpc/rpc.sh@43 -- # jq length 00:04:25.743 16:46:36 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:25.743 16:46:36 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:25.743 16:46:36 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:25.743 16:46:36 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:25.743 16:46:36 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:25.743 16:46:36 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:25.743 16:46:37 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:25.743 16:46:37 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:25.743 16:46:37 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:25.743 00:04:25.743 real 0m0.182s 00:04:25.743 user 0m0.159s 00:04:25.743 sys 0m0.015s 00:04:25.743 16:46:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:25.743 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:25.743 ************************************ 00:04:25.743 END TEST rpc_trace_cmd_test 00:04:25.743 ************************************ 00:04:25.743 16:46:37 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:25.743 16:46:37 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:25.743 16:46:37 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:25.743 16:46:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.743 16:46:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.743 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:25.743 ************************************ 00:04:25.743 START TEST rpc_daemon_integrity 00:04:25.743 ************************************ 00:04:25.743 16:46:37 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:25.743 16:46:37 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:25.743 16:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.743 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:25.743 16:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.743 16:46:37 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:25.743 16:46:37 -- rpc/rpc.sh@13 -- # jq length 00:04:25.743 16:46:37 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:25.743 16:46:37 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:25.743 16:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.743 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:25.743 16:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.743 16:46:37 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:25.743 16:46:37 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:25.743 16:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.743 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:25.743 16:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.743 16:46:37 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:25.743 { 00:04:25.743 "name": "Malloc2", 00:04:25.743 "aliases": [ 00:04:25.743 "3f4c1545-6ef9-45bb-b900-ef89e0908f68" 00:04:25.743 ], 00:04:25.743 "product_name": "Malloc disk", 00:04:25.743 "block_size": 512, 00:04:25.743 "num_blocks": 16384, 00:04:25.743 "uuid": "3f4c1545-6ef9-45bb-b900-ef89e0908f68", 00:04:25.743 "assigned_rate_limits": { 00:04:25.743 "rw_ios_per_sec": 0, 00:04:25.743 "rw_mbytes_per_sec": 0, 00:04:25.743 "r_mbytes_per_sec": 0, 00:04:25.743 "w_mbytes_per_sec": 0 00:04:25.743 }, 00:04:25.743 "claimed": false, 00:04:25.743 "zoned": false, 00:04:25.743 "supported_io_types": { 00:04:25.743 "read": true, 00:04:25.743 "write": true, 00:04:25.743 "unmap": true, 00:04:25.743 "write_zeroes": true, 00:04:25.743 "flush": true, 00:04:25.743 "reset": true, 00:04:25.743 "compare": false, 00:04:25.743 "compare_and_write": false, 00:04:25.743 "abort": true, 00:04:25.743 "nvme_admin": false, 00:04:25.743 "nvme_io": false 00:04:25.743 }, 00:04:25.743 "memory_domains": [ 00:04:25.743 { 00:04:25.743 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:25.743 "dma_device_type": 2 00:04:25.743 } 00:04:25.743 ], 00:04:25.743 "driver_specific": {} 00:04:25.743 } 00:04:25.743 ]' 00:04:25.743 16:46:37 -- rpc/rpc.sh@17 -- # jq length 00:04:26.002 16:46:37 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:26.002 16:46:37 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:26.002 16:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:26.002 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.002 [2024-11-29 16:46:37.179460] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:26.002 [2024-11-29 16:46:37.179509] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:26.002 [2024-11-29 16:46:37.179528] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x2381590 00:04:26.002 [2024-11-29 16:46:37.179540] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:26.002 [2024-11-29 16:46:37.180693] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:26.002 [2024-11-29 16:46:37.180714] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:26.002 Passthru0 00:04:26.002 16:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:26.002 16:46:37 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:26.002 16:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:26.002 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.002 16:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:26.002 16:46:37 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:26.002 { 00:04:26.002 "name": "Malloc2", 00:04:26.002 "aliases": [ 00:04:26.002 "3f4c1545-6ef9-45bb-b900-ef89e0908f68" 00:04:26.002 ], 00:04:26.002 "product_name": "Malloc disk", 00:04:26.002 "block_size": 512, 00:04:26.002 "num_blocks": 16384, 00:04:26.002 "uuid": "3f4c1545-6ef9-45bb-b900-ef89e0908f68", 00:04:26.002 "assigned_rate_limits": { 00:04:26.002 "rw_ios_per_sec": 0, 00:04:26.002 "rw_mbytes_per_sec": 0, 00:04:26.002 "r_mbytes_per_sec": 0, 00:04:26.002 "w_mbytes_per_sec": 0 00:04:26.002 }, 00:04:26.002 "claimed": true, 00:04:26.002 "claim_type": "exclusive_write", 00:04:26.002 "zoned": false, 00:04:26.002 "supported_io_types": { 00:04:26.002 "read": true, 00:04:26.002 "write": true, 00:04:26.002 "unmap": true, 00:04:26.002 "write_zeroes": true, 00:04:26.002 "flush": true, 00:04:26.002 "reset": true, 00:04:26.002 "compare": false, 00:04:26.002 "compare_and_write": false, 00:04:26.002 "abort": true, 00:04:26.002 "nvme_admin": false, 00:04:26.002 "nvme_io": false 00:04:26.002 }, 00:04:26.002 "memory_domains": [ 00:04:26.002 { 00:04:26.002 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:26.002 "dma_device_type": 2 00:04:26.002 } 00:04:26.002 ], 00:04:26.002 "driver_specific": {} 00:04:26.002 }, 00:04:26.002 { 00:04:26.002 "name": "Passthru0", 00:04:26.002 "aliases": [ 00:04:26.002 "96a1b816-77b2-554d-816d-c23fb2019af6" 00:04:26.002 ], 00:04:26.002 "product_name": "passthru", 00:04:26.002 "block_size": 512, 00:04:26.002 "num_blocks": 16384, 00:04:26.002 "uuid": "96a1b816-77b2-554d-816d-c23fb2019af6", 00:04:26.002 "assigned_rate_limits": { 00:04:26.002 "rw_ios_per_sec": 0, 00:04:26.002 "rw_mbytes_per_sec": 0, 00:04:26.002 "r_mbytes_per_sec": 0, 00:04:26.002 "w_mbytes_per_sec": 0 00:04:26.002 }, 00:04:26.002 "claimed": false, 00:04:26.002 "zoned": false, 00:04:26.002 "supported_io_types": { 00:04:26.002 "read": true, 00:04:26.002 "write": true, 00:04:26.002 "unmap": true, 00:04:26.002 "write_zeroes": true, 00:04:26.002 "flush": true, 00:04:26.002 "reset": true, 00:04:26.002 "compare": false, 00:04:26.002 "compare_and_write": false, 00:04:26.002 "abort": true, 00:04:26.002 "nvme_admin": false, 00:04:26.002 "nvme_io": false 00:04:26.002 }, 00:04:26.002 "memory_domains": [ 00:04:26.002 { 00:04:26.002 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:26.002 "dma_device_type": 2 00:04:26.002 } 00:04:26.002 ], 00:04:26.002 "driver_specific": { 00:04:26.002 "passthru": { 00:04:26.002 "name": "Passthru0", 00:04:26.002 "base_bdev_name": "Malloc2" 00:04:26.002 } 00:04:26.002 } 00:04:26.002 } 00:04:26.002 ]' 00:04:26.002 16:46:37 -- rpc/rpc.sh@21 -- # jq length 00:04:26.002 16:46:37 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:26.002 16:46:37 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:26.002 16:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:26.002 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.002 16:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:26.002 16:46:37 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:26.002 16:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:26.002 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.003 16:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:26.003 16:46:37 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:26.003 16:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:26.003 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.003 16:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:26.003 16:46:37 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:26.003 16:46:37 -- rpc/rpc.sh@26 -- # jq length 00:04:26.003 16:46:37 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:26.003 00:04:26.003 real 0m0.205s 00:04:26.003 user 0m0.132s 00:04:26.003 sys 0m0.021s 00:04:26.003 16:46:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:26.003 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.003 ************************************ 00:04:26.003 END TEST rpc_daemon_integrity 00:04:26.003 ************************************ 00:04:26.003 16:46:37 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:26.003 16:46:37 -- rpc/rpc.sh@84 -- # killprocess 80069 00:04:26.003 16:46:37 -- common/autotest_common.sh@936 -- # '[' -z 80069 ']' 00:04:26.003 16:46:37 -- common/autotest_common.sh@940 -- # kill -0 80069 00:04:26.003 16:46:37 -- common/autotest_common.sh@941 -- # uname 00:04:26.003 16:46:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:26.003 16:46:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 80069 00:04:26.003 16:46:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:26.003 16:46:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:26.003 16:46:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 80069' 00:04:26.003 killing process with pid 80069 00:04:26.003 16:46:37 -- common/autotest_common.sh@955 -- # kill 80069 00:04:26.003 16:46:37 -- common/autotest_common.sh@960 -- # wait 80069 00:04:26.569 00:04:26.569 real 0m2.404s 00:04:26.569 user 0m3.038s 00:04:26.569 sys 0m0.551s 00:04:26.569 16:46:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:26.569 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.569 ************************************ 00:04:26.569 END TEST rpc 00:04:26.569 ************************************ 00:04:26.569 16:46:37 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:26.569 16:46:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:26.569 16:46:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:26.569 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.569 ************************************ 00:04:26.569 START TEST rpc_client 00:04:26.569 ************************************ 00:04:26.569 16:46:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:26.569 * Looking for test storage... 00:04:26.569 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:26.569 16:46:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:26.569 16:46:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:26.569 16:46:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:26.569 16:46:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:26.569 16:46:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:26.569 16:46:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:26.569 16:46:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:26.569 16:46:37 -- scripts/common.sh@335 -- # IFS=.-: 00:04:26.569 16:46:37 -- scripts/common.sh@335 -- # read -ra ver1 00:04:26.569 16:46:37 -- scripts/common.sh@336 -- # IFS=.-: 00:04:26.569 16:46:37 -- scripts/common.sh@336 -- # read -ra ver2 00:04:26.569 16:46:37 -- scripts/common.sh@337 -- # local 'op=<' 00:04:26.569 16:46:37 -- scripts/common.sh@339 -- # ver1_l=2 00:04:26.569 16:46:37 -- scripts/common.sh@340 -- # ver2_l=1 00:04:26.569 16:46:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:26.569 16:46:37 -- scripts/common.sh@343 -- # case "$op" in 00:04:26.569 16:46:37 -- scripts/common.sh@344 -- # : 1 00:04:26.569 16:46:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:26.569 16:46:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:26.569 16:46:37 -- scripts/common.sh@364 -- # decimal 1 00:04:26.569 16:46:37 -- scripts/common.sh@352 -- # local d=1 00:04:26.569 16:46:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:26.569 16:46:37 -- scripts/common.sh@354 -- # echo 1 00:04:26.569 16:46:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:26.569 16:46:37 -- scripts/common.sh@365 -- # decimal 2 00:04:26.569 16:46:37 -- scripts/common.sh@352 -- # local d=2 00:04:26.569 16:46:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:26.569 16:46:37 -- scripts/common.sh@354 -- # echo 2 00:04:26.569 16:46:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:26.569 16:46:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:26.569 16:46:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:26.569 16:46:37 -- scripts/common.sh@367 -- # return 0 00:04:26.569 16:46:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:26.569 16:46:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:26.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.569 --rc genhtml_branch_coverage=1 00:04:26.569 --rc genhtml_function_coverage=1 00:04:26.569 --rc genhtml_legend=1 00:04:26.569 --rc geninfo_all_blocks=1 00:04:26.569 --rc geninfo_unexecuted_blocks=1 00:04:26.569 00:04:26.569 ' 00:04:26.569 16:46:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:26.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.569 --rc genhtml_branch_coverage=1 00:04:26.569 --rc genhtml_function_coverage=1 00:04:26.569 --rc genhtml_legend=1 00:04:26.569 --rc geninfo_all_blocks=1 00:04:26.569 --rc geninfo_unexecuted_blocks=1 00:04:26.569 00:04:26.569 ' 00:04:26.569 16:46:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:26.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.569 --rc genhtml_branch_coverage=1 00:04:26.569 --rc genhtml_function_coverage=1 00:04:26.569 --rc genhtml_legend=1 00:04:26.569 --rc geninfo_all_blocks=1 00:04:26.569 --rc geninfo_unexecuted_blocks=1 00:04:26.569 00:04:26.569 ' 00:04:26.569 16:46:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:26.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.569 --rc genhtml_branch_coverage=1 00:04:26.569 --rc genhtml_function_coverage=1 00:04:26.569 --rc genhtml_legend=1 00:04:26.569 --rc geninfo_all_blocks=1 00:04:26.569 --rc geninfo_unexecuted_blocks=1 00:04:26.569 00:04:26.569 ' 00:04:26.569 16:46:37 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:26.569 OK 00:04:26.569 16:46:37 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:26.569 00:04:26.569 real 0m0.160s 00:04:26.569 user 0m0.105s 00:04:26.569 sys 0m0.064s 00:04:26.569 16:46:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:26.569 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.569 ************************************ 00:04:26.569 END TEST rpc_client 00:04:26.569 ************************************ 00:04:26.569 16:46:37 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:26.569 16:46:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:26.569 16:46:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:26.569 16:46:37 -- common/autotest_common.sh@10 -- # set +x 00:04:26.569 ************************************ 00:04:26.569 START TEST json_config 00:04:26.569 ************************************ 00:04:26.569 16:46:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:26.828 16:46:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:26.828 16:46:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:26.828 16:46:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:26.828 16:46:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:26.828 16:46:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:26.828 16:46:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:26.828 16:46:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:26.828 16:46:38 -- scripts/common.sh@335 -- # IFS=.-: 00:04:26.828 16:46:38 -- scripts/common.sh@335 -- # read -ra ver1 00:04:26.828 16:46:38 -- scripts/common.sh@336 -- # IFS=.-: 00:04:26.828 16:46:38 -- scripts/common.sh@336 -- # read -ra ver2 00:04:26.828 16:46:38 -- scripts/common.sh@337 -- # local 'op=<' 00:04:26.828 16:46:38 -- scripts/common.sh@339 -- # ver1_l=2 00:04:26.828 16:46:38 -- scripts/common.sh@340 -- # ver2_l=1 00:04:26.828 16:46:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:26.828 16:46:38 -- scripts/common.sh@343 -- # case "$op" in 00:04:26.828 16:46:38 -- scripts/common.sh@344 -- # : 1 00:04:26.828 16:46:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:26.828 16:46:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:26.828 16:46:38 -- scripts/common.sh@364 -- # decimal 1 00:04:26.828 16:46:38 -- scripts/common.sh@352 -- # local d=1 00:04:26.828 16:46:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:26.828 16:46:38 -- scripts/common.sh@354 -- # echo 1 00:04:26.828 16:46:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:26.828 16:46:38 -- scripts/common.sh@365 -- # decimal 2 00:04:26.828 16:46:38 -- scripts/common.sh@352 -- # local d=2 00:04:26.828 16:46:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:26.828 16:46:38 -- scripts/common.sh@354 -- # echo 2 00:04:26.828 16:46:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:26.828 16:46:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:26.828 16:46:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:26.828 16:46:38 -- scripts/common.sh@367 -- # return 0 00:04:26.828 16:46:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:26.828 16:46:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:26.828 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.828 --rc genhtml_branch_coverage=1 00:04:26.828 --rc genhtml_function_coverage=1 00:04:26.828 --rc genhtml_legend=1 00:04:26.828 --rc geninfo_all_blocks=1 00:04:26.828 --rc geninfo_unexecuted_blocks=1 00:04:26.828 00:04:26.828 ' 00:04:26.828 16:46:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:26.828 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.828 --rc genhtml_branch_coverage=1 00:04:26.828 --rc genhtml_function_coverage=1 00:04:26.828 --rc genhtml_legend=1 00:04:26.828 --rc geninfo_all_blocks=1 00:04:26.828 --rc geninfo_unexecuted_blocks=1 00:04:26.828 00:04:26.828 ' 00:04:26.828 16:46:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:26.828 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.828 --rc genhtml_branch_coverage=1 00:04:26.828 --rc genhtml_function_coverage=1 00:04:26.828 --rc genhtml_legend=1 00:04:26.828 --rc geninfo_all_blocks=1 00:04:26.828 --rc geninfo_unexecuted_blocks=1 00:04:26.828 00:04:26.828 ' 00:04:26.828 16:46:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:26.828 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.828 --rc genhtml_branch_coverage=1 00:04:26.828 --rc genhtml_function_coverage=1 00:04:26.828 --rc genhtml_legend=1 00:04:26.828 --rc geninfo_all_blocks=1 00:04:26.828 --rc geninfo_unexecuted_blocks=1 00:04:26.828 00:04:26.828 ' 00:04:26.829 16:46:38 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:26.829 16:46:38 -- nvmf/common.sh@7 -- # uname -s 00:04:26.829 16:46:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:26.829 16:46:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:26.829 16:46:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:26.829 16:46:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:26.829 16:46:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:26.829 16:46:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:26.829 16:46:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:26.829 16:46:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:26.829 16:46:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:26.829 16:46:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:26.829 16:46:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:26.829 16:46:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:26.829 16:46:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:26.829 16:46:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:26.829 16:46:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:26.829 16:46:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:26.829 16:46:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:26.829 16:46:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:26.829 16:46:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:26.829 16:46:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:26.829 16:46:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:26.829 16:46:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:26.829 16:46:38 -- paths/export.sh@5 -- # export PATH 00:04:26.829 16:46:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:26.829 16:46:38 -- nvmf/common.sh@46 -- # : 0 00:04:26.829 16:46:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:26.829 16:46:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:26.829 16:46:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:26.829 16:46:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:26.829 16:46:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:26.829 16:46:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:26.829 16:46:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:26.829 16:46:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:26.829 16:46:38 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:26.829 16:46:38 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:26.829 16:46:38 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:26.829 16:46:38 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:26.829 16:46:38 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:26.829 16:46:38 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:26.829 16:46:38 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:26.829 16:46:38 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:26.829 16:46:38 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:26.829 16:46:38 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:26.829 16:46:38 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:26.829 16:46:38 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:26.829 16:46:38 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:26.829 16:46:38 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:26.829 16:46:38 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:26.829 INFO: JSON configuration test init 00:04:26.829 16:46:38 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:26.829 16:46:38 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:26.829 16:46:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:26.829 16:46:38 -- common/autotest_common.sh@10 -- # set +x 00:04:26.829 16:46:38 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:26.829 16:46:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:26.829 16:46:38 -- common/autotest_common.sh@10 -- # set +x 00:04:26.829 16:46:38 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:26.829 16:46:38 -- json_config/json_config.sh@98 -- # local app=target 00:04:26.829 16:46:38 -- json_config/json_config.sh@99 -- # shift 00:04:26.829 16:46:38 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:26.829 16:46:38 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:26.829 16:46:38 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:26.829 16:46:38 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:26.829 16:46:38 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:26.829 16:46:38 -- json_config/json_config.sh@111 -- # app_pid[$app]=80566 00:04:26.829 16:46:38 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:26.829 16:46:38 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:26.829 Waiting for target to run... 00:04:26.829 16:46:38 -- json_config/json_config.sh@114 -- # waitforlisten 80566 /var/tmp/spdk_tgt.sock 00:04:26.829 16:46:38 -- common/autotest_common.sh@829 -- # '[' -z 80566 ']' 00:04:26.829 16:46:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:26.829 16:46:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:26.829 16:46:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:26.829 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:26.829 16:46:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:26.829 16:46:38 -- common/autotest_common.sh@10 -- # set +x 00:04:26.829 [2024-11-29 16:46:38.180075] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:26.829 [2024-11-29 16:46:38.180169] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid80566 ] 00:04:26.829 EAL: No free 2048 kB hugepages reported on node 1 00:04:27.088 [2024-11-29 16:46:38.517061] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:27.346 [2024-11-29 16:46:38.594030] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:27.346 [2024-11-29 16:46:38.594213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:27.912 16:46:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:27.912 16:46:39 -- common/autotest_common.sh@862 -- # return 0 00:04:27.912 16:46:39 -- json_config/json_config.sh@115 -- # echo '' 00:04:27.912 00:04:27.912 16:46:39 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:27.912 16:46:39 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:27.912 16:46:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:27.912 16:46:39 -- common/autotest_common.sh@10 -- # set +x 00:04:27.912 16:46:39 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:27.912 16:46:39 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:27.912 16:46:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:27.912 16:46:39 -- common/autotest_common.sh@10 -- # set +x 00:04:27.912 16:46:39 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:27.912 16:46:39 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:27.912 16:46:39 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:31.224 16:46:42 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:31.224 16:46:42 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:31.224 16:46:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:31.224 16:46:42 -- common/autotest_common.sh@10 -- # set +x 00:04:31.224 16:46:42 -- json_config/json_config.sh@48 -- # local ret=0 00:04:31.224 16:46:42 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:31.224 16:46:42 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:31.224 16:46:42 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:31.224 16:46:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:31.224 16:46:42 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:31.224 16:46:42 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:31.224 16:46:42 -- json_config/json_config.sh@51 -- # local get_types 00:04:31.224 16:46:42 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:31.224 16:46:42 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:31.224 16:46:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:31.224 16:46:42 -- common/autotest_common.sh@10 -- # set +x 00:04:31.224 16:46:42 -- json_config/json_config.sh@58 -- # return 0 00:04:31.224 16:46:42 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:31.224 16:46:42 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:31.224 16:46:42 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:31.224 16:46:42 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:31.224 16:46:42 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:31.224 16:46:42 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:31.224 16:46:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:31.224 16:46:42 -- common/autotest_common.sh@10 -- # set +x 00:04:31.224 16:46:42 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:31.224 16:46:42 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:31.224 16:46:42 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:31.224 16:46:42 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:31.224 16:46:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:31.482 MallocForNvmf0 00:04:31.482 16:46:42 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:31.482 16:46:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:31.740 MallocForNvmf1 00:04:31.740 16:46:43 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:31.740 16:46:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:31.999 [2024-11-29 16:46:43.326760] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:31.999 16:46:43 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:31.999 16:46:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:32.257 16:46:43 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:32.257 16:46:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:32.515 16:46:43 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:32.515 16:46:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:32.773 16:46:44 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:32.773 16:46:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:33.031 [2024-11-29 16:46:44.301983] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:33.031 16:46:44 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:33.031 16:46:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:33.031 16:46:44 -- common/autotest_common.sh@10 -- # set +x 00:04:33.031 16:46:44 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:33.031 16:46:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:33.031 16:46:44 -- common/autotest_common.sh@10 -- # set +x 00:04:33.031 16:46:44 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:33.031 16:46:44 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:33.031 16:46:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:33.290 MallocBdevForConfigChangeCheck 00:04:33.290 16:46:44 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:33.290 16:46:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:33.290 16:46:44 -- common/autotest_common.sh@10 -- # set +x 00:04:33.290 16:46:44 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:33.290 16:46:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:33.855 16:46:44 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:33.855 INFO: shutting down applications... 00:04:33.855 16:46:44 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:33.855 16:46:44 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:33.855 16:46:44 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:33.855 16:46:44 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:35.227 Calling clear_iscsi_subsystem 00:04:35.227 Calling clear_nvmf_subsystem 00:04:35.227 Calling clear_nbd_subsystem 00:04:35.227 Calling clear_ublk_subsystem 00:04:35.227 Calling clear_vhost_blk_subsystem 00:04:35.227 Calling clear_vhost_scsi_subsystem 00:04:35.227 Calling clear_scheduler_subsystem 00:04:35.227 Calling clear_bdev_subsystem 00:04:35.227 Calling clear_accel_subsystem 00:04:35.227 Calling clear_vmd_subsystem 00:04:35.227 Calling clear_sock_subsystem 00:04:35.227 Calling clear_iobuf_subsystem 00:04:35.227 16:46:46 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:35.227 16:46:46 -- json_config/json_config.sh@396 -- # count=100 00:04:35.227 16:46:46 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:35.227 16:46:46 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:35.227 16:46:46 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:35.227 16:46:46 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:35.795 16:46:47 -- json_config/json_config.sh@398 -- # break 00:04:35.795 16:46:47 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:35.795 16:46:47 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:35.795 16:46:47 -- json_config/json_config.sh@120 -- # local app=target 00:04:35.795 16:46:47 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:35.795 16:46:47 -- json_config/json_config.sh@124 -- # [[ -n 80566 ]] 00:04:35.795 16:46:47 -- json_config/json_config.sh@127 -- # kill -SIGINT 80566 00:04:35.795 16:46:47 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:35.795 16:46:47 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:35.795 16:46:47 -- json_config/json_config.sh@130 -- # kill -0 80566 00:04:35.795 16:46:47 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:36.367 16:46:47 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:36.367 16:46:47 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:36.367 16:46:47 -- json_config/json_config.sh@130 -- # kill -0 80566 00:04:36.367 16:46:47 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:36.367 16:46:47 -- json_config/json_config.sh@132 -- # break 00:04:36.367 16:46:47 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:36.367 16:46:47 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:36.367 SPDK target shutdown done 00:04:36.367 16:46:47 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:36.367 INFO: relaunching applications... 00:04:36.367 16:46:47 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:36.367 16:46:47 -- json_config/json_config.sh@98 -- # local app=target 00:04:36.367 16:46:47 -- json_config/json_config.sh@99 -- # shift 00:04:36.367 16:46:47 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:36.367 16:46:47 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:36.367 16:46:47 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:36.367 16:46:47 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:36.367 16:46:47 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:36.367 16:46:47 -- json_config/json_config.sh@111 -- # app_pid[$app]=81910 00:04:36.367 16:46:47 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:36.367 16:46:47 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:36.367 Waiting for target to run... 00:04:36.367 16:46:47 -- json_config/json_config.sh@114 -- # waitforlisten 81910 /var/tmp/spdk_tgt.sock 00:04:36.367 16:46:47 -- common/autotest_common.sh@829 -- # '[' -z 81910 ']' 00:04:36.367 16:46:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:36.367 16:46:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:36.367 16:46:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:36.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:36.367 16:46:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:36.367 16:46:47 -- common/autotest_common.sh@10 -- # set +x 00:04:36.367 [2024-11-29 16:46:47.557910] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:36.367 [2024-11-29 16:46:47.558025] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid81910 ] 00:04:36.367 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.626 [2024-11-29 16:46:47.912458] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:36.626 [2024-11-29 16:46:47.997453] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:36.626 [2024-11-29 16:46:47.997611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.912 [2024-11-29 16:46:51.016523] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:39.912 [2024-11-29 16:46:51.049032] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:40.170 16:46:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:40.170 16:46:51 -- common/autotest_common.sh@862 -- # return 0 00:04:40.170 16:46:51 -- json_config/json_config.sh@115 -- # echo '' 00:04:40.170 00:04:40.170 16:46:51 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:40.170 16:46:51 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:40.170 INFO: Checking if target configuration is the same... 00:04:40.170 16:46:51 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:40.170 16:46:51 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:40.170 16:46:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:40.170 + '[' 2 -ne 2 ']' 00:04:40.170 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:40.170 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:40.170 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:40.170 +++ basename /dev/fd/62 00:04:40.170 ++ mktemp /tmp/62.XXX 00:04:40.170 + tmp_file_1=/tmp/62.usV 00:04:40.170 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:40.170 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:40.170 + tmp_file_2=/tmp/spdk_tgt_config.json.nmN 00:04:40.170 + ret=0 00:04:40.170 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:40.736 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:40.736 + diff -u /tmp/62.usV /tmp/spdk_tgt_config.json.nmN 00:04:40.736 + echo 'INFO: JSON config files are the same' 00:04:40.736 INFO: JSON config files are the same 00:04:40.736 + rm /tmp/62.usV /tmp/spdk_tgt_config.json.nmN 00:04:40.736 + exit 0 00:04:40.736 16:46:51 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:40.736 16:46:51 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:40.736 INFO: changing configuration and checking if this can be detected... 00:04:40.736 16:46:51 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:40.736 16:46:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:40.995 16:46:52 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:40.995 16:46:52 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:40.995 16:46:52 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:40.995 + '[' 2 -ne 2 ']' 00:04:40.995 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:40.995 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:40.995 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:40.995 +++ basename /dev/fd/62 00:04:40.995 ++ mktemp /tmp/62.XXX 00:04:40.995 + tmp_file_1=/tmp/62.ydT 00:04:40.995 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:40.995 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:40.995 + tmp_file_2=/tmp/spdk_tgt_config.json.HdS 00:04:40.995 + ret=0 00:04:40.995 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:41.253 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:41.253 + diff -u /tmp/62.ydT /tmp/spdk_tgt_config.json.HdS 00:04:41.253 + ret=1 00:04:41.253 + echo '=== Start of file: /tmp/62.ydT ===' 00:04:41.253 + cat /tmp/62.ydT 00:04:41.253 + echo '=== End of file: /tmp/62.ydT ===' 00:04:41.253 + echo '' 00:04:41.253 + echo '=== Start of file: /tmp/spdk_tgt_config.json.HdS ===' 00:04:41.253 + cat /tmp/spdk_tgt_config.json.HdS 00:04:41.253 + echo '=== End of file: /tmp/spdk_tgt_config.json.HdS ===' 00:04:41.253 + echo '' 00:04:41.253 + rm /tmp/62.ydT /tmp/spdk_tgt_config.json.HdS 00:04:41.253 + exit 1 00:04:41.253 16:46:52 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:41.253 INFO: configuration change detected. 00:04:41.253 16:46:52 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:41.253 16:46:52 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:41.253 16:46:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:41.253 16:46:52 -- common/autotest_common.sh@10 -- # set +x 00:04:41.253 16:46:52 -- json_config/json_config.sh@360 -- # local ret=0 00:04:41.253 16:46:52 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:41.253 16:46:52 -- json_config/json_config.sh@370 -- # [[ -n 81910 ]] 00:04:41.253 16:46:52 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:41.253 16:46:52 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:41.253 16:46:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:41.253 16:46:52 -- common/autotest_common.sh@10 -- # set +x 00:04:41.253 16:46:52 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:41.253 16:46:52 -- json_config/json_config.sh@246 -- # uname -s 00:04:41.253 16:46:52 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:41.253 16:46:52 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:41.253 16:46:52 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:41.253 16:46:52 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:41.253 16:46:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:41.253 16:46:52 -- common/autotest_common.sh@10 -- # set +x 00:04:41.253 16:46:52 -- json_config/json_config.sh@376 -- # killprocess 81910 00:04:41.253 16:46:52 -- common/autotest_common.sh@936 -- # '[' -z 81910 ']' 00:04:41.254 16:46:52 -- common/autotest_common.sh@940 -- # kill -0 81910 00:04:41.254 16:46:52 -- common/autotest_common.sh@941 -- # uname 00:04:41.254 16:46:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:41.254 16:46:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 81910 00:04:41.512 16:46:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:41.512 16:46:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:41.512 16:46:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 81910' 00:04:41.512 killing process with pid 81910 00:04:41.512 16:46:52 -- common/autotest_common.sh@955 -- # kill 81910 00:04:41.512 16:46:52 -- common/autotest_common.sh@960 -- # wait 81910 00:04:42.887 16:46:54 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:42.887 16:46:54 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:42.887 16:46:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:42.887 16:46:54 -- common/autotest_common.sh@10 -- # set +x 00:04:42.887 16:46:54 -- json_config/json_config.sh@381 -- # return 0 00:04:42.887 16:46:54 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:42.887 INFO: Success 00:04:42.887 00:04:42.887 real 0m16.326s 00:04:42.887 user 0m19.005s 00:04:42.887 sys 0m1.900s 00:04:43.146 16:46:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.146 16:46:54 -- common/autotest_common.sh@10 -- # set +x 00:04:43.146 ************************************ 00:04:43.146 END TEST json_config 00:04:43.146 ************************************ 00:04:43.146 16:46:54 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:43.146 16:46:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.146 16:46:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.146 16:46:54 -- common/autotest_common.sh@10 -- # set +x 00:04:43.146 ************************************ 00:04:43.146 START TEST json_config_extra_key 00:04:43.146 ************************************ 00:04:43.146 16:46:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:43.146 16:46:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:43.146 16:46:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:43.146 16:46:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:43.146 16:46:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:43.146 16:46:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:43.146 16:46:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:43.146 16:46:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:43.146 16:46:54 -- scripts/common.sh@335 -- # IFS=.-: 00:04:43.146 16:46:54 -- scripts/common.sh@335 -- # read -ra ver1 00:04:43.146 16:46:54 -- scripts/common.sh@336 -- # IFS=.-: 00:04:43.146 16:46:54 -- scripts/common.sh@336 -- # read -ra ver2 00:04:43.146 16:46:54 -- scripts/common.sh@337 -- # local 'op=<' 00:04:43.146 16:46:54 -- scripts/common.sh@339 -- # ver1_l=2 00:04:43.146 16:46:54 -- scripts/common.sh@340 -- # ver2_l=1 00:04:43.146 16:46:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:43.146 16:46:54 -- scripts/common.sh@343 -- # case "$op" in 00:04:43.146 16:46:54 -- scripts/common.sh@344 -- # : 1 00:04:43.146 16:46:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:43.146 16:46:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:43.146 16:46:54 -- scripts/common.sh@364 -- # decimal 1 00:04:43.146 16:46:54 -- scripts/common.sh@352 -- # local d=1 00:04:43.146 16:46:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:43.146 16:46:54 -- scripts/common.sh@354 -- # echo 1 00:04:43.146 16:46:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:43.146 16:46:54 -- scripts/common.sh@365 -- # decimal 2 00:04:43.146 16:46:54 -- scripts/common.sh@352 -- # local d=2 00:04:43.146 16:46:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:43.146 16:46:54 -- scripts/common.sh@354 -- # echo 2 00:04:43.146 16:46:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:43.146 16:46:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:43.146 16:46:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:43.146 16:46:54 -- scripts/common.sh@367 -- # return 0 00:04:43.146 16:46:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:43.146 16:46:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:43.146 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.146 --rc genhtml_branch_coverage=1 00:04:43.146 --rc genhtml_function_coverage=1 00:04:43.146 --rc genhtml_legend=1 00:04:43.146 --rc geninfo_all_blocks=1 00:04:43.146 --rc geninfo_unexecuted_blocks=1 00:04:43.146 00:04:43.146 ' 00:04:43.146 16:46:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:43.146 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.146 --rc genhtml_branch_coverage=1 00:04:43.146 --rc genhtml_function_coverage=1 00:04:43.146 --rc genhtml_legend=1 00:04:43.146 --rc geninfo_all_blocks=1 00:04:43.146 --rc geninfo_unexecuted_blocks=1 00:04:43.146 00:04:43.146 ' 00:04:43.146 16:46:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:43.146 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.146 --rc genhtml_branch_coverage=1 00:04:43.146 --rc genhtml_function_coverage=1 00:04:43.146 --rc genhtml_legend=1 00:04:43.146 --rc geninfo_all_blocks=1 00:04:43.146 --rc geninfo_unexecuted_blocks=1 00:04:43.146 00:04:43.146 ' 00:04:43.146 16:46:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:43.146 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.146 --rc genhtml_branch_coverage=1 00:04:43.146 --rc genhtml_function_coverage=1 00:04:43.146 --rc genhtml_legend=1 00:04:43.146 --rc geninfo_all_blocks=1 00:04:43.146 --rc geninfo_unexecuted_blocks=1 00:04:43.146 00:04:43.146 ' 00:04:43.146 16:46:54 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:43.146 16:46:54 -- nvmf/common.sh@7 -- # uname -s 00:04:43.146 16:46:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:43.146 16:46:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:43.146 16:46:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:43.146 16:46:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:43.146 16:46:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:43.146 16:46:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:43.146 16:46:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:43.146 16:46:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:43.146 16:46:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:43.146 16:46:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:43.146 16:46:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:43.146 16:46:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:43.146 16:46:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:43.146 16:46:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:43.146 16:46:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:43.146 16:46:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:43.146 16:46:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:43.146 16:46:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:43.146 16:46:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:43.146 16:46:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.146 16:46:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.146 16:46:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.146 16:46:54 -- paths/export.sh@5 -- # export PATH 00:04:43.146 16:46:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.146 16:46:54 -- nvmf/common.sh@46 -- # : 0 00:04:43.146 16:46:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:43.146 16:46:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:43.146 16:46:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:43.146 16:46:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:43.146 16:46:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:43.146 16:46:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:43.146 16:46:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:43.146 16:46:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:43.147 INFO: launching applications... 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=82852 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:43.147 Waiting for target to run... 00:04:43.147 16:46:54 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 82852 /var/tmp/spdk_tgt.sock 00:04:43.147 16:46:54 -- common/autotest_common.sh@829 -- # '[' -z 82852 ']' 00:04:43.147 16:46:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:43.147 16:46:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:43.147 16:46:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:43.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:43.147 16:46:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:43.147 16:46:54 -- common/autotest_common.sh@10 -- # set +x 00:04:43.147 [2024-11-29 16:46:54.521697] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.147 [2024-11-29 16:46:54.521772] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid82852 ] 00:04:43.147 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.714 [2024-11-29 16:46:55.024214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:43.714 [2024-11-29 16:46:55.114260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:43.714 [2024-11-29 16:46:55.114456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.280 16:46:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:44.280 16:46:55 -- common/autotest_common.sh@862 -- # return 0 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:44.280 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:44.280 INFO: shutting down applications... 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 82852 ]] 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 82852 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@50 -- # kill -0 82852 00:04:44.280 16:46:55 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:44.850 16:46:55 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:44.850 16:46:55 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:44.850 16:46:55 -- json_config/json_config_extra_key.sh@50 -- # kill -0 82852 00:04:44.850 16:46:55 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:44.850 16:46:55 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:44.850 16:46:55 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:44.850 16:46:55 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:44.850 SPDK target shutdown done 00:04:44.850 16:46:55 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:44.850 Success 00:04:44.850 00:04:44.850 real 0m1.645s 00:04:44.850 user 0m1.476s 00:04:44.850 sys 0m0.614s 00:04:44.850 16:46:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:44.850 16:46:55 -- common/autotest_common.sh@10 -- # set +x 00:04:44.850 ************************************ 00:04:44.850 END TEST json_config_extra_key 00:04:44.850 ************************************ 00:04:44.850 16:46:56 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:44.850 16:46:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.850 16:46:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.850 16:46:56 -- common/autotest_common.sh@10 -- # set +x 00:04:44.850 ************************************ 00:04:44.850 START TEST alias_rpc 00:04:44.850 ************************************ 00:04:44.850 16:46:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:44.850 * Looking for test storage... 00:04:44.850 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:44.850 16:46:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:44.850 16:46:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:44.850 16:46:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:44.850 16:46:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:44.850 16:46:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:44.850 16:46:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:44.850 16:46:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:44.850 16:46:56 -- scripts/common.sh@335 -- # IFS=.-: 00:04:44.850 16:46:56 -- scripts/common.sh@335 -- # read -ra ver1 00:04:44.850 16:46:56 -- scripts/common.sh@336 -- # IFS=.-: 00:04:44.850 16:46:56 -- scripts/common.sh@336 -- # read -ra ver2 00:04:44.850 16:46:56 -- scripts/common.sh@337 -- # local 'op=<' 00:04:44.850 16:46:56 -- scripts/common.sh@339 -- # ver1_l=2 00:04:44.850 16:46:56 -- scripts/common.sh@340 -- # ver2_l=1 00:04:44.850 16:46:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:44.850 16:46:56 -- scripts/common.sh@343 -- # case "$op" in 00:04:44.850 16:46:56 -- scripts/common.sh@344 -- # : 1 00:04:44.850 16:46:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:44.850 16:46:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:44.850 16:46:56 -- scripts/common.sh@364 -- # decimal 1 00:04:44.850 16:46:56 -- scripts/common.sh@352 -- # local d=1 00:04:44.850 16:46:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:44.850 16:46:56 -- scripts/common.sh@354 -- # echo 1 00:04:44.850 16:46:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:44.850 16:46:56 -- scripts/common.sh@365 -- # decimal 2 00:04:44.850 16:46:56 -- scripts/common.sh@352 -- # local d=2 00:04:44.850 16:46:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:44.850 16:46:56 -- scripts/common.sh@354 -- # echo 2 00:04:44.850 16:46:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:44.850 16:46:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:44.850 16:46:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:44.850 16:46:56 -- scripts/common.sh@367 -- # return 0 00:04:44.850 16:46:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:44.850 16:46:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:44.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.850 --rc genhtml_branch_coverage=1 00:04:44.850 --rc genhtml_function_coverage=1 00:04:44.850 --rc genhtml_legend=1 00:04:44.850 --rc geninfo_all_blocks=1 00:04:44.850 --rc geninfo_unexecuted_blocks=1 00:04:44.850 00:04:44.850 ' 00:04:44.850 16:46:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:44.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.850 --rc genhtml_branch_coverage=1 00:04:44.850 --rc genhtml_function_coverage=1 00:04:44.850 --rc genhtml_legend=1 00:04:44.850 --rc geninfo_all_blocks=1 00:04:44.850 --rc geninfo_unexecuted_blocks=1 00:04:44.850 00:04:44.850 ' 00:04:44.850 16:46:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:44.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.850 --rc genhtml_branch_coverage=1 00:04:44.850 --rc genhtml_function_coverage=1 00:04:44.850 --rc genhtml_legend=1 00:04:44.850 --rc geninfo_all_blocks=1 00:04:44.850 --rc geninfo_unexecuted_blocks=1 00:04:44.850 00:04:44.850 ' 00:04:44.850 16:46:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:44.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.850 --rc genhtml_branch_coverage=1 00:04:44.850 --rc genhtml_function_coverage=1 00:04:44.850 --rc genhtml_legend=1 00:04:44.850 --rc geninfo_all_blocks=1 00:04:44.850 --rc geninfo_unexecuted_blocks=1 00:04:44.850 00:04:44.850 ' 00:04:44.850 16:46:56 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:44.850 16:46:56 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=83060 00:04:44.850 16:46:56 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:44.850 16:46:56 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 83060 00:04:44.851 16:46:56 -- common/autotest_common.sh@829 -- # '[' -z 83060 ']' 00:04:44.851 16:46:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:44.851 16:46:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:44.851 16:46:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:44.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:44.851 16:46:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:44.851 16:46:56 -- common/autotest_common.sh@10 -- # set +x 00:04:44.851 [2024-11-29 16:46:56.201878] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:44.851 [2024-11-29 16:46:56.201980] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83060 ] 00:04:44.851 EAL: No free 2048 kB hugepages reported on node 1 00:04:44.851 [2024-11-29 16:46:56.258419] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:45.110 [2024-11-29 16:46:56.365830] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:45.110 [2024-11-29 16:46:56.366017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.046 16:46:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:46.046 16:46:57 -- common/autotest_common.sh@862 -- # return 0 00:04:46.046 16:46:57 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:46.046 16:46:57 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 83060 00:04:46.046 16:46:57 -- common/autotest_common.sh@936 -- # '[' -z 83060 ']' 00:04:46.046 16:46:57 -- common/autotest_common.sh@940 -- # kill -0 83060 00:04:46.046 16:46:57 -- common/autotest_common.sh@941 -- # uname 00:04:46.046 16:46:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:46.046 16:46:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 83060 00:04:46.046 16:46:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:46.046 16:46:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:46.046 16:46:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 83060' 00:04:46.046 killing process with pid 83060 00:04:46.046 16:46:57 -- common/autotest_common.sh@955 -- # kill 83060 00:04:46.046 16:46:57 -- common/autotest_common.sh@960 -- # wait 83060 00:04:46.613 00:04:46.613 real 0m1.887s 00:04:46.613 user 0m2.200s 00:04:46.613 sys 0m0.452s 00:04:46.613 16:46:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.613 16:46:57 -- common/autotest_common.sh@10 -- # set +x 00:04:46.613 ************************************ 00:04:46.613 END TEST alias_rpc 00:04:46.613 ************************************ 00:04:46.613 16:46:57 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:46.613 16:46:57 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:46.613 16:46:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.613 16:46:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.613 16:46:57 -- common/autotest_common.sh@10 -- # set +x 00:04:46.613 ************************************ 00:04:46.613 START TEST spdkcli_tcp 00:04:46.613 ************************************ 00:04:46.613 16:46:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:46.613 * Looking for test storage... 00:04:46.613 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:46.613 16:46:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:46.613 16:46:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:46.613 16:46:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:46.873 16:46:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:46.873 16:46:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:46.873 16:46:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:46.873 16:46:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:46.873 16:46:58 -- scripts/common.sh@335 -- # IFS=.-: 00:04:46.873 16:46:58 -- scripts/common.sh@335 -- # read -ra ver1 00:04:46.873 16:46:58 -- scripts/common.sh@336 -- # IFS=.-: 00:04:46.873 16:46:58 -- scripts/common.sh@336 -- # read -ra ver2 00:04:46.873 16:46:58 -- scripts/common.sh@337 -- # local 'op=<' 00:04:46.873 16:46:58 -- scripts/common.sh@339 -- # ver1_l=2 00:04:46.873 16:46:58 -- scripts/common.sh@340 -- # ver2_l=1 00:04:46.873 16:46:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:46.873 16:46:58 -- scripts/common.sh@343 -- # case "$op" in 00:04:46.873 16:46:58 -- scripts/common.sh@344 -- # : 1 00:04:46.873 16:46:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:46.873 16:46:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:46.873 16:46:58 -- scripts/common.sh@364 -- # decimal 1 00:04:46.873 16:46:58 -- scripts/common.sh@352 -- # local d=1 00:04:46.873 16:46:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:46.873 16:46:58 -- scripts/common.sh@354 -- # echo 1 00:04:46.873 16:46:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:46.873 16:46:58 -- scripts/common.sh@365 -- # decimal 2 00:04:46.873 16:46:58 -- scripts/common.sh@352 -- # local d=2 00:04:46.873 16:46:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:46.873 16:46:58 -- scripts/common.sh@354 -- # echo 2 00:04:46.873 16:46:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:46.873 16:46:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:46.873 16:46:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:46.873 16:46:58 -- scripts/common.sh@367 -- # return 0 00:04:46.873 16:46:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:46.873 16:46:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:46.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.873 --rc genhtml_branch_coverage=1 00:04:46.873 --rc genhtml_function_coverage=1 00:04:46.873 --rc genhtml_legend=1 00:04:46.873 --rc geninfo_all_blocks=1 00:04:46.873 --rc geninfo_unexecuted_blocks=1 00:04:46.873 00:04:46.873 ' 00:04:46.873 16:46:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:46.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.873 --rc genhtml_branch_coverage=1 00:04:46.873 --rc genhtml_function_coverage=1 00:04:46.873 --rc genhtml_legend=1 00:04:46.873 --rc geninfo_all_blocks=1 00:04:46.873 --rc geninfo_unexecuted_blocks=1 00:04:46.873 00:04:46.873 ' 00:04:46.873 16:46:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:46.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.873 --rc genhtml_branch_coverage=1 00:04:46.873 --rc genhtml_function_coverage=1 00:04:46.873 --rc genhtml_legend=1 00:04:46.873 --rc geninfo_all_blocks=1 00:04:46.873 --rc geninfo_unexecuted_blocks=1 00:04:46.873 00:04:46.873 ' 00:04:46.873 16:46:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:46.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.873 --rc genhtml_branch_coverage=1 00:04:46.873 --rc genhtml_function_coverage=1 00:04:46.873 --rc genhtml_legend=1 00:04:46.873 --rc geninfo_all_blocks=1 00:04:46.873 --rc geninfo_unexecuted_blocks=1 00:04:46.873 00:04:46.873 ' 00:04:46.873 16:46:58 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:46.873 16:46:58 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:46.873 16:46:58 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:46.873 16:46:58 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:46.873 16:46:58 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:46.873 16:46:58 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:46.873 16:46:58 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:46.873 16:46:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:46.873 16:46:58 -- common/autotest_common.sh@10 -- # set +x 00:04:46.873 16:46:58 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=83386 00:04:46.873 16:46:58 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:46.873 16:46:58 -- spdkcli/tcp.sh@27 -- # waitforlisten 83386 00:04:46.873 16:46:58 -- common/autotest_common.sh@829 -- # '[' -z 83386 ']' 00:04:46.873 16:46:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:46.873 16:46:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:46.873 16:46:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:46.873 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:46.873 16:46:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:46.873 16:46:58 -- common/autotest_common.sh@10 -- # set +x 00:04:46.873 [2024-11-29 16:46:58.120281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.873 [2024-11-29 16:46:58.120391] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83386 ] 00:04:46.873 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.873 [2024-11-29 16:46:58.177076] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:46.873 [2024-11-29 16:46:58.284292] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:46.873 [2024-11-29 16:46:58.284485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:46.873 [2024-11-29 16:46:58.284490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.810 16:46:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:47.810 16:46:59 -- common/autotest_common.sh@862 -- # return 0 00:04:47.810 16:46:59 -- spdkcli/tcp.sh@31 -- # socat_pid=83529 00:04:47.810 16:46:59 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:47.810 16:46:59 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:48.068 [ 00:04:48.068 "bdev_malloc_delete", 00:04:48.068 "bdev_malloc_create", 00:04:48.068 "bdev_null_resize", 00:04:48.068 "bdev_null_delete", 00:04:48.068 "bdev_null_create", 00:04:48.068 "bdev_nvme_cuse_unregister", 00:04:48.068 "bdev_nvme_cuse_register", 00:04:48.068 "bdev_opal_new_user", 00:04:48.068 "bdev_opal_set_lock_state", 00:04:48.068 "bdev_opal_delete", 00:04:48.068 "bdev_opal_get_info", 00:04:48.068 "bdev_opal_create", 00:04:48.068 "bdev_nvme_opal_revert", 00:04:48.068 "bdev_nvme_opal_init", 00:04:48.068 "bdev_nvme_send_cmd", 00:04:48.069 "bdev_nvme_get_path_iostat", 00:04:48.069 "bdev_nvme_get_mdns_discovery_info", 00:04:48.069 "bdev_nvme_stop_mdns_discovery", 00:04:48.069 "bdev_nvme_start_mdns_discovery", 00:04:48.069 "bdev_nvme_set_multipath_policy", 00:04:48.069 "bdev_nvme_set_preferred_path", 00:04:48.069 "bdev_nvme_get_io_paths", 00:04:48.069 "bdev_nvme_remove_error_injection", 00:04:48.069 "bdev_nvme_add_error_injection", 00:04:48.069 "bdev_nvme_get_discovery_info", 00:04:48.069 "bdev_nvme_stop_discovery", 00:04:48.069 "bdev_nvme_start_discovery", 00:04:48.069 "bdev_nvme_get_controller_health_info", 00:04:48.069 "bdev_nvme_disable_controller", 00:04:48.069 "bdev_nvme_enable_controller", 00:04:48.069 "bdev_nvme_reset_controller", 00:04:48.069 "bdev_nvme_get_transport_statistics", 00:04:48.069 "bdev_nvme_apply_firmware", 00:04:48.069 "bdev_nvme_detach_controller", 00:04:48.069 "bdev_nvme_get_controllers", 00:04:48.069 "bdev_nvme_attach_controller", 00:04:48.069 "bdev_nvme_set_hotplug", 00:04:48.069 "bdev_nvme_set_options", 00:04:48.069 "bdev_passthru_delete", 00:04:48.069 "bdev_passthru_create", 00:04:48.069 "bdev_lvol_grow_lvstore", 00:04:48.069 "bdev_lvol_get_lvols", 00:04:48.069 "bdev_lvol_get_lvstores", 00:04:48.069 "bdev_lvol_delete", 00:04:48.069 "bdev_lvol_set_read_only", 00:04:48.069 "bdev_lvol_resize", 00:04:48.069 "bdev_lvol_decouple_parent", 00:04:48.069 "bdev_lvol_inflate", 00:04:48.069 "bdev_lvol_rename", 00:04:48.069 "bdev_lvol_clone_bdev", 00:04:48.069 "bdev_lvol_clone", 00:04:48.069 "bdev_lvol_snapshot", 00:04:48.069 "bdev_lvol_create", 00:04:48.069 "bdev_lvol_delete_lvstore", 00:04:48.069 "bdev_lvol_rename_lvstore", 00:04:48.069 "bdev_lvol_create_lvstore", 00:04:48.069 "bdev_raid_set_options", 00:04:48.069 "bdev_raid_remove_base_bdev", 00:04:48.069 "bdev_raid_add_base_bdev", 00:04:48.069 "bdev_raid_delete", 00:04:48.069 "bdev_raid_create", 00:04:48.069 "bdev_raid_get_bdevs", 00:04:48.069 "bdev_error_inject_error", 00:04:48.069 "bdev_error_delete", 00:04:48.069 "bdev_error_create", 00:04:48.069 "bdev_split_delete", 00:04:48.069 "bdev_split_create", 00:04:48.069 "bdev_delay_delete", 00:04:48.069 "bdev_delay_create", 00:04:48.069 "bdev_delay_update_latency", 00:04:48.069 "bdev_zone_block_delete", 00:04:48.069 "bdev_zone_block_create", 00:04:48.069 "blobfs_create", 00:04:48.069 "blobfs_detect", 00:04:48.069 "blobfs_set_cache_size", 00:04:48.069 "bdev_aio_delete", 00:04:48.069 "bdev_aio_rescan", 00:04:48.069 "bdev_aio_create", 00:04:48.069 "bdev_ftl_set_property", 00:04:48.069 "bdev_ftl_get_properties", 00:04:48.069 "bdev_ftl_get_stats", 00:04:48.069 "bdev_ftl_unmap", 00:04:48.069 "bdev_ftl_unload", 00:04:48.069 "bdev_ftl_delete", 00:04:48.069 "bdev_ftl_load", 00:04:48.069 "bdev_ftl_create", 00:04:48.069 "bdev_virtio_attach_controller", 00:04:48.069 "bdev_virtio_scsi_get_devices", 00:04:48.069 "bdev_virtio_detach_controller", 00:04:48.069 "bdev_virtio_blk_set_hotplug", 00:04:48.069 "bdev_iscsi_delete", 00:04:48.069 "bdev_iscsi_create", 00:04:48.069 "bdev_iscsi_set_options", 00:04:48.069 "accel_error_inject_error", 00:04:48.069 "ioat_scan_accel_module", 00:04:48.069 "dsa_scan_accel_module", 00:04:48.069 "iaa_scan_accel_module", 00:04:48.069 "iscsi_set_options", 00:04:48.069 "iscsi_get_auth_groups", 00:04:48.069 "iscsi_auth_group_remove_secret", 00:04:48.069 "iscsi_auth_group_add_secret", 00:04:48.069 "iscsi_delete_auth_group", 00:04:48.069 "iscsi_create_auth_group", 00:04:48.069 "iscsi_set_discovery_auth", 00:04:48.069 "iscsi_get_options", 00:04:48.069 "iscsi_target_node_request_logout", 00:04:48.069 "iscsi_target_node_set_redirect", 00:04:48.069 "iscsi_target_node_set_auth", 00:04:48.069 "iscsi_target_node_add_lun", 00:04:48.069 "iscsi_get_connections", 00:04:48.069 "iscsi_portal_group_set_auth", 00:04:48.069 "iscsi_start_portal_group", 00:04:48.069 "iscsi_delete_portal_group", 00:04:48.069 "iscsi_create_portal_group", 00:04:48.069 "iscsi_get_portal_groups", 00:04:48.069 "iscsi_delete_target_node", 00:04:48.069 "iscsi_target_node_remove_pg_ig_maps", 00:04:48.069 "iscsi_target_node_add_pg_ig_maps", 00:04:48.069 "iscsi_create_target_node", 00:04:48.069 "iscsi_get_target_nodes", 00:04:48.069 "iscsi_delete_initiator_group", 00:04:48.069 "iscsi_initiator_group_remove_initiators", 00:04:48.069 "iscsi_initiator_group_add_initiators", 00:04:48.069 "iscsi_create_initiator_group", 00:04:48.069 "iscsi_get_initiator_groups", 00:04:48.069 "nvmf_set_crdt", 00:04:48.069 "nvmf_set_config", 00:04:48.069 "nvmf_set_max_subsystems", 00:04:48.069 "nvmf_subsystem_get_listeners", 00:04:48.069 "nvmf_subsystem_get_qpairs", 00:04:48.069 "nvmf_subsystem_get_controllers", 00:04:48.069 "nvmf_get_stats", 00:04:48.069 "nvmf_get_transports", 00:04:48.069 "nvmf_create_transport", 00:04:48.069 "nvmf_get_targets", 00:04:48.069 "nvmf_delete_target", 00:04:48.069 "nvmf_create_target", 00:04:48.069 "nvmf_subsystem_allow_any_host", 00:04:48.069 "nvmf_subsystem_remove_host", 00:04:48.069 "nvmf_subsystem_add_host", 00:04:48.069 "nvmf_subsystem_remove_ns", 00:04:48.069 "nvmf_subsystem_add_ns", 00:04:48.069 "nvmf_subsystem_listener_set_ana_state", 00:04:48.069 "nvmf_discovery_get_referrals", 00:04:48.069 "nvmf_discovery_remove_referral", 00:04:48.069 "nvmf_discovery_add_referral", 00:04:48.069 "nvmf_subsystem_remove_listener", 00:04:48.069 "nvmf_subsystem_add_listener", 00:04:48.069 "nvmf_delete_subsystem", 00:04:48.069 "nvmf_create_subsystem", 00:04:48.069 "nvmf_get_subsystems", 00:04:48.069 "env_dpdk_get_mem_stats", 00:04:48.069 "nbd_get_disks", 00:04:48.069 "nbd_stop_disk", 00:04:48.069 "nbd_start_disk", 00:04:48.069 "ublk_recover_disk", 00:04:48.069 "ublk_get_disks", 00:04:48.069 "ublk_stop_disk", 00:04:48.069 "ublk_start_disk", 00:04:48.069 "ublk_destroy_target", 00:04:48.069 "ublk_create_target", 00:04:48.069 "virtio_blk_create_transport", 00:04:48.069 "virtio_blk_get_transports", 00:04:48.069 "vhost_controller_set_coalescing", 00:04:48.069 "vhost_get_controllers", 00:04:48.069 "vhost_delete_controller", 00:04:48.069 "vhost_create_blk_controller", 00:04:48.069 "vhost_scsi_controller_remove_target", 00:04:48.069 "vhost_scsi_controller_add_target", 00:04:48.069 "vhost_start_scsi_controller", 00:04:48.069 "vhost_create_scsi_controller", 00:04:48.069 "thread_set_cpumask", 00:04:48.069 "framework_get_scheduler", 00:04:48.069 "framework_set_scheduler", 00:04:48.069 "framework_get_reactors", 00:04:48.069 "thread_get_io_channels", 00:04:48.069 "thread_get_pollers", 00:04:48.069 "thread_get_stats", 00:04:48.069 "framework_monitor_context_switch", 00:04:48.069 "spdk_kill_instance", 00:04:48.069 "log_enable_timestamps", 00:04:48.069 "log_get_flags", 00:04:48.069 "log_clear_flag", 00:04:48.069 "log_set_flag", 00:04:48.069 "log_get_level", 00:04:48.069 "log_set_level", 00:04:48.069 "log_get_print_level", 00:04:48.069 "log_set_print_level", 00:04:48.069 "framework_enable_cpumask_locks", 00:04:48.069 "framework_disable_cpumask_locks", 00:04:48.069 "framework_wait_init", 00:04:48.069 "framework_start_init", 00:04:48.069 "scsi_get_devices", 00:04:48.069 "bdev_get_histogram", 00:04:48.069 "bdev_enable_histogram", 00:04:48.069 "bdev_set_qos_limit", 00:04:48.069 "bdev_set_qd_sampling_period", 00:04:48.069 "bdev_get_bdevs", 00:04:48.069 "bdev_reset_iostat", 00:04:48.069 "bdev_get_iostat", 00:04:48.069 "bdev_examine", 00:04:48.069 "bdev_wait_for_examine", 00:04:48.069 "bdev_set_options", 00:04:48.069 "notify_get_notifications", 00:04:48.069 "notify_get_types", 00:04:48.069 "accel_get_stats", 00:04:48.069 "accel_set_options", 00:04:48.069 "accel_set_driver", 00:04:48.069 "accel_crypto_key_destroy", 00:04:48.069 "accel_crypto_keys_get", 00:04:48.069 "accel_crypto_key_create", 00:04:48.069 "accel_assign_opc", 00:04:48.069 "accel_get_module_info", 00:04:48.069 "accel_get_opc_assignments", 00:04:48.069 "vmd_rescan", 00:04:48.069 "vmd_remove_device", 00:04:48.069 "vmd_enable", 00:04:48.069 "sock_set_default_impl", 00:04:48.069 "sock_impl_set_options", 00:04:48.069 "sock_impl_get_options", 00:04:48.069 "iobuf_get_stats", 00:04:48.069 "iobuf_set_options", 00:04:48.069 "framework_get_pci_devices", 00:04:48.069 "framework_get_config", 00:04:48.069 "framework_get_subsystems", 00:04:48.069 "trace_get_info", 00:04:48.069 "trace_get_tpoint_group_mask", 00:04:48.069 "trace_disable_tpoint_group", 00:04:48.069 "trace_enable_tpoint_group", 00:04:48.069 "trace_clear_tpoint_mask", 00:04:48.069 "trace_set_tpoint_mask", 00:04:48.069 "spdk_get_version", 00:04:48.069 "rpc_get_methods" 00:04:48.069 ] 00:04:48.069 16:46:59 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:48.069 16:46:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:48.069 16:46:59 -- common/autotest_common.sh@10 -- # set +x 00:04:48.069 16:46:59 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:48.069 16:46:59 -- spdkcli/tcp.sh@38 -- # killprocess 83386 00:04:48.069 16:46:59 -- common/autotest_common.sh@936 -- # '[' -z 83386 ']' 00:04:48.069 16:46:59 -- common/autotest_common.sh@940 -- # kill -0 83386 00:04:48.069 16:46:59 -- common/autotest_common.sh@941 -- # uname 00:04:48.069 16:46:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:48.069 16:46:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 83386 00:04:48.069 16:46:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:48.069 16:46:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:48.070 16:46:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 83386' 00:04:48.070 killing process with pid 83386 00:04:48.070 16:46:59 -- common/autotest_common.sh@955 -- # kill 83386 00:04:48.070 16:46:59 -- common/autotest_common.sh@960 -- # wait 83386 00:04:48.637 00:04:48.637 real 0m1.872s 00:04:48.637 user 0m3.532s 00:04:48.637 sys 0m0.525s 00:04:48.637 16:46:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:48.637 16:46:59 -- common/autotest_common.sh@10 -- # set +x 00:04:48.637 ************************************ 00:04:48.637 END TEST spdkcli_tcp 00:04:48.637 ************************************ 00:04:48.637 16:46:59 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:48.637 16:46:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.637 16:46:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.637 16:46:59 -- common/autotest_common.sh@10 -- # set +x 00:04:48.637 ************************************ 00:04:48.637 START TEST dpdk_mem_utility 00:04:48.637 ************************************ 00:04:48.637 16:46:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:48.637 * Looking for test storage... 00:04:48.637 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:48.637 16:46:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:48.637 16:46:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:48.637 16:46:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:48.637 16:46:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:48.637 16:46:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:48.637 16:46:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:48.637 16:46:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:48.637 16:46:59 -- scripts/common.sh@335 -- # IFS=.-: 00:04:48.637 16:46:59 -- scripts/common.sh@335 -- # read -ra ver1 00:04:48.637 16:46:59 -- scripts/common.sh@336 -- # IFS=.-: 00:04:48.637 16:46:59 -- scripts/common.sh@336 -- # read -ra ver2 00:04:48.637 16:46:59 -- scripts/common.sh@337 -- # local 'op=<' 00:04:48.637 16:46:59 -- scripts/common.sh@339 -- # ver1_l=2 00:04:48.637 16:46:59 -- scripts/common.sh@340 -- # ver2_l=1 00:04:48.637 16:46:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:48.637 16:46:59 -- scripts/common.sh@343 -- # case "$op" in 00:04:48.637 16:46:59 -- scripts/common.sh@344 -- # : 1 00:04:48.637 16:46:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:48.637 16:46:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:48.637 16:46:59 -- scripts/common.sh@364 -- # decimal 1 00:04:48.637 16:46:59 -- scripts/common.sh@352 -- # local d=1 00:04:48.637 16:46:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:48.637 16:46:59 -- scripts/common.sh@354 -- # echo 1 00:04:48.637 16:46:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:48.637 16:46:59 -- scripts/common.sh@365 -- # decimal 2 00:04:48.637 16:46:59 -- scripts/common.sh@352 -- # local d=2 00:04:48.637 16:46:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:48.637 16:46:59 -- scripts/common.sh@354 -- # echo 2 00:04:48.637 16:46:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:48.637 16:46:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:48.637 16:46:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:48.637 16:46:59 -- scripts/common.sh@367 -- # return 0 00:04:48.637 16:46:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:48.637 16:46:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:48.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.637 --rc genhtml_branch_coverage=1 00:04:48.637 --rc genhtml_function_coverage=1 00:04:48.637 --rc genhtml_legend=1 00:04:48.637 --rc geninfo_all_blocks=1 00:04:48.637 --rc geninfo_unexecuted_blocks=1 00:04:48.637 00:04:48.637 ' 00:04:48.637 16:46:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:48.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.637 --rc genhtml_branch_coverage=1 00:04:48.637 --rc genhtml_function_coverage=1 00:04:48.637 --rc genhtml_legend=1 00:04:48.637 --rc geninfo_all_blocks=1 00:04:48.637 --rc geninfo_unexecuted_blocks=1 00:04:48.637 00:04:48.637 ' 00:04:48.637 16:46:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:48.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.637 --rc genhtml_branch_coverage=1 00:04:48.637 --rc genhtml_function_coverage=1 00:04:48.637 --rc genhtml_legend=1 00:04:48.637 --rc geninfo_all_blocks=1 00:04:48.637 --rc geninfo_unexecuted_blocks=1 00:04:48.637 00:04:48.637 ' 00:04:48.637 16:46:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:48.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.637 --rc genhtml_branch_coverage=1 00:04:48.637 --rc genhtml_function_coverage=1 00:04:48.637 --rc genhtml_legend=1 00:04:48.637 --rc geninfo_all_blocks=1 00:04:48.637 --rc geninfo_unexecuted_blocks=1 00:04:48.637 00:04:48.637 ' 00:04:48.637 16:46:59 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:48.637 16:46:59 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=83729 00:04:48.637 16:46:59 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:48.637 16:46:59 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 83729 00:04:48.637 16:46:59 -- common/autotest_common.sh@829 -- # '[' -z 83729 ']' 00:04:48.637 16:46:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:48.637 16:46:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:48.637 16:46:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:48.637 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:48.637 16:46:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:48.637 16:46:59 -- common/autotest_common.sh@10 -- # set +x 00:04:48.637 [2024-11-29 16:47:00.009805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:48.637 [2024-11-29 16:47:00.009888] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83729 ] 00:04:48.637 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.896 [2024-11-29 16:47:00.071706] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:48.896 [2024-11-29 16:47:00.175046] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:48.896 [2024-11-29 16:47:00.175232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.831 16:47:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:49.831 16:47:00 -- common/autotest_common.sh@862 -- # return 0 00:04:49.831 16:47:00 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:49.831 16:47:00 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:49.831 16:47:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:49.831 16:47:00 -- common/autotest_common.sh@10 -- # set +x 00:04:49.831 { 00:04:49.831 "filename": "/tmp/spdk_mem_dump.txt" 00:04:49.831 } 00:04:49.831 16:47:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:49.831 16:47:00 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:49.831 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:49.831 1 heaps totaling size 814.000000 MiB 00:04:49.831 size: 814.000000 MiB heap id: 0 00:04:49.831 end heaps---------- 00:04:49.831 8 mempools totaling size 598.116089 MiB 00:04:49.831 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:49.831 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:49.831 size: 84.521057 MiB name: bdev_io_83729 00:04:49.831 size: 51.011292 MiB name: evtpool_83729 00:04:49.831 size: 50.003479 MiB name: msgpool_83729 00:04:49.831 size: 21.763794 MiB name: PDU_Pool 00:04:49.831 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:49.831 size: 0.026123 MiB name: Session_Pool 00:04:49.831 end mempools------- 00:04:49.831 6 memzones totaling size 4.142822 MiB 00:04:49.831 size: 1.000366 MiB name: RG_ring_0_83729 00:04:49.831 size: 1.000366 MiB name: RG_ring_1_83729 00:04:49.831 size: 1.000366 MiB name: RG_ring_4_83729 00:04:49.831 size: 1.000366 MiB name: RG_ring_5_83729 00:04:49.831 size: 0.125366 MiB name: RG_ring_2_83729 00:04:49.831 size: 0.015991 MiB name: RG_ring_3_83729 00:04:49.831 end memzones------- 00:04:49.831 16:47:01 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:49.831 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:49.831 list of free elements. size: 12.519348 MiB 00:04:49.831 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:49.831 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:49.831 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:49.831 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:49.831 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:49.831 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:49.831 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:49.831 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:49.831 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:49.831 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:49.831 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:49.831 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:49.831 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:49.831 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:49.831 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:49.831 list of standard malloc elements. size: 199.218079 MiB 00:04:49.831 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:49.831 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:49.831 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:49.831 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:49.831 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:49.831 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:49.831 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:49.831 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:49.831 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:49.831 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:49.831 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:49.831 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:49.831 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:49.831 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:49.831 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:49.831 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:49.831 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:49.831 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:49.831 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:49.831 list of memzone associated elements. size: 602.262573 MiB 00:04:49.831 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:49.831 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:49.831 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:49.831 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:49.831 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:49.831 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_83729_0 00:04:49.831 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:49.831 associated memzone info: size: 48.002930 MiB name: MP_evtpool_83729_0 00:04:49.831 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:49.831 associated memzone info: size: 48.002930 MiB name: MP_msgpool_83729_0 00:04:49.831 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:49.831 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:49.831 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:49.831 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:49.831 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:49.831 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_83729 00:04:49.831 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:49.831 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_83729 00:04:49.831 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:49.831 associated memzone info: size: 1.007996 MiB name: MP_evtpool_83729 00:04:49.831 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:49.831 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:49.831 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:49.831 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:49.831 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:49.831 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:49.831 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:49.831 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:49.831 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:49.831 associated memzone info: size: 1.000366 MiB name: RG_ring_0_83729 00:04:49.831 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:49.832 associated memzone info: size: 1.000366 MiB name: RG_ring_1_83729 00:04:49.832 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:49.832 associated memzone info: size: 1.000366 MiB name: RG_ring_4_83729 00:04:49.832 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:49.832 associated memzone info: size: 1.000366 MiB name: RG_ring_5_83729 00:04:49.832 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:49.832 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_83729 00:04:49.832 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:49.832 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:49.832 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:49.832 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:49.832 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:49.832 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:49.832 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:49.832 associated memzone info: size: 0.125366 MiB name: RG_ring_2_83729 00:04:49.832 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:49.832 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:49.832 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:49.832 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:49.832 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:49.832 associated memzone info: size: 0.015991 MiB name: RG_ring_3_83729 00:04:49.832 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:49.832 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:49.832 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:49.832 associated memzone info: size: 0.000183 MiB name: MP_msgpool_83729 00:04:49.832 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:49.832 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_83729 00:04:49.832 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:49.832 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:49.832 16:47:01 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:49.832 16:47:01 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 83729 00:04:49.832 16:47:01 -- common/autotest_common.sh@936 -- # '[' -z 83729 ']' 00:04:49.832 16:47:01 -- common/autotest_common.sh@940 -- # kill -0 83729 00:04:49.832 16:47:01 -- common/autotest_common.sh@941 -- # uname 00:04:49.832 16:47:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:49.832 16:47:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 83729 00:04:49.832 16:47:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:49.832 16:47:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:49.832 16:47:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 83729' 00:04:49.832 killing process with pid 83729 00:04:49.832 16:47:01 -- common/autotest_common.sh@955 -- # kill 83729 00:04:49.832 16:47:01 -- common/autotest_common.sh@960 -- # wait 83729 00:04:50.399 00:04:50.399 real 0m1.732s 00:04:50.399 user 0m1.921s 00:04:50.399 sys 0m0.443s 00:04:50.399 16:47:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.399 16:47:01 -- common/autotest_common.sh@10 -- # set +x 00:04:50.399 ************************************ 00:04:50.399 END TEST dpdk_mem_utility 00:04:50.399 ************************************ 00:04:50.399 16:47:01 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:50.399 16:47:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.399 16:47:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.399 16:47:01 -- common/autotest_common.sh@10 -- # set +x 00:04:50.399 ************************************ 00:04:50.399 START TEST event 00:04:50.399 ************************************ 00:04:50.399 16:47:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:50.399 * Looking for test storage... 00:04:50.399 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:50.399 16:47:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:50.399 16:47:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:50.399 16:47:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:50.399 16:47:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:50.399 16:47:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:50.399 16:47:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:50.399 16:47:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:50.399 16:47:01 -- scripts/common.sh@335 -- # IFS=.-: 00:04:50.399 16:47:01 -- scripts/common.sh@335 -- # read -ra ver1 00:04:50.399 16:47:01 -- scripts/common.sh@336 -- # IFS=.-: 00:04:50.399 16:47:01 -- scripts/common.sh@336 -- # read -ra ver2 00:04:50.399 16:47:01 -- scripts/common.sh@337 -- # local 'op=<' 00:04:50.399 16:47:01 -- scripts/common.sh@339 -- # ver1_l=2 00:04:50.399 16:47:01 -- scripts/common.sh@340 -- # ver2_l=1 00:04:50.399 16:47:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:50.399 16:47:01 -- scripts/common.sh@343 -- # case "$op" in 00:04:50.399 16:47:01 -- scripts/common.sh@344 -- # : 1 00:04:50.399 16:47:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:50.399 16:47:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:50.399 16:47:01 -- scripts/common.sh@364 -- # decimal 1 00:04:50.399 16:47:01 -- scripts/common.sh@352 -- # local d=1 00:04:50.399 16:47:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:50.399 16:47:01 -- scripts/common.sh@354 -- # echo 1 00:04:50.399 16:47:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:50.399 16:47:01 -- scripts/common.sh@365 -- # decimal 2 00:04:50.399 16:47:01 -- scripts/common.sh@352 -- # local d=2 00:04:50.399 16:47:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:50.399 16:47:01 -- scripts/common.sh@354 -- # echo 2 00:04:50.399 16:47:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:50.399 16:47:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:50.399 16:47:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:50.399 16:47:01 -- scripts/common.sh@367 -- # return 0 00:04:50.399 16:47:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:50.399 16:47:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:50.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.399 --rc genhtml_branch_coverage=1 00:04:50.399 --rc genhtml_function_coverage=1 00:04:50.399 --rc genhtml_legend=1 00:04:50.399 --rc geninfo_all_blocks=1 00:04:50.399 --rc geninfo_unexecuted_blocks=1 00:04:50.399 00:04:50.399 ' 00:04:50.399 16:47:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:50.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.399 --rc genhtml_branch_coverage=1 00:04:50.399 --rc genhtml_function_coverage=1 00:04:50.399 --rc genhtml_legend=1 00:04:50.399 --rc geninfo_all_blocks=1 00:04:50.399 --rc geninfo_unexecuted_blocks=1 00:04:50.399 00:04:50.399 ' 00:04:50.399 16:47:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:50.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.399 --rc genhtml_branch_coverage=1 00:04:50.399 --rc genhtml_function_coverage=1 00:04:50.399 --rc genhtml_legend=1 00:04:50.399 --rc geninfo_all_blocks=1 00:04:50.399 --rc geninfo_unexecuted_blocks=1 00:04:50.399 00:04:50.399 ' 00:04:50.399 16:47:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:50.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.399 --rc genhtml_branch_coverage=1 00:04:50.399 --rc genhtml_function_coverage=1 00:04:50.399 --rc genhtml_legend=1 00:04:50.399 --rc geninfo_all_blocks=1 00:04:50.399 --rc geninfo_unexecuted_blocks=1 00:04:50.399 00:04:50.399 ' 00:04:50.399 16:47:01 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:50.399 16:47:01 -- bdev/nbd_common.sh@6 -- # set -e 00:04:50.399 16:47:01 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:50.399 16:47:01 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:50.399 16:47:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.399 16:47:01 -- common/autotest_common.sh@10 -- # set +x 00:04:50.399 ************************************ 00:04:50.399 START TEST event_perf 00:04:50.399 ************************************ 00:04:50.399 16:47:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:50.399 Running I/O for 1 seconds...[2024-11-29 16:47:01.745137] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:50.399 [2024-11-29 16:47:01.745210] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83944 ] 00:04:50.399 EAL: No free 2048 kB hugepages reported on node 1 00:04:50.399 [2024-11-29 16:47:01.804535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:50.657 [2024-11-29 16:47:01.913601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:50.657 [2024-11-29 16:47:01.913753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:50.657 [2024-11-29 16:47:01.913745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:50.657 [2024-11-29 16:47:01.913653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:51.590 Running I/O for 1 seconds... 00:04:51.590 lcore 0: 232399 00:04:51.590 lcore 1: 232397 00:04:51.590 lcore 2: 232398 00:04:51.590 lcore 3: 232399 00:04:51.848 done. 00:04:51.848 00:04:51.848 real 0m1.298s 00:04:51.848 user 0m4.199s 00:04:51.848 sys 0m0.093s 00:04:51.848 16:47:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.849 16:47:03 -- common/autotest_common.sh@10 -- # set +x 00:04:51.849 ************************************ 00:04:51.849 END TEST event_perf 00:04:51.849 ************************************ 00:04:51.849 16:47:03 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:51.849 16:47:03 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:51.849 16:47:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.849 16:47:03 -- common/autotest_common.sh@10 -- # set +x 00:04:51.849 ************************************ 00:04:51.849 START TEST event_reactor 00:04:51.849 ************************************ 00:04:51.849 16:47:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:51.849 [2024-11-29 16:47:03.066805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.849 [2024-11-29 16:47:03.066890] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84102 ] 00:04:51.849 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.849 [2024-11-29 16:47:03.123488] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:51.849 [2024-11-29 16:47:03.226219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:53.224 test_start 00:04:53.224 oneshot 00:04:53.224 tick 100 00:04:53.224 tick 100 00:04:53.224 tick 250 00:04:53.224 tick 100 00:04:53.224 tick 100 00:04:53.224 tick 100 00:04:53.224 tick 250 00:04:53.224 tick 500 00:04:53.224 tick 100 00:04:53.224 tick 100 00:04:53.224 tick 250 00:04:53.224 tick 100 00:04:53.224 tick 100 00:04:53.224 test_end 00:04:53.224 00:04:53.224 real 0m1.282s 00:04:53.224 user 0m1.205s 00:04:53.224 sys 0m0.073s 00:04:53.224 16:47:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:53.224 16:47:04 -- common/autotest_common.sh@10 -- # set +x 00:04:53.224 ************************************ 00:04:53.224 END TEST event_reactor 00:04:53.224 ************************************ 00:04:53.224 16:47:04 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:53.224 16:47:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:53.224 16:47:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.224 16:47:04 -- common/autotest_common.sh@10 -- # set +x 00:04:53.224 ************************************ 00:04:53.224 START TEST event_reactor_perf 00:04:53.224 ************************************ 00:04:53.224 16:47:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:53.224 [2024-11-29 16:47:04.378136] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:53.224 [2024-11-29 16:47:04.378211] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84375 ] 00:04:53.224 EAL: No free 2048 kB hugepages reported on node 1 00:04:53.224 [2024-11-29 16:47:04.437379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:53.224 [2024-11-29 16:47:04.553813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.599 test_start 00:04:54.599 test_end 00:04:54.599 Performance: 432901 events per second 00:04:54.599 00:04:54.599 real 0m1.303s 00:04:54.599 user 0m1.223s 00:04:54.599 sys 0m0.074s 00:04:54.599 16:47:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.599 16:47:05 -- common/autotest_common.sh@10 -- # set +x 00:04:54.599 ************************************ 00:04:54.599 END TEST event_reactor_perf 00:04:54.599 ************************************ 00:04:54.599 16:47:05 -- event/event.sh@49 -- # uname -s 00:04:54.599 16:47:05 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:54.599 16:47:05 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:54.599 16:47:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:54.599 16:47:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.599 16:47:05 -- common/autotest_common.sh@10 -- # set +x 00:04:54.599 ************************************ 00:04:54.599 START TEST event_scheduler 00:04:54.599 ************************************ 00:04:54.599 16:47:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:54.599 * Looking for test storage... 00:04:54.599 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:54.599 16:47:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:54.599 16:47:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:54.599 16:47:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:54.599 16:47:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:54.599 16:47:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:54.599 16:47:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:54.599 16:47:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:54.599 16:47:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:54.599 16:47:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:54.599 16:47:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:54.599 16:47:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:54.599 16:47:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:54.599 16:47:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:54.599 16:47:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:54.599 16:47:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:54.599 16:47:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:54.599 16:47:05 -- scripts/common.sh@344 -- # : 1 00:04:54.599 16:47:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:54.599 16:47:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:54.599 16:47:05 -- scripts/common.sh@364 -- # decimal 1 00:04:54.599 16:47:05 -- scripts/common.sh@352 -- # local d=1 00:04:54.599 16:47:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:54.599 16:47:05 -- scripts/common.sh@354 -- # echo 1 00:04:54.599 16:47:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:54.599 16:47:05 -- scripts/common.sh@365 -- # decimal 2 00:04:54.599 16:47:05 -- scripts/common.sh@352 -- # local d=2 00:04:54.599 16:47:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:54.599 16:47:05 -- scripts/common.sh@354 -- # echo 2 00:04:54.599 16:47:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:54.599 16:47:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:54.599 16:47:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:54.599 16:47:05 -- scripts/common.sh@367 -- # return 0 00:04:54.599 16:47:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:54.599 16:47:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:54.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.599 --rc genhtml_branch_coverage=1 00:04:54.599 --rc genhtml_function_coverage=1 00:04:54.599 --rc genhtml_legend=1 00:04:54.599 --rc geninfo_all_blocks=1 00:04:54.599 --rc geninfo_unexecuted_blocks=1 00:04:54.599 00:04:54.599 ' 00:04:54.599 16:47:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:54.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.599 --rc genhtml_branch_coverage=1 00:04:54.599 --rc genhtml_function_coverage=1 00:04:54.599 --rc genhtml_legend=1 00:04:54.599 --rc geninfo_all_blocks=1 00:04:54.599 --rc geninfo_unexecuted_blocks=1 00:04:54.599 00:04:54.599 ' 00:04:54.599 16:47:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:54.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.599 --rc genhtml_branch_coverage=1 00:04:54.599 --rc genhtml_function_coverage=1 00:04:54.599 --rc genhtml_legend=1 00:04:54.599 --rc geninfo_all_blocks=1 00:04:54.599 --rc geninfo_unexecuted_blocks=1 00:04:54.599 00:04:54.599 ' 00:04:54.599 16:47:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:54.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.599 --rc genhtml_branch_coverage=1 00:04:54.599 --rc genhtml_function_coverage=1 00:04:54.599 --rc genhtml_legend=1 00:04:54.599 --rc geninfo_all_blocks=1 00:04:54.599 --rc geninfo_unexecuted_blocks=1 00:04:54.599 00:04:54.599 ' 00:04:54.599 16:47:05 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:54.599 16:47:05 -- scheduler/scheduler.sh@35 -- # scheduler_pid=84575 00:04:54.599 16:47:05 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:54.599 16:47:05 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:54.599 16:47:05 -- scheduler/scheduler.sh@37 -- # waitforlisten 84575 00:04:54.599 16:47:05 -- common/autotest_common.sh@829 -- # '[' -z 84575 ']' 00:04:54.599 16:47:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:54.599 16:47:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:54.599 16:47:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:54.599 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:54.599 16:47:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:54.599 16:47:05 -- common/autotest_common.sh@10 -- # set +x 00:04:54.599 [2024-11-29 16:47:05.865026] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:54.599 [2024-11-29 16:47:05.865106] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84575 ] 00:04:54.599 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.599 [2024-11-29 16:47:05.921836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:54.599 [2024-11-29 16:47:06.024797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.599 [2024-11-29 16:47:06.024899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:54.599 [2024-11-29 16:47:06.025007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:54.599 [2024-11-29 16:47:06.025012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:54.858 16:47:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:54.858 16:47:06 -- common/autotest_common.sh@862 -- # return 0 00:04:54.858 16:47:06 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:54.858 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:54.858 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:54.858 POWER: Env isn't set yet! 00:04:54.858 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:54.858 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:54.858 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:54.858 POWER: Cannot get available frequencies of lcore 0 00:04:54.858 POWER: Attempting to initialise PSTAT power management... 00:04:54.858 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:54.858 POWER: Initialized successfully for lcore 0 power management 00:04:54.858 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:54.858 POWER: Initialized successfully for lcore 1 power management 00:04:54.858 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:54.858 POWER: Initialized successfully for lcore 2 power management 00:04:54.858 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:54.858 POWER: Initialized successfully for lcore 3 power management 00:04:54.858 [2024-11-29 16:47:06.122212] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:54.858 [2024-11-29 16:47:06.122234] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:54.858 [2024-11-29 16:47:06.122247] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:54.858 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:54.858 16:47:06 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:54.858 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:54.858 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:54.858 [2024-11-29 16:47:06.225445] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:54.858 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:54.858 16:47:06 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:54.858 16:47:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:54.858 16:47:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.858 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:54.858 ************************************ 00:04:54.858 START TEST scheduler_create_thread 00:04:54.858 ************************************ 00:04:54.858 16:47:06 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:54.858 16:47:06 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:54.858 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:54.858 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:54.858 2 00:04:54.858 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:54.858 16:47:06 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:54.858 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:54.858 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:54.858 3 00:04:54.858 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:54.858 16:47:06 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:54.858 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:54.858 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:54.858 4 00:04:54.858 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:54.858 16:47:06 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:54.858 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:54.858 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:54.858 5 00:04:54.858 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:54.858 16:47:06 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:54.858 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:54.858 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:54.858 6 00:04:54.858 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:54.858 16:47:06 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:54.858 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:54.858 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:55.117 7 00:04:55.117 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.117 16:47:06 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:55.117 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.117 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:55.117 8 00:04:55.117 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.117 16:47:06 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:55.117 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.117 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:55.117 9 00:04:55.117 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.117 16:47:06 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:55.117 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.117 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:55.117 10 00:04:55.117 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.117 16:47:06 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:55.117 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.117 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:55.117 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.117 16:47:06 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:55.117 16:47:06 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:55.117 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.117 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:55.117 16:47:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.117 16:47:06 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:55.117 16:47:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.117 16:47:06 -- common/autotest_common.sh@10 -- # set +x 00:04:56.492 16:47:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:56.492 16:47:07 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:56.492 16:47:07 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:56.492 16:47:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:56.492 16:47:07 -- common/autotest_common.sh@10 -- # set +x 00:04:57.427 16:47:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.427 00:04:57.427 real 0m2.617s 00:04:57.427 user 0m0.011s 00:04:57.427 sys 0m0.002s 00:04:57.427 16:47:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.427 16:47:08 -- common/autotest_common.sh@10 -- # set +x 00:04:57.427 ************************************ 00:04:57.427 END TEST scheduler_create_thread 00:04:57.427 ************************************ 00:04:57.686 16:47:08 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:57.686 16:47:08 -- scheduler/scheduler.sh@46 -- # killprocess 84575 00:04:57.686 16:47:08 -- common/autotest_common.sh@936 -- # '[' -z 84575 ']' 00:04:57.686 16:47:08 -- common/autotest_common.sh@940 -- # kill -0 84575 00:04:57.686 16:47:08 -- common/autotest_common.sh@941 -- # uname 00:04:57.686 16:47:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:57.686 16:47:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 84575 00:04:57.686 16:47:08 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:57.686 16:47:08 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:57.686 16:47:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 84575' 00:04:57.686 killing process with pid 84575 00:04:57.686 16:47:08 -- common/autotest_common.sh@955 -- # kill 84575 00:04:57.686 16:47:08 -- common/autotest_common.sh@960 -- # wait 84575 00:04:57.944 [2024-11-29 16:47:09.328469] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:58.204 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:58.204 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:58.204 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:58.204 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:58.204 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:58.204 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:58.204 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:58.204 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:58.204 00:04:58.204 real 0m3.908s 00:04:58.204 user 0m5.865s 00:04:58.204 sys 0m0.330s 00:04:58.204 16:47:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:58.204 16:47:09 -- common/autotest_common.sh@10 -- # set +x 00:04:58.204 ************************************ 00:04:58.204 END TEST event_scheduler 00:04:58.204 ************************************ 00:04:58.204 16:47:09 -- event/event.sh@51 -- # modprobe -n nbd 00:04:58.204 16:47:09 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:58.204 16:47:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:58.204 16:47:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.204 16:47:09 -- common/autotest_common.sh@10 -- # set +x 00:04:58.204 ************************************ 00:04:58.204 START TEST app_repeat 00:04:58.204 ************************************ 00:04:58.204 16:47:09 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:58.464 16:47:09 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:58.464 16:47:09 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:58.464 16:47:09 -- event/event.sh@13 -- # local nbd_list 00:04:58.464 16:47:09 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:58.464 16:47:09 -- event/event.sh@14 -- # local bdev_list 00:04:58.464 16:47:09 -- event/event.sh@15 -- # local repeat_times=4 00:04:58.464 16:47:09 -- event/event.sh@17 -- # modprobe nbd 00:04:58.464 16:47:09 -- event/event.sh@19 -- # repeat_pid=85032 00:04:58.464 16:47:09 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:58.464 16:47:09 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:58.464 16:47:09 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 85032' 00:04:58.464 Process app_repeat pid: 85032 00:04:58.464 16:47:09 -- event/event.sh@23 -- # for i in {0..2} 00:04:58.464 16:47:09 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:58.464 spdk_app_start Round 0 00:04:58.464 16:47:09 -- event/event.sh@25 -- # waitforlisten 85032 /var/tmp/spdk-nbd.sock 00:04:58.464 16:47:09 -- common/autotest_common.sh@829 -- # '[' -z 85032 ']' 00:04:58.464 16:47:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:58.464 16:47:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:58.464 16:47:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:58.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:58.464 16:47:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:58.464 16:47:09 -- common/autotest_common.sh@10 -- # set +x 00:04:58.464 [2024-11-29 16:47:09.659395] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:58.464 [2024-11-29 16:47:09.659468] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid85032 ] 00:04:58.464 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.464 [2024-11-29 16:47:09.721493] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:58.464 [2024-11-29 16:47:09.837107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:58.464 [2024-11-29 16:47:09.837112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.399 16:47:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:59.399 16:47:10 -- common/autotest_common.sh@862 -- # return 0 00:04:59.399 16:47:10 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:59.658 Malloc0 00:04:59.658 16:47:10 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:59.917 Malloc1 00:04:59.917 16:47:11 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@12 -- # local i 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.917 16:47:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:00.175 /dev/nbd0 00:05:00.175 16:47:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:00.175 16:47:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:00.175 16:47:11 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:00.175 16:47:11 -- common/autotest_common.sh@867 -- # local i 00:05:00.175 16:47:11 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:00.175 16:47:11 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:00.175 16:47:11 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:00.175 16:47:11 -- common/autotest_common.sh@871 -- # break 00:05:00.175 16:47:11 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:00.175 16:47:11 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:00.175 16:47:11 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:00.175 1+0 records in 00:05:00.175 1+0 records out 00:05:00.175 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000173647 s, 23.6 MB/s 00:05:00.175 16:47:11 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:00.175 16:47:11 -- common/autotest_common.sh@884 -- # size=4096 00:05:00.175 16:47:11 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:00.175 16:47:11 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:00.175 16:47:11 -- common/autotest_common.sh@887 -- # return 0 00:05:00.175 16:47:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:00.175 16:47:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:00.175 16:47:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:00.434 /dev/nbd1 00:05:00.434 16:47:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:00.434 16:47:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:00.434 16:47:11 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:00.434 16:47:11 -- common/autotest_common.sh@867 -- # local i 00:05:00.434 16:47:11 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:00.434 16:47:11 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:00.434 16:47:11 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:00.434 16:47:11 -- common/autotest_common.sh@871 -- # break 00:05:00.434 16:47:11 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:00.434 16:47:11 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:00.434 16:47:11 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:00.434 1+0 records in 00:05:00.434 1+0 records out 00:05:00.434 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209959 s, 19.5 MB/s 00:05:00.434 16:47:11 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:00.434 16:47:11 -- common/autotest_common.sh@884 -- # size=4096 00:05:00.434 16:47:11 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:00.434 16:47:11 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:00.434 16:47:11 -- common/autotest_common.sh@887 -- # return 0 00:05:00.434 16:47:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:00.434 16:47:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:00.434 16:47:11 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:00.434 16:47:11 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.434 16:47:11 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:00.693 16:47:11 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:00.693 { 00:05:00.693 "nbd_device": "/dev/nbd0", 00:05:00.693 "bdev_name": "Malloc0" 00:05:00.693 }, 00:05:00.693 { 00:05:00.693 "nbd_device": "/dev/nbd1", 00:05:00.693 "bdev_name": "Malloc1" 00:05:00.693 } 00:05:00.693 ]' 00:05:00.693 16:47:11 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:00.693 { 00:05:00.693 "nbd_device": "/dev/nbd0", 00:05:00.693 "bdev_name": "Malloc0" 00:05:00.693 }, 00:05:00.693 { 00:05:00.693 "nbd_device": "/dev/nbd1", 00:05:00.693 "bdev_name": "Malloc1" 00:05:00.693 } 00:05:00.693 ]' 00:05:00.693 16:47:11 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:00.693 /dev/nbd1' 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:00.693 /dev/nbd1' 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@65 -- # count=2 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@95 -- # count=2 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:00.693 256+0 records in 00:05:00.693 256+0 records out 00:05:00.693 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00384394 s, 273 MB/s 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:00.693 16:47:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:00.693 256+0 records in 00:05:00.693 256+0 records out 00:05:00.693 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227353 s, 46.1 MB/s 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:00.694 256+0 records in 00:05:00.694 256+0 records out 00:05:00.694 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216612 s, 48.4 MB/s 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@51 -- # local i 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:00.694 16:47:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@41 -- # break 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@45 -- # return 0 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@41 -- # break 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@45 -- # return 0 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:01.260 16:47:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:01.519 16:47:12 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:01.519 16:47:12 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:01.519 16:47:12 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:01.777 16:47:12 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:01.777 16:47:12 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:01.777 16:47:12 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:01.777 16:47:12 -- bdev/nbd_common.sh@65 -- # true 00:05:01.777 16:47:12 -- bdev/nbd_common.sh@65 -- # count=0 00:05:01.777 16:47:12 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:01.777 16:47:12 -- bdev/nbd_common.sh@104 -- # count=0 00:05:01.777 16:47:12 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:01.777 16:47:12 -- bdev/nbd_common.sh@109 -- # return 0 00:05:01.777 16:47:12 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:02.035 16:47:13 -- event/event.sh@35 -- # sleep 3 00:05:02.293 [2024-11-29 16:47:13.508517] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:02.293 [2024-11-29 16:47:13.621033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.293 [2024-11-29 16:47:13.621033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:02.293 [2024-11-29 16:47:13.682125] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:02.293 [2024-11-29 16:47:13.682201] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:04.823 16:47:16 -- event/event.sh@23 -- # for i in {0..2} 00:05:04.823 16:47:16 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:04.823 spdk_app_start Round 1 00:05:04.824 16:47:16 -- event/event.sh@25 -- # waitforlisten 85032 /var/tmp/spdk-nbd.sock 00:05:04.824 16:47:16 -- common/autotest_common.sh@829 -- # '[' -z 85032 ']' 00:05:04.824 16:47:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:04.824 16:47:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:04.824 16:47:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:04.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:04.824 16:47:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:04.824 16:47:16 -- common/autotest_common.sh@10 -- # set +x 00:05:05.081 16:47:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:05.081 16:47:16 -- common/autotest_common.sh@862 -- # return 0 00:05:05.081 16:47:16 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:05.339 Malloc0 00:05:05.339 16:47:16 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:05.598 Malloc1 00:05:05.598 16:47:17 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:05.598 16:47:17 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:05.598 16:47:17 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:05.598 16:47:17 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:05.598 16:47:17 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:05.598 16:47:17 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:05.598 16:47:17 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@12 -- # local i 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:05.856 /dev/nbd0 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:05.856 16:47:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:05.856 16:47:17 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:05.856 16:47:17 -- common/autotest_common.sh@867 -- # local i 00:05:05.856 16:47:17 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:05.856 16:47:17 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:05.856 16:47:17 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:05.856 16:47:17 -- common/autotest_common.sh@871 -- # break 00:05:05.856 16:47:17 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:05.856 16:47:17 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:05.857 16:47:17 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:06.114 1+0 records in 00:05:06.114 1+0 records out 00:05:06.114 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000172801 s, 23.7 MB/s 00:05:06.114 16:47:17 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:06.114 16:47:17 -- common/autotest_common.sh@884 -- # size=4096 00:05:06.114 16:47:17 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:06.114 16:47:17 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:06.114 16:47:17 -- common/autotest_common.sh@887 -- # return 0 00:05:06.114 16:47:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:06.114 16:47:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:06.114 16:47:17 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:06.114 /dev/nbd1 00:05:06.114 16:47:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:06.114 16:47:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:06.114 16:47:17 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:06.114 16:47:17 -- common/autotest_common.sh@867 -- # local i 00:05:06.115 16:47:17 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:06.115 16:47:17 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:06.115 16:47:17 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:06.373 16:47:17 -- common/autotest_common.sh@871 -- # break 00:05:06.373 16:47:17 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:06.373 16:47:17 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:06.373 16:47:17 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:06.373 1+0 records in 00:05:06.373 1+0 records out 00:05:06.373 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000190439 s, 21.5 MB/s 00:05:06.373 16:47:17 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:06.373 16:47:17 -- common/autotest_common.sh@884 -- # size=4096 00:05:06.373 16:47:17 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:06.373 16:47:17 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:06.373 16:47:17 -- common/autotest_common.sh@887 -- # return 0 00:05:06.373 16:47:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:06.373 16:47:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:06.373 16:47:17 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:06.373 16:47:17 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.373 16:47:17 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:06.632 { 00:05:06.632 "nbd_device": "/dev/nbd0", 00:05:06.632 "bdev_name": "Malloc0" 00:05:06.632 }, 00:05:06.632 { 00:05:06.632 "nbd_device": "/dev/nbd1", 00:05:06.632 "bdev_name": "Malloc1" 00:05:06.632 } 00:05:06.632 ]' 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:06.632 { 00:05:06.632 "nbd_device": "/dev/nbd0", 00:05:06.632 "bdev_name": "Malloc0" 00:05:06.632 }, 00:05:06.632 { 00:05:06.632 "nbd_device": "/dev/nbd1", 00:05:06.632 "bdev_name": "Malloc1" 00:05:06.632 } 00:05:06.632 ]' 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:06.632 /dev/nbd1' 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:06.632 /dev/nbd1' 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@65 -- # count=2 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@95 -- # count=2 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:06.632 16:47:17 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:06.633 256+0 records in 00:05:06.633 256+0 records out 00:05:06.633 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00470498 s, 223 MB/s 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:06.633 256+0 records in 00:05:06.633 256+0 records out 00:05:06.633 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210262 s, 49.9 MB/s 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:06.633 256+0 records in 00:05:06.633 256+0 records out 00:05:06.633 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226973 s, 46.2 MB/s 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@51 -- # local i 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:06.633 16:47:17 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:06.892 16:47:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:06.892 16:47:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:06.892 16:47:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:06.892 16:47:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:06.892 16:47:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:06.892 16:47:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:06.892 16:47:18 -- bdev/nbd_common.sh@41 -- # break 00:05:06.892 16:47:18 -- bdev/nbd_common.sh@45 -- # return 0 00:05:06.892 16:47:18 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:06.893 16:47:18 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:07.150 16:47:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@41 -- # break 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@45 -- # return 0 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:07.151 16:47:18 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@65 -- # true 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@65 -- # count=0 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@104 -- # count=0 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:07.409 16:47:18 -- bdev/nbd_common.sh@109 -- # return 0 00:05:07.409 16:47:18 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:07.667 16:47:19 -- event/event.sh@35 -- # sleep 3 00:05:07.926 [2024-11-29 16:47:19.333641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:08.185 [2024-11-29 16:47:19.448802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:08.185 [2024-11-29 16:47:19.448806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.185 [2024-11-29 16:47:19.510147] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:08.185 [2024-11-29 16:47:19.510223] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:10.735 16:47:22 -- event/event.sh@23 -- # for i in {0..2} 00:05:10.735 16:47:22 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:10.735 spdk_app_start Round 2 00:05:10.735 16:47:22 -- event/event.sh@25 -- # waitforlisten 85032 /var/tmp/spdk-nbd.sock 00:05:10.735 16:47:22 -- common/autotest_common.sh@829 -- # '[' -z 85032 ']' 00:05:10.735 16:47:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:10.736 16:47:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.736 16:47:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:10.736 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:10.736 16:47:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.736 16:47:22 -- common/autotest_common.sh@10 -- # set +x 00:05:10.995 16:47:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.995 16:47:22 -- common/autotest_common.sh@862 -- # return 0 00:05:10.995 16:47:22 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:11.253 Malloc0 00:05:11.253 16:47:22 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:11.512 Malloc1 00:05:11.512 16:47:22 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@12 -- # local i 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:11.512 16:47:22 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:11.770 /dev/nbd0 00:05:11.770 16:47:23 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:11.770 16:47:23 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:11.770 16:47:23 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:11.770 16:47:23 -- common/autotest_common.sh@867 -- # local i 00:05:11.770 16:47:23 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:11.770 16:47:23 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:11.770 16:47:23 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:11.770 16:47:23 -- common/autotest_common.sh@871 -- # break 00:05:11.770 16:47:23 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:11.770 16:47:23 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:11.770 16:47:23 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:11.770 1+0 records in 00:05:11.770 1+0 records out 00:05:11.770 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000198449 s, 20.6 MB/s 00:05:11.770 16:47:23 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:11.770 16:47:23 -- common/autotest_common.sh@884 -- # size=4096 00:05:11.770 16:47:23 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:11.770 16:47:23 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:11.770 16:47:23 -- common/autotest_common.sh@887 -- # return 0 00:05:11.770 16:47:23 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:11.770 16:47:23 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:11.770 16:47:23 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:12.028 /dev/nbd1 00:05:12.028 16:47:23 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:12.028 16:47:23 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:12.028 16:47:23 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:12.028 16:47:23 -- common/autotest_common.sh@867 -- # local i 00:05:12.028 16:47:23 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:12.028 16:47:23 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:12.028 16:47:23 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:12.028 16:47:23 -- common/autotest_common.sh@871 -- # break 00:05:12.028 16:47:23 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:12.028 16:47:23 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:12.028 16:47:23 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:12.028 1+0 records in 00:05:12.028 1+0 records out 00:05:12.028 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000187573 s, 21.8 MB/s 00:05:12.028 16:47:23 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:12.028 16:47:23 -- common/autotest_common.sh@884 -- # size=4096 00:05:12.028 16:47:23 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:12.028 16:47:23 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:12.028 16:47:23 -- common/autotest_common.sh@887 -- # return 0 00:05:12.028 16:47:23 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:12.028 16:47:23 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:12.028 16:47:23 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:12.028 16:47:23 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:12.028 16:47:23 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:12.287 { 00:05:12.287 "nbd_device": "/dev/nbd0", 00:05:12.287 "bdev_name": "Malloc0" 00:05:12.287 }, 00:05:12.287 { 00:05:12.287 "nbd_device": "/dev/nbd1", 00:05:12.287 "bdev_name": "Malloc1" 00:05:12.287 } 00:05:12.287 ]' 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:12.287 { 00:05:12.287 "nbd_device": "/dev/nbd0", 00:05:12.287 "bdev_name": "Malloc0" 00:05:12.287 }, 00:05:12.287 { 00:05:12.287 "nbd_device": "/dev/nbd1", 00:05:12.287 "bdev_name": "Malloc1" 00:05:12.287 } 00:05:12.287 ]' 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:12.287 /dev/nbd1' 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:12.287 /dev/nbd1' 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@65 -- # count=2 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@95 -- # count=2 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:12.287 16:47:23 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:12.288 256+0 records in 00:05:12.288 256+0 records out 00:05:12.288 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00499507 s, 210 MB/s 00:05:12.288 16:47:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:12.288 16:47:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:12.546 256+0 records in 00:05:12.546 256+0 records out 00:05:12.546 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205104 s, 51.1 MB/s 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:12.546 256+0 records in 00:05:12.546 256+0 records out 00:05:12.546 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240552 s, 43.6 MB/s 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@51 -- # local i 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:12.546 16:47:23 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@41 -- # break 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@45 -- # return 0 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:12.804 16:47:24 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@41 -- # break 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@45 -- # return 0 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:13.063 16:47:24 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@65 -- # true 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@65 -- # count=0 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@104 -- # count=0 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:13.321 16:47:24 -- bdev/nbd_common.sh@109 -- # return 0 00:05:13.321 16:47:24 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:13.579 16:47:24 -- event/event.sh@35 -- # sleep 3 00:05:13.838 [2024-11-29 16:47:25.155649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:14.096 [2024-11-29 16:47:25.269695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:14.096 [2024-11-29 16:47:25.269699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.096 [2024-11-29 16:47:25.331015] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:14.096 [2024-11-29 16:47:25.331105] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:16.625 16:47:27 -- event/event.sh@38 -- # waitforlisten 85032 /var/tmp/spdk-nbd.sock 00:05:16.625 16:47:27 -- common/autotest_common.sh@829 -- # '[' -z 85032 ']' 00:05:16.625 16:47:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:16.625 16:47:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:16.625 16:47:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:16.625 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:16.625 16:47:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:16.625 16:47:27 -- common/autotest_common.sh@10 -- # set +x 00:05:16.884 16:47:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.884 16:47:28 -- common/autotest_common.sh@862 -- # return 0 00:05:16.884 16:47:28 -- event/event.sh@39 -- # killprocess 85032 00:05:16.884 16:47:28 -- common/autotest_common.sh@936 -- # '[' -z 85032 ']' 00:05:16.884 16:47:28 -- common/autotest_common.sh@940 -- # kill -0 85032 00:05:16.884 16:47:28 -- common/autotest_common.sh@941 -- # uname 00:05:16.884 16:47:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.884 16:47:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 85032 00:05:16.884 16:47:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:16.884 16:47:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:16.884 16:47:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 85032' 00:05:16.884 killing process with pid 85032 00:05:16.884 16:47:28 -- common/autotest_common.sh@955 -- # kill 85032 00:05:16.884 16:47:28 -- common/autotest_common.sh@960 -- # wait 85032 00:05:17.142 spdk_app_start is called in Round 0. 00:05:17.142 Shutdown signal received, stop current app iteration 00:05:17.142 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:17.142 spdk_app_start is called in Round 1. 00:05:17.142 Shutdown signal received, stop current app iteration 00:05:17.142 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:17.142 spdk_app_start is called in Round 2. 00:05:17.142 Shutdown signal received, stop current app iteration 00:05:17.142 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:17.142 spdk_app_start is called in Round 3. 00:05:17.142 Shutdown signal received, stop current app iteration 00:05:17.142 16:47:28 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:17.142 16:47:28 -- event/event.sh@42 -- # return 0 00:05:17.142 00:05:17.142 real 0m18.810s 00:05:17.142 user 0m40.988s 00:05:17.142 sys 0m3.131s 00:05:17.142 16:47:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.142 16:47:28 -- common/autotest_common.sh@10 -- # set +x 00:05:17.142 ************************************ 00:05:17.142 END TEST app_repeat 00:05:17.142 ************************************ 00:05:17.142 16:47:28 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:17.142 16:47:28 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:17.142 16:47:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:17.142 16:47:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.142 16:47:28 -- common/autotest_common.sh@10 -- # set +x 00:05:17.142 ************************************ 00:05:17.142 START TEST cpu_locks 00:05:17.142 ************************************ 00:05:17.142 16:47:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:17.142 * Looking for test storage... 00:05:17.142 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:17.142 16:47:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:17.142 16:47:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:17.142 16:47:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:17.401 16:47:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:17.401 16:47:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:17.401 16:47:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:17.401 16:47:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:17.401 16:47:28 -- scripts/common.sh@335 -- # IFS=.-: 00:05:17.401 16:47:28 -- scripts/common.sh@335 -- # read -ra ver1 00:05:17.401 16:47:28 -- scripts/common.sh@336 -- # IFS=.-: 00:05:17.401 16:47:28 -- scripts/common.sh@336 -- # read -ra ver2 00:05:17.401 16:47:28 -- scripts/common.sh@337 -- # local 'op=<' 00:05:17.401 16:47:28 -- scripts/common.sh@339 -- # ver1_l=2 00:05:17.401 16:47:28 -- scripts/common.sh@340 -- # ver2_l=1 00:05:17.401 16:47:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:17.401 16:47:28 -- scripts/common.sh@343 -- # case "$op" in 00:05:17.401 16:47:28 -- scripts/common.sh@344 -- # : 1 00:05:17.401 16:47:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:17.401 16:47:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:17.401 16:47:28 -- scripts/common.sh@364 -- # decimal 1 00:05:17.401 16:47:28 -- scripts/common.sh@352 -- # local d=1 00:05:17.401 16:47:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:17.401 16:47:28 -- scripts/common.sh@354 -- # echo 1 00:05:17.401 16:47:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:17.401 16:47:28 -- scripts/common.sh@365 -- # decimal 2 00:05:17.401 16:47:28 -- scripts/common.sh@352 -- # local d=2 00:05:17.401 16:47:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:17.401 16:47:28 -- scripts/common.sh@354 -- # echo 2 00:05:17.401 16:47:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:17.401 16:47:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:17.401 16:47:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:17.401 16:47:28 -- scripts/common.sh@367 -- # return 0 00:05:17.401 16:47:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:17.401 16:47:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:17.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:17.401 --rc genhtml_branch_coverage=1 00:05:17.401 --rc genhtml_function_coverage=1 00:05:17.401 --rc genhtml_legend=1 00:05:17.401 --rc geninfo_all_blocks=1 00:05:17.401 --rc geninfo_unexecuted_blocks=1 00:05:17.401 00:05:17.401 ' 00:05:17.401 16:47:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:17.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:17.401 --rc genhtml_branch_coverage=1 00:05:17.401 --rc genhtml_function_coverage=1 00:05:17.401 --rc genhtml_legend=1 00:05:17.401 --rc geninfo_all_blocks=1 00:05:17.401 --rc geninfo_unexecuted_blocks=1 00:05:17.401 00:05:17.401 ' 00:05:17.401 16:47:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:17.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:17.401 --rc genhtml_branch_coverage=1 00:05:17.401 --rc genhtml_function_coverage=1 00:05:17.401 --rc genhtml_legend=1 00:05:17.401 --rc geninfo_all_blocks=1 00:05:17.401 --rc geninfo_unexecuted_blocks=1 00:05:17.401 00:05:17.401 ' 00:05:17.401 16:47:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:17.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:17.401 --rc genhtml_branch_coverage=1 00:05:17.401 --rc genhtml_function_coverage=1 00:05:17.401 --rc genhtml_legend=1 00:05:17.401 --rc geninfo_all_blocks=1 00:05:17.401 --rc geninfo_unexecuted_blocks=1 00:05:17.401 00:05:17.401 ' 00:05:17.401 16:47:28 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:17.401 16:47:28 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:17.401 16:47:28 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:17.401 16:47:28 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:17.401 16:47:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:17.401 16:47:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.401 16:47:28 -- common/autotest_common.sh@10 -- # set +x 00:05:17.401 ************************************ 00:05:17.401 START TEST default_locks 00:05:17.401 ************************************ 00:05:17.401 16:47:28 -- common/autotest_common.sh@1114 -- # default_locks 00:05:17.401 16:47:28 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=87589 00:05:17.401 16:47:28 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:17.401 16:47:28 -- event/cpu_locks.sh@47 -- # waitforlisten 87589 00:05:17.401 16:47:28 -- common/autotest_common.sh@829 -- # '[' -z 87589 ']' 00:05:17.401 16:47:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:17.401 16:47:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:17.401 16:47:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:17.401 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:17.401 16:47:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:17.401 16:47:28 -- common/autotest_common.sh@10 -- # set +x 00:05:17.401 [2024-11-29 16:47:28.665696] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.401 [2024-11-29 16:47:28.665780] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid87589 ] 00:05:17.401 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.401 [2024-11-29 16:47:28.726172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.660 [2024-11-29 16:47:28.840075] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:17.660 [2024-11-29 16:47:28.840241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.227 16:47:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.227 16:47:29 -- common/autotest_common.sh@862 -- # return 0 00:05:18.227 16:47:29 -- event/cpu_locks.sh@49 -- # locks_exist 87589 00:05:18.227 16:47:29 -- event/cpu_locks.sh@22 -- # lslocks -p 87589 00:05:18.227 16:47:29 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:18.485 lslocks: write error 00:05:18.485 16:47:29 -- event/cpu_locks.sh@50 -- # killprocess 87589 00:05:18.485 16:47:29 -- common/autotest_common.sh@936 -- # '[' -z 87589 ']' 00:05:18.485 16:47:29 -- common/autotest_common.sh@940 -- # kill -0 87589 00:05:18.485 16:47:29 -- common/autotest_common.sh@941 -- # uname 00:05:18.485 16:47:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:18.485 16:47:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 87589 00:05:18.743 16:47:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:18.743 16:47:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:18.744 16:47:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 87589' 00:05:18.744 killing process with pid 87589 00:05:18.744 16:47:29 -- common/autotest_common.sh@955 -- # kill 87589 00:05:18.744 16:47:29 -- common/autotest_common.sh@960 -- # wait 87589 00:05:19.002 16:47:30 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 87589 00:05:19.002 16:47:30 -- common/autotest_common.sh@650 -- # local es=0 00:05:19.002 16:47:30 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 87589 00:05:19.002 16:47:30 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:19.002 16:47:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:19.002 16:47:30 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:19.002 16:47:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:19.002 16:47:30 -- common/autotest_common.sh@653 -- # waitforlisten 87589 00:05:19.002 16:47:30 -- common/autotest_common.sh@829 -- # '[' -z 87589 ']' 00:05:19.002 16:47:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.002 16:47:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.002 16:47:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.002 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.002 16:47:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.002 16:47:30 -- common/autotest_common.sh@10 -- # set +x 00:05:19.002 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (87589) - No such process 00:05:19.002 ERROR: process (pid: 87589) is no longer running 00:05:19.002 16:47:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.002 16:47:30 -- common/autotest_common.sh@862 -- # return 1 00:05:19.002 16:47:30 -- common/autotest_common.sh@653 -- # es=1 00:05:19.002 16:47:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:19.002 16:47:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:19.002 16:47:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:19.002 16:47:30 -- event/cpu_locks.sh@54 -- # no_locks 00:05:19.002 16:47:30 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:19.002 16:47:30 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:19.002 16:47:30 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:19.002 00:05:19.002 real 0m1.761s 00:05:19.002 user 0m1.887s 00:05:19.002 sys 0m0.526s 00:05:19.002 16:47:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.003 16:47:30 -- common/autotest_common.sh@10 -- # set +x 00:05:19.003 ************************************ 00:05:19.003 END TEST default_locks 00:05:19.003 ************************************ 00:05:19.003 16:47:30 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:19.003 16:47:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.003 16:47:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.003 16:47:30 -- common/autotest_common.sh@10 -- # set +x 00:05:19.003 ************************************ 00:05:19.003 START TEST default_locks_via_rpc 00:05:19.003 ************************************ 00:05:19.003 16:47:30 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:19.003 16:47:30 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=87889 00:05:19.003 16:47:30 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:19.003 16:47:30 -- event/cpu_locks.sh@63 -- # waitforlisten 87889 00:05:19.003 16:47:30 -- common/autotest_common.sh@829 -- # '[' -z 87889 ']' 00:05:19.003 16:47:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.003 16:47:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.003 16:47:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.003 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.003 16:47:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.003 16:47:30 -- common/autotest_common.sh@10 -- # set +x 00:05:19.261 [2024-11-29 16:47:30.454038] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.261 [2024-11-29 16:47:30.454117] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid87889 ] 00:05:19.261 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.261 [2024-11-29 16:47:30.515002] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.261 [2024-11-29 16:47:30.626568] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:19.261 [2024-11-29 16:47:30.626746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.194 16:47:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.194 16:47:31 -- common/autotest_common.sh@862 -- # return 0 00:05:20.194 16:47:31 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:20.194 16:47:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.194 16:47:31 -- common/autotest_common.sh@10 -- # set +x 00:05:20.194 16:47:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.194 16:47:31 -- event/cpu_locks.sh@67 -- # no_locks 00:05:20.194 16:47:31 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:20.194 16:47:31 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:20.194 16:47:31 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:20.194 16:47:31 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:20.194 16:47:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.194 16:47:31 -- common/autotest_common.sh@10 -- # set +x 00:05:20.194 16:47:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.194 16:47:31 -- event/cpu_locks.sh@71 -- # locks_exist 87889 00:05:20.194 16:47:31 -- event/cpu_locks.sh@22 -- # lslocks -p 87889 00:05:20.194 16:47:31 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:20.452 16:47:31 -- event/cpu_locks.sh@73 -- # killprocess 87889 00:05:20.452 16:47:31 -- common/autotest_common.sh@936 -- # '[' -z 87889 ']' 00:05:20.452 16:47:31 -- common/autotest_common.sh@940 -- # kill -0 87889 00:05:20.452 16:47:31 -- common/autotest_common.sh@941 -- # uname 00:05:20.452 16:47:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.452 16:47:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 87889 00:05:20.710 16:47:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:20.710 16:47:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:20.710 16:47:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 87889' 00:05:20.710 killing process with pid 87889 00:05:20.710 16:47:31 -- common/autotest_common.sh@955 -- # kill 87889 00:05:20.710 16:47:31 -- common/autotest_common.sh@960 -- # wait 87889 00:05:20.969 00:05:20.969 real 0m1.967s 00:05:20.969 user 0m2.099s 00:05:20.969 sys 0m0.602s 00:05:20.969 16:47:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.969 16:47:32 -- common/autotest_common.sh@10 -- # set +x 00:05:20.969 ************************************ 00:05:20.969 END TEST default_locks_via_rpc 00:05:20.969 ************************************ 00:05:20.969 16:47:32 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:20.969 16:47:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:20.969 16:47:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.969 16:47:32 -- common/autotest_common.sh@10 -- # set +x 00:05:20.969 ************************************ 00:05:20.969 START TEST non_locking_app_on_locked_coremask 00:05:20.969 ************************************ 00:05:20.969 16:47:32 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:20.969 16:47:32 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=88089 00:05:20.969 16:47:32 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:20.969 16:47:32 -- event/cpu_locks.sh@81 -- # waitforlisten 88089 /var/tmp/spdk.sock 00:05:20.969 16:47:32 -- common/autotest_common.sh@829 -- # '[' -z 88089 ']' 00:05:20.969 16:47:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:20.969 16:47:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:20.969 16:47:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:20.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:20.969 16:47:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:20.969 16:47:32 -- common/autotest_common.sh@10 -- # set +x 00:05:21.241 [2024-11-29 16:47:32.446997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.241 [2024-11-29 16:47:32.447076] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88089 ] 00:05:21.241 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.241 [2024-11-29 16:47:32.510860] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.241 [2024-11-29 16:47:32.628832] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.241 [2024-11-29 16:47:32.629017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.175 16:47:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.175 16:47:33 -- common/autotest_common.sh@862 -- # return 0 00:05:22.175 16:47:33 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=88201 00:05:22.175 16:47:33 -- event/cpu_locks.sh@85 -- # waitforlisten 88201 /var/tmp/spdk2.sock 00:05:22.175 16:47:33 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:22.175 16:47:33 -- common/autotest_common.sh@829 -- # '[' -z 88201 ']' 00:05:22.175 16:47:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:22.175 16:47:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.175 16:47:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:22.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:22.175 16:47:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.175 16:47:33 -- common/autotest_common.sh@10 -- # set +x 00:05:22.175 [2024-11-29 16:47:33.451903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.175 [2024-11-29 16:47:33.451999] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88201 ] 00:05:22.175 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.175 [2024-11-29 16:47:33.545023] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:22.175 [2024-11-29 16:47:33.545056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.435 [2024-11-29 16:47:33.776045] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.435 [2024-11-29 16:47:33.776213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.001 16:47:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.001 16:47:34 -- common/autotest_common.sh@862 -- # return 0 00:05:23.001 16:47:34 -- event/cpu_locks.sh@87 -- # locks_exist 88089 00:05:23.001 16:47:34 -- event/cpu_locks.sh@22 -- # lslocks -p 88089 00:05:23.001 16:47:34 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:23.568 lslocks: write error 00:05:23.568 16:47:34 -- event/cpu_locks.sh@89 -- # killprocess 88089 00:05:23.568 16:47:34 -- common/autotest_common.sh@936 -- # '[' -z 88089 ']' 00:05:23.568 16:47:34 -- common/autotest_common.sh@940 -- # kill -0 88089 00:05:23.568 16:47:34 -- common/autotest_common.sh@941 -- # uname 00:05:23.568 16:47:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:23.568 16:47:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88089 00:05:23.827 16:47:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:23.827 16:47:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:23.827 16:47:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88089' 00:05:23.827 killing process with pid 88089 00:05:23.827 16:47:35 -- common/autotest_common.sh@955 -- # kill 88089 00:05:23.827 16:47:35 -- common/autotest_common.sh@960 -- # wait 88089 00:05:24.759 16:47:35 -- event/cpu_locks.sh@90 -- # killprocess 88201 00:05:24.759 16:47:35 -- common/autotest_common.sh@936 -- # '[' -z 88201 ']' 00:05:24.759 16:47:35 -- common/autotest_common.sh@940 -- # kill -0 88201 00:05:24.759 16:47:35 -- common/autotest_common.sh@941 -- # uname 00:05:24.759 16:47:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.759 16:47:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88201 00:05:24.759 16:47:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.759 16:47:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.759 16:47:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88201' 00:05:24.759 killing process with pid 88201 00:05:24.759 16:47:35 -- common/autotest_common.sh@955 -- # kill 88201 00:05:24.759 16:47:35 -- common/autotest_common.sh@960 -- # wait 88201 00:05:25.018 00:05:25.018 real 0m4.032s 00:05:25.018 user 0m4.403s 00:05:25.018 sys 0m1.104s 00:05:25.018 16:47:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.018 16:47:36 -- common/autotest_common.sh@10 -- # set +x 00:05:25.018 ************************************ 00:05:25.018 END TEST non_locking_app_on_locked_coremask 00:05:25.018 ************************************ 00:05:25.277 16:47:36 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:25.277 16:47:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:25.277 16:47:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.277 16:47:36 -- common/autotest_common.sh@10 -- # set +x 00:05:25.277 ************************************ 00:05:25.277 START TEST locking_app_on_unlocked_coremask 00:05:25.277 ************************************ 00:05:25.277 16:47:36 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:25.277 16:47:36 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=88642 00:05:25.277 16:47:36 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:25.277 16:47:36 -- event/cpu_locks.sh@99 -- # waitforlisten 88642 /var/tmp/spdk.sock 00:05:25.277 16:47:36 -- common/autotest_common.sh@829 -- # '[' -z 88642 ']' 00:05:25.277 16:47:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:25.277 16:47:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:25.277 16:47:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:25.277 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:25.277 16:47:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:25.277 16:47:36 -- common/autotest_common.sh@10 -- # set +x 00:05:25.277 [2024-11-29 16:47:36.507072] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.277 [2024-11-29 16:47:36.507150] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88642 ] 00:05:25.277 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.277 [2024-11-29 16:47:36.568047] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:25.277 [2024-11-29 16:47:36.568087] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.277 [2024-11-29 16:47:36.679642] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:25.277 [2024-11-29 16:47:36.679823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.212 16:47:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.212 16:47:37 -- common/autotest_common.sh@862 -- # return 0 00:05:26.212 16:47:37 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=88782 00:05:26.212 16:47:37 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:26.212 16:47:37 -- event/cpu_locks.sh@103 -- # waitforlisten 88782 /var/tmp/spdk2.sock 00:05:26.212 16:47:37 -- common/autotest_common.sh@829 -- # '[' -z 88782 ']' 00:05:26.212 16:47:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:26.212 16:47:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.212 16:47:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:26.212 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:26.212 16:47:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.212 16:47:37 -- common/autotest_common.sh@10 -- # set +x 00:05:26.213 [2024-11-29 16:47:37.486709] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.213 [2024-11-29 16:47:37.486787] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88782 ] 00:05:26.213 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.213 [2024-11-29 16:47:37.582616] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.472 [2024-11-29 16:47:37.814833] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:26.472 [2024-11-29 16:47:37.815020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.039 16:47:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:27.039 16:47:38 -- common/autotest_common.sh@862 -- # return 0 00:05:27.039 16:47:38 -- event/cpu_locks.sh@105 -- # locks_exist 88782 00:05:27.039 16:47:38 -- event/cpu_locks.sh@22 -- # lslocks -p 88782 00:05:27.039 16:47:38 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:27.606 lslocks: write error 00:05:27.606 16:47:38 -- event/cpu_locks.sh@107 -- # killprocess 88642 00:05:27.606 16:47:38 -- common/autotest_common.sh@936 -- # '[' -z 88642 ']' 00:05:27.606 16:47:38 -- common/autotest_common.sh@940 -- # kill -0 88642 00:05:27.606 16:47:38 -- common/autotest_common.sh@941 -- # uname 00:05:27.606 16:47:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.606 16:47:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88642 00:05:27.606 16:47:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:27.606 16:47:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:27.606 16:47:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88642' 00:05:27.606 killing process with pid 88642 00:05:27.606 16:47:38 -- common/autotest_common.sh@955 -- # kill 88642 00:05:27.606 16:47:38 -- common/autotest_common.sh@960 -- # wait 88642 00:05:28.543 16:47:39 -- event/cpu_locks.sh@108 -- # killprocess 88782 00:05:28.543 16:47:39 -- common/autotest_common.sh@936 -- # '[' -z 88782 ']' 00:05:28.543 16:47:39 -- common/autotest_common.sh@940 -- # kill -0 88782 00:05:28.544 16:47:39 -- common/autotest_common.sh@941 -- # uname 00:05:28.544 16:47:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:28.544 16:47:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88782 00:05:28.544 16:47:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:28.544 16:47:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:28.544 16:47:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88782' 00:05:28.544 killing process with pid 88782 00:05:28.544 16:47:39 -- common/autotest_common.sh@955 -- # kill 88782 00:05:28.544 16:47:39 -- common/autotest_common.sh@960 -- # wait 88782 00:05:29.111 00:05:29.111 real 0m3.948s 00:05:29.111 user 0m4.285s 00:05:29.111 sys 0m1.087s 00:05:29.111 16:47:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.111 16:47:40 -- common/autotest_common.sh@10 -- # set +x 00:05:29.111 ************************************ 00:05:29.111 END TEST locking_app_on_unlocked_coremask 00:05:29.111 ************************************ 00:05:29.111 16:47:40 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:29.111 16:47:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:29.111 16:47:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.111 16:47:40 -- common/autotest_common.sh@10 -- # set +x 00:05:29.111 ************************************ 00:05:29.111 START TEST locking_app_on_locked_coremask 00:05:29.111 ************************************ 00:05:29.111 16:47:40 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:29.111 16:47:40 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=89219 00:05:29.111 16:47:40 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:29.111 16:47:40 -- event/cpu_locks.sh@116 -- # waitforlisten 89219 /var/tmp/spdk.sock 00:05:29.111 16:47:40 -- common/autotest_common.sh@829 -- # '[' -z 89219 ']' 00:05:29.111 16:47:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:29.111 16:47:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:29.111 16:47:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:29.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:29.111 16:47:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:29.111 16:47:40 -- common/autotest_common.sh@10 -- # set +x 00:05:29.111 [2024-11-29 16:47:40.478428] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.111 [2024-11-29 16:47:40.478531] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89219 ] 00:05:29.111 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.111 [2024-11-29 16:47:40.541341] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.371 [2024-11-29 16:47:40.654787] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:29.371 [2024-11-29 16:47:40.654970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.308 16:47:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:30.308 16:47:41 -- common/autotest_common.sh@862 -- # return 0 00:05:30.308 16:47:41 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=89258 00:05:30.308 16:47:41 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:30.308 16:47:41 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 89258 /var/tmp/spdk2.sock 00:05:30.308 16:47:41 -- common/autotest_common.sh@650 -- # local es=0 00:05:30.308 16:47:41 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 89258 /var/tmp/spdk2.sock 00:05:30.308 16:47:41 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:30.308 16:47:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:30.308 16:47:41 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:30.308 16:47:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:30.308 16:47:41 -- common/autotest_common.sh@653 -- # waitforlisten 89258 /var/tmp/spdk2.sock 00:05:30.308 16:47:41 -- common/autotest_common.sh@829 -- # '[' -z 89258 ']' 00:05:30.308 16:47:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:30.308 16:47:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:30.308 16:47:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:30.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:30.308 16:47:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:30.308 16:47:41 -- common/autotest_common.sh@10 -- # set +x 00:05:30.308 [2024-11-29 16:47:41.472775] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.308 [2024-11-29 16:47:41.472861] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89258 ] 00:05:30.308 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.308 [2024-11-29 16:47:41.565625] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 89219 has claimed it. 00:05:30.308 [2024-11-29 16:47:41.565688] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:30.874 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (89258) - No such process 00:05:30.874 ERROR: process (pid: 89258) is no longer running 00:05:30.874 16:47:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:30.874 16:47:42 -- common/autotest_common.sh@862 -- # return 1 00:05:30.874 16:47:42 -- common/autotest_common.sh@653 -- # es=1 00:05:30.874 16:47:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:30.874 16:47:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:30.874 16:47:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:30.874 16:47:42 -- event/cpu_locks.sh@122 -- # locks_exist 89219 00:05:30.874 16:47:42 -- event/cpu_locks.sh@22 -- # lslocks -p 89219 00:05:30.874 16:47:42 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:31.441 lslocks: write error 00:05:31.441 16:47:42 -- event/cpu_locks.sh@124 -- # killprocess 89219 00:05:31.441 16:47:42 -- common/autotest_common.sh@936 -- # '[' -z 89219 ']' 00:05:31.441 16:47:42 -- common/autotest_common.sh@940 -- # kill -0 89219 00:05:31.441 16:47:42 -- common/autotest_common.sh@941 -- # uname 00:05:31.441 16:47:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:31.441 16:47:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89219 00:05:31.441 16:47:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:31.441 16:47:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:31.441 16:47:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89219' 00:05:31.441 killing process with pid 89219 00:05:31.441 16:47:42 -- common/autotest_common.sh@955 -- # kill 89219 00:05:31.441 16:47:42 -- common/autotest_common.sh@960 -- # wait 89219 00:05:31.700 00:05:31.700 real 0m2.644s 00:05:31.700 user 0m3.018s 00:05:31.700 sys 0m0.693s 00:05:31.700 16:47:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.700 16:47:43 -- common/autotest_common.sh@10 -- # set +x 00:05:31.700 ************************************ 00:05:31.700 END TEST locking_app_on_locked_coremask 00:05:31.700 ************************************ 00:05:31.700 16:47:43 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:31.700 16:47:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.700 16:47:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.700 16:47:43 -- common/autotest_common.sh@10 -- # set +x 00:05:31.700 ************************************ 00:05:31.700 START TEST locking_overlapped_coremask 00:05:31.700 ************************************ 00:05:31.700 16:47:43 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:31.700 16:47:43 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=89529 00:05:31.700 16:47:43 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:31.700 16:47:43 -- event/cpu_locks.sh@133 -- # waitforlisten 89529 /var/tmp/spdk.sock 00:05:31.700 16:47:43 -- common/autotest_common.sh@829 -- # '[' -z 89529 ']' 00:05:31.701 16:47:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:31.701 16:47:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:31.701 16:47:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:31.701 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:31.701 16:47:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:31.701 16:47:43 -- common/autotest_common.sh@10 -- # set +x 00:05:31.959 [2024-11-29 16:47:43.151402] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.960 [2024-11-29 16:47:43.151471] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89529 ] 00:05:31.960 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.960 [2024-11-29 16:47:43.208075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:31.960 [2024-11-29 16:47:43.316817] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:31.960 [2024-11-29 16:47:43.317036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:31.960 [2024-11-29 16:47:43.317100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:31.960 [2024-11-29 16:47:43.317103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.896 16:47:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.896 16:47:44 -- common/autotest_common.sh@862 -- # return 0 00:05:32.896 16:47:44 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=89673 00:05:32.896 16:47:44 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:32.896 16:47:44 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 89673 /var/tmp/spdk2.sock 00:05:32.896 16:47:44 -- common/autotest_common.sh@650 -- # local es=0 00:05:32.896 16:47:44 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 89673 /var/tmp/spdk2.sock 00:05:32.896 16:47:44 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:32.896 16:47:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:32.896 16:47:44 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:32.896 16:47:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:32.896 16:47:44 -- common/autotest_common.sh@653 -- # waitforlisten 89673 /var/tmp/spdk2.sock 00:05:32.896 16:47:44 -- common/autotest_common.sh@829 -- # '[' -z 89673 ']' 00:05:32.896 16:47:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:32.896 16:47:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:32.896 16:47:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:32.896 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:32.896 16:47:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:32.896 16:47:44 -- common/autotest_common.sh@10 -- # set +x 00:05:32.896 [2024-11-29 16:47:44.155661] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.896 [2024-11-29 16:47:44.155735] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89673 ] 00:05:32.896 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.896 [2024-11-29 16:47:44.243418] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 89529 has claimed it. 00:05:32.896 [2024-11-29 16:47:44.243467] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:33.462 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (89673) - No such process 00:05:33.462 ERROR: process (pid: 89673) is no longer running 00:05:33.462 16:47:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:33.462 16:47:44 -- common/autotest_common.sh@862 -- # return 1 00:05:33.462 16:47:44 -- common/autotest_common.sh@653 -- # es=1 00:05:33.462 16:47:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:33.462 16:47:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:33.462 16:47:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:33.462 16:47:44 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:33.462 16:47:44 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:33.462 16:47:44 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:33.462 16:47:44 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:33.462 16:47:44 -- event/cpu_locks.sh@141 -- # killprocess 89529 00:05:33.462 16:47:44 -- common/autotest_common.sh@936 -- # '[' -z 89529 ']' 00:05:33.462 16:47:44 -- common/autotest_common.sh@940 -- # kill -0 89529 00:05:33.462 16:47:44 -- common/autotest_common.sh@941 -- # uname 00:05:33.462 16:47:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:33.462 16:47:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89529 00:05:33.462 16:47:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:33.462 16:47:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:33.462 16:47:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89529' 00:05:33.462 killing process with pid 89529 00:05:33.462 16:47:44 -- common/autotest_common.sh@955 -- # kill 89529 00:05:33.462 16:47:44 -- common/autotest_common.sh@960 -- # wait 89529 00:05:34.027 00:05:34.027 real 0m2.224s 00:05:34.027 user 0m6.275s 00:05:34.027 sys 0m0.506s 00:05:34.027 16:47:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.027 16:47:45 -- common/autotest_common.sh@10 -- # set +x 00:05:34.028 ************************************ 00:05:34.028 END TEST locking_overlapped_coremask 00:05:34.028 ************************************ 00:05:34.028 16:47:45 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:34.028 16:47:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.028 16:47:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.028 16:47:45 -- common/autotest_common.sh@10 -- # set +x 00:05:34.028 ************************************ 00:05:34.028 START TEST locking_overlapped_coremask_via_rpc 00:05:34.028 ************************************ 00:05:34.028 16:47:45 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:34.028 16:47:45 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=89843 00:05:34.028 16:47:45 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:34.028 16:47:45 -- event/cpu_locks.sh@149 -- # waitforlisten 89843 /var/tmp/spdk.sock 00:05:34.028 16:47:45 -- common/autotest_common.sh@829 -- # '[' -z 89843 ']' 00:05:34.028 16:47:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.028 16:47:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:34.028 16:47:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.028 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.028 16:47:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:34.028 16:47:45 -- common/autotest_common.sh@10 -- # set +x 00:05:34.028 [2024-11-29 16:47:45.404434] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.028 [2024-11-29 16:47:45.404525] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89843 ] 00:05:34.028 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.288 [2024-11-29 16:47:45.462687] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:34.288 [2024-11-29 16:47:45.462725] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:34.288 [2024-11-29 16:47:45.571907] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.288 [2024-11-29 16:47:45.572117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:34.288 [2024-11-29 16:47:45.572178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:34.288 [2024-11-29 16:47:45.572181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.255 16:47:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:35.255 16:47:46 -- common/autotest_common.sh@862 -- # return 0 00:05:35.255 16:47:46 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=89985 00:05:35.255 16:47:46 -- event/cpu_locks.sh@153 -- # waitforlisten 89985 /var/tmp/spdk2.sock 00:05:35.255 16:47:46 -- common/autotest_common.sh@829 -- # '[' -z 89985 ']' 00:05:35.255 16:47:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:35.255 16:47:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:35.255 16:47:46 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:35.255 16:47:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:35.255 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:35.255 16:47:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:35.255 16:47:46 -- common/autotest_common.sh@10 -- # set +x 00:05:35.255 [2024-11-29 16:47:46.413075] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.255 [2024-11-29 16:47:46.413152] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89985 ] 00:05:35.255 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.255 [2024-11-29 16:47:46.495853] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:35.255 [2024-11-29 16:47:46.495885] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:35.513 [2024-11-29 16:47:46.717042] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:35.513 [2024-11-29 16:47:46.717260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:35.513 [2024-11-29 16:47:46.717306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:35.513 [2024-11-29 16:47:46.717308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:36.079 16:47:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:36.079 16:47:47 -- common/autotest_common.sh@862 -- # return 0 00:05:36.079 16:47:47 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:36.079 16:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:36.079 16:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:36.079 16:47:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:36.079 16:47:47 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:36.079 16:47:47 -- common/autotest_common.sh@650 -- # local es=0 00:05:36.079 16:47:47 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:36.079 16:47:47 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:36.079 16:47:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.079 16:47:47 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:36.079 16:47:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.079 16:47:47 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:36.079 16:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:36.079 16:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:36.079 [2024-11-29 16:47:47.393060] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 89843 has claimed it. 00:05:36.079 request: 00:05:36.079 { 00:05:36.079 "method": "framework_enable_cpumask_locks", 00:05:36.079 "req_id": 1 00:05:36.079 } 00:05:36.079 Got JSON-RPC error response 00:05:36.079 response: 00:05:36.079 { 00:05:36.079 "code": -32603, 00:05:36.079 "message": "Failed to claim CPU core: 2" 00:05:36.079 } 00:05:36.079 16:47:47 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:36.079 16:47:47 -- common/autotest_common.sh@653 -- # es=1 00:05:36.079 16:47:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.079 16:47:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:36.079 16:47:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.079 16:47:47 -- event/cpu_locks.sh@158 -- # waitforlisten 89843 /var/tmp/spdk.sock 00:05:36.079 16:47:47 -- common/autotest_common.sh@829 -- # '[' -z 89843 ']' 00:05:36.079 16:47:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:36.079 16:47:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:36.079 16:47:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:36.079 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:36.079 16:47:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:36.079 16:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:36.337 16:47:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:36.337 16:47:47 -- common/autotest_common.sh@862 -- # return 0 00:05:36.337 16:47:47 -- event/cpu_locks.sh@159 -- # waitforlisten 89985 /var/tmp/spdk2.sock 00:05:36.337 16:47:47 -- common/autotest_common.sh@829 -- # '[' -z 89985 ']' 00:05:36.337 16:47:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:36.337 16:47:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:36.337 16:47:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:36.337 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:36.337 16:47:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:36.337 16:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:36.595 16:47:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:36.595 16:47:47 -- common/autotest_common.sh@862 -- # return 0 00:05:36.595 16:47:47 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:36.595 16:47:47 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:36.595 16:47:47 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:36.595 16:47:47 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:36.595 00:05:36.595 real 0m2.525s 00:05:36.595 user 0m1.249s 00:05:36.595 sys 0m0.205s 00:05:36.595 16:47:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.595 16:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:36.595 ************************************ 00:05:36.595 END TEST locking_overlapped_coremask_via_rpc 00:05:36.595 ************************************ 00:05:36.595 16:47:47 -- event/cpu_locks.sh@174 -- # cleanup 00:05:36.595 16:47:47 -- event/cpu_locks.sh@15 -- # [[ -z 89843 ]] 00:05:36.595 16:47:47 -- event/cpu_locks.sh@15 -- # killprocess 89843 00:05:36.595 16:47:47 -- common/autotest_common.sh@936 -- # '[' -z 89843 ']' 00:05:36.595 16:47:47 -- common/autotest_common.sh@940 -- # kill -0 89843 00:05:36.595 16:47:47 -- common/autotest_common.sh@941 -- # uname 00:05:36.595 16:47:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:36.595 16:47:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89843 00:05:36.595 16:47:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:36.595 16:47:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:36.595 16:47:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89843' 00:05:36.595 killing process with pid 89843 00:05:36.595 16:47:47 -- common/autotest_common.sh@955 -- # kill 89843 00:05:36.595 16:47:47 -- common/autotest_common.sh@960 -- # wait 89843 00:05:37.159 16:47:48 -- event/cpu_locks.sh@16 -- # [[ -z 89985 ]] 00:05:37.159 16:47:48 -- event/cpu_locks.sh@16 -- # killprocess 89985 00:05:37.159 16:47:48 -- common/autotest_common.sh@936 -- # '[' -z 89985 ']' 00:05:37.159 16:47:48 -- common/autotest_common.sh@940 -- # kill -0 89985 00:05:37.159 16:47:48 -- common/autotest_common.sh@941 -- # uname 00:05:37.159 16:47:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:37.159 16:47:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89985 00:05:37.159 16:47:48 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:37.159 16:47:48 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:37.159 16:47:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89985' 00:05:37.159 killing process with pid 89985 00:05:37.159 16:47:48 -- common/autotest_common.sh@955 -- # kill 89985 00:05:37.159 16:47:48 -- common/autotest_common.sh@960 -- # wait 89985 00:05:37.725 16:47:48 -- event/cpu_locks.sh@18 -- # rm -f 00:05:37.725 16:47:48 -- event/cpu_locks.sh@1 -- # cleanup 00:05:37.725 16:47:48 -- event/cpu_locks.sh@15 -- # [[ -z 89843 ]] 00:05:37.725 16:47:48 -- event/cpu_locks.sh@15 -- # killprocess 89843 00:05:37.725 16:47:48 -- common/autotest_common.sh@936 -- # '[' -z 89843 ']' 00:05:37.725 16:47:48 -- common/autotest_common.sh@940 -- # kill -0 89843 00:05:37.725 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (89843) - No such process 00:05:37.725 16:47:48 -- common/autotest_common.sh@963 -- # echo 'Process with pid 89843 is not found' 00:05:37.725 Process with pid 89843 is not found 00:05:37.725 16:47:48 -- event/cpu_locks.sh@16 -- # [[ -z 89985 ]] 00:05:37.725 16:47:48 -- event/cpu_locks.sh@16 -- # killprocess 89985 00:05:37.725 16:47:48 -- common/autotest_common.sh@936 -- # '[' -z 89985 ']' 00:05:37.725 16:47:48 -- common/autotest_common.sh@940 -- # kill -0 89985 00:05:37.725 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (89985) - No such process 00:05:37.725 16:47:48 -- common/autotest_common.sh@963 -- # echo 'Process with pid 89985 is not found' 00:05:37.725 Process with pid 89985 is not found 00:05:37.725 16:47:48 -- event/cpu_locks.sh@18 -- # rm -f 00:05:37.725 00:05:37.725 real 0m20.400s 00:05:37.725 user 0m35.880s 00:05:37.725 sys 0m5.571s 00:05:37.725 16:47:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.725 16:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:37.725 ************************************ 00:05:37.725 END TEST cpu_locks 00:05:37.725 ************************************ 00:05:37.725 00:05:37.725 real 0m47.310s 00:05:37.725 user 1m29.526s 00:05:37.725 sys 0m9.449s 00:05:37.725 16:47:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.725 16:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:37.725 ************************************ 00:05:37.725 END TEST event 00:05:37.725 ************************************ 00:05:37.725 16:47:48 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:37.725 16:47:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:37.725 16:47:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.725 16:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:37.725 ************************************ 00:05:37.725 START TEST thread 00:05:37.725 ************************************ 00:05:37.725 16:47:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:37.725 * Looking for test storage... 00:05:37.725 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:37.725 16:47:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:37.725 16:47:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:37.725 16:47:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:37.725 16:47:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:37.725 16:47:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:37.725 16:47:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:37.725 16:47:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:37.725 16:47:49 -- scripts/common.sh@335 -- # IFS=.-: 00:05:37.725 16:47:49 -- scripts/common.sh@335 -- # read -ra ver1 00:05:37.725 16:47:49 -- scripts/common.sh@336 -- # IFS=.-: 00:05:37.725 16:47:49 -- scripts/common.sh@336 -- # read -ra ver2 00:05:37.725 16:47:49 -- scripts/common.sh@337 -- # local 'op=<' 00:05:37.725 16:47:49 -- scripts/common.sh@339 -- # ver1_l=2 00:05:37.725 16:47:49 -- scripts/common.sh@340 -- # ver2_l=1 00:05:37.725 16:47:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:37.725 16:47:49 -- scripts/common.sh@343 -- # case "$op" in 00:05:37.725 16:47:49 -- scripts/common.sh@344 -- # : 1 00:05:37.725 16:47:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:37.725 16:47:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:37.725 16:47:49 -- scripts/common.sh@364 -- # decimal 1 00:05:37.725 16:47:49 -- scripts/common.sh@352 -- # local d=1 00:05:37.725 16:47:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:37.725 16:47:49 -- scripts/common.sh@354 -- # echo 1 00:05:37.725 16:47:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:37.725 16:47:49 -- scripts/common.sh@365 -- # decimal 2 00:05:37.725 16:47:49 -- scripts/common.sh@352 -- # local d=2 00:05:37.725 16:47:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:37.725 16:47:49 -- scripts/common.sh@354 -- # echo 2 00:05:37.726 16:47:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:37.726 16:47:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:37.726 16:47:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:37.726 16:47:49 -- scripts/common.sh@367 -- # return 0 00:05:37.726 16:47:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:37.726 16:47:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:37.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.726 --rc genhtml_branch_coverage=1 00:05:37.726 --rc genhtml_function_coverage=1 00:05:37.726 --rc genhtml_legend=1 00:05:37.726 --rc geninfo_all_blocks=1 00:05:37.726 --rc geninfo_unexecuted_blocks=1 00:05:37.726 00:05:37.726 ' 00:05:37.726 16:47:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:37.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.726 --rc genhtml_branch_coverage=1 00:05:37.726 --rc genhtml_function_coverage=1 00:05:37.726 --rc genhtml_legend=1 00:05:37.726 --rc geninfo_all_blocks=1 00:05:37.726 --rc geninfo_unexecuted_blocks=1 00:05:37.726 00:05:37.726 ' 00:05:37.726 16:47:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:37.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.726 --rc genhtml_branch_coverage=1 00:05:37.726 --rc genhtml_function_coverage=1 00:05:37.726 --rc genhtml_legend=1 00:05:37.726 --rc geninfo_all_blocks=1 00:05:37.726 --rc geninfo_unexecuted_blocks=1 00:05:37.726 00:05:37.726 ' 00:05:37.726 16:47:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:37.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.726 --rc genhtml_branch_coverage=1 00:05:37.726 --rc genhtml_function_coverage=1 00:05:37.726 --rc genhtml_legend=1 00:05:37.726 --rc geninfo_all_blocks=1 00:05:37.726 --rc geninfo_unexecuted_blocks=1 00:05:37.726 00:05:37.726 ' 00:05:37.726 16:47:49 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:37.726 16:47:49 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:37.726 16:47:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.726 16:47:49 -- common/autotest_common.sh@10 -- # set +x 00:05:37.726 ************************************ 00:05:37.726 START TEST thread_poller_perf 00:05:37.726 ************************************ 00:05:37.726 16:47:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:37.726 [2024-11-29 16:47:49.074736] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.726 [2024-11-29 16:47:49.074822] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90375 ] 00:05:37.726 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.726 [2024-11-29 16:47:49.132120] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.984 [2024-11-29 16:47:49.243633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.984 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:39.356 [2024-11-29T15:47:50.787Z] ====================================== 00:05:39.356 [2024-11-29T15:47:50.787Z] busy:2716260784 (cyc) 00:05:39.356 [2024-11-29T15:47:50.787Z] total_run_count: 280000 00:05:39.356 [2024-11-29T15:47:50.787Z] tsc_hz: 2700000000 (cyc) 00:05:39.356 [2024-11-29T15:47:50.787Z] ====================================== 00:05:39.356 [2024-11-29T15:47:50.787Z] poller_cost: 9700 (cyc), 3592 (nsec) 00:05:39.356 00:05:39.356 real 0m1.313s 00:05:39.356 user 0m1.229s 00:05:39.356 sys 0m0.078s 00:05:39.356 16:47:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.356 16:47:50 -- common/autotest_common.sh@10 -- # set +x 00:05:39.356 ************************************ 00:05:39.356 END TEST thread_poller_perf 00:05:39.356 ************************************ 00:05:39.356 16:47:50 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:39.356 16:47:50 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:39.356 16:47:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.356 16:47:50 -- common/autotest_common.sh@10 -- # set +x 00:05:39.356 ************************************ 00:05:39.356 START TEST thread_poller_perf 00:05:39.356 ************************************ 00:05:39.356 16:47:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:39.356 [2024-11-29 16:47:50.420476] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.356 [2024-11-29 16:47:50.420563] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90537 ] 00:05:39.356 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.356 [2024-11-29 16:47:50.485750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.356 [2024-11-29 16:47:50.601866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.356 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:40.289 [2024-11-29T15:47:51.720Z] ====================================== 00:05:40.289 [2024-11-29T15:47:51.720Z] busy:2703548941 (cyc) 00:05:40.289 [2024-11-29T15:47:51.720Z] total_run_count: 3828000 00:05:40.289 [2024-11-29T15:47:51.720Z] tsc_hz: 2700000000 (cyc) 00:05:40.289 [2024-11-29T15:47:51.720Z] ====================================== 00:05:40.289 [2024-11-29T15:47:51.720Z] poller_cost: 706 (cyc), 261 (nsec) 00:05:40.547 00:05:40.547 real 0m1.315s 00:05:40.548 user 0m1.223s 00:05:40.548 sys 0m0.085s 00:05:40.548 16:47:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.548 16:47:51 -- common/autotest_common.sh@10 -- # set +x 00:05:40.548 ************************************ 00:05:40.548 END TEST thread_poller_perf 00:05:40.548 ************************************ 00:05:40.548 16:47:51 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:40.548 00:05:40.548 real 0m2.816s 00:05:40.548 user 0m2.568s 00:05:40.548 sys 0m0.251s 00:05:40.548 16:47:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.548 16:47:51 -- common/autotest_common.sh@10 -- # set +x 00:05:40.548 ************************************ 00:05:40.548 END TEST thread 00:05:40.548 ************************************ 00:05:40.548 16:47:51 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:40.548 16:47:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.548 16:47:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.548 16:47:51 -- common/autotest_common.sh@10 -- # set +x 00:05:40.548 ************************************ 00:05:40.548 START TEST accel 00:05:40.548 ************************************ 00:05:40.548 16:47:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:40.548 * Looking for test storage... 00:05:40.548 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:40.548 16:47:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:40.548 16:47:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:40.548 16:47:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:40.548 16:47:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:40.548 16:47:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:40.548 16:47:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:40.548 16:47:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:40.548 16:47:51 -- scripts/common.sh@335 -- # IFS=.-: 00:05:40.548 16:47:51 -- scripts/common.sh@335 -- # read -ra ver1 00:05:40.548 16:47:51 -- scripts/common.sh@336 -- # IFS=.-: 00:05:40.548 16:47:51 -- scripts/common.sh@336 -- # read -ra ver2 00:05:40.548 16:47:51 -- scripts/common.sh@337 -- # local 'op=<' 00:05:40.548 16:47:51 -- scripts/common.sh@339 -- # ver1_l=2 00:05:40.548 16:47:51 -- scripts/common.sh@340 -- # ver2_l=1 00:05:40.548 16:47:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:40.548 16:47:51 -- scripts/common.sh@343 -- # case "$op" in 00:05:40.548 16:47:51 -- scripts/common.sh@344 -- # : 1 00:05:40.548 16:47:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:40.548 16:47:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:40.548 16:47:51 -- scripts/common.sh@364 -- # decimal 1 00:05:40.548 16:47:51 -- scripts/common.sh@352 -- # local d=1 00:05:40.548 16:47:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:40.548 16:47:51 -- scripts/common.sh@354 -- # echo 1 00:05:40.548 16:47:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:40.548 16:47:51 -- scripts/common.sh@365 -- # decimal 2 00:05:40.548 16:47:51 -- scripts/common.sh@352 -- # local d=2 00:05:40.548 16:47:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:40.548 16:47:51 -- scripts/common.sh@354 -- # echo 2 00:05:40.548 16:47:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:40.548 16:47:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:40.548 16:47:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:40.548 16:47:51 -- scripts/common.sh@367 -- # return 0 00:05:40.548 16:47:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:40.548 16:47:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:40.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.548 --rc genhtml_branch_coverage=1 00:05:40.548 --rc genhtml_function_coverage=1 00:05:40.548 --rc genhtml_legend=1 00:05:40.548 --rc geninfo_all_blocks=1 00:05:40.548 --rc geninfo_unexecuted_blocks=1 00:05:40.548 00:05:40.548 ' 00:05:40.548 16:47:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:40.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.548 --rc genhtml_branch_coverage=1 00:05:40.548 --rc genhtml_function_coverage=1 00:05:40.548 --rc genhtml_legend=1 00:05:40.548 --rc geninfo_all_blocks=1 00:05:40.548 --rc geninfo_unexecuted_blocks=1 00:05:40.548 00:05:40.548 ' 00:05:40.548 16:47:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:40.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.548 --rc genhtml_branch_coverage=1 00:05:40.548 --rc genhtml_function_coverage=1 00:05:40.548 --rc genhtml_legend=1 00:05:40.548 --rc geninfo_all_blocks=1 00:05:40.548 --rc geninfo_unexecuted_blocks=1 00:05:40.548 00:05:40.548 ' 00:05:40.548 16:47:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:40.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.548 --rc genhtml_branch_coverage=1 00:05:40.548 --rc genhtml_function_coverage=1 00:05:40.548 --rc genhtml_legend=1 00:05:40.548 --rc geninfo_all_blocks=1 00:05:40.548 --rc geninfo_unexecuted_blocks=1 00:05:40.548 00:05:40.548 ' 00:05:40.548 16:47:51 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:40.548 16:47:51 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:40.548 16:47:51 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:40.548 16:47:51 -- accel/accel.sh@59 -- # spdk_tgt_pid=90865 00:05:40.548 16:47:51 -- accel/accel.sh@60 -- # waitforlisten 90865 00:05:40.548 16:47:51 -- common/autotest_common.sh@829 -- # '[' -z 90865 ']' 00:05:40.548 16:47:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:40.548 16:47:51 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:40.548 16:47:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:40.548 16:47:51 -- accel/accel.sh@58 -- # build_accel_config 00:05:40.548 16:47:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:40.548 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:40.548 16:47:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:40.548 16:47:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.548 16:47:51 -- common/autotest_common.sh@10 -- # set +x 00:05:40.548 16:47:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.548 16:47:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.548 16:47:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.548 16:47:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.548 16:47:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.548 16:47:51 -- accel/accel.sh@42 -- # jq -r . 00:05:40.548 [2024-11-29 16:47:51.935382] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.548 [2024-11-29 16:47:51.935460] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90865 ] 00:05:40.548 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.808 [2024-11-29 16:47:51.994331] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.808 [2024-11-29 16:47:52.109011] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:40.808 [2024-11-29 16:47:52.109185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.744 16:47:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:41.744 16:47:52 -- common/autotest_common.sh@862 -- # return 0 00:05:41.744 16:47:52 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:41.744 16:47:52 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:41.744 16:47:52 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:41.744 16:47:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.744 16:47:52 -- common/autotest_common.sh@10 -- # set +x 00:05:41.745 16:47:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # IFS== 00:05:41.745 16:47:52 -- accel/accel.sh@64 -- # read -r opc module 00:05:41.745 16:47:52 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:41.745 16:47:52 -- accel/accel.sh@67 -- # killprocess 90865 00:05:41.745 16:47:52 -- common/autotest_common.sh@936 -- # '[' -z 90865 ']' 00:05:41.745 16:47:52 -- common/autotest_common.sh@940 -- # kill -0 90865 00:05:41.745 16:47:52 -- common/autotest_common.sh@941 -- # uname 00:05:41.745 16:47:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:41.745 16:47:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 90865 00:05:41.745 16:47:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:41.745 16:47:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:41.745 16:47:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 90865' 00:05:41.745 killing process with pid 90865 00:05:41.745 16:47:52 -- common/autotest_common.sh@955 -- # kill 90865 00:05:41.745 16:47:52 -- common/autotest_common.sh@960 -- # wait 90865 00:05:42.313 16:47:53 -- accel/accel.sh@68 -- # trap - ERR 00:05:42.313 16:47:53 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:42.313 16:47:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:42.313 16:47:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.313 16:47:53 -- common/autotest_common.sh@10 -- # set +x 00:05:42.313 16:47:53 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:42.313 16:47:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:42.313 16:47:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.313 16:47:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.313 16:47:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.313 16:47:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.313 16:47:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.313 16:47:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.313 16:47:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.313 16:47:53 -- accel/accel.sh@42 -- # jq -r . 00:05:42.313 16:47:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.313 16:47:53 -- common/autotest_common.sh@10 -- # set +x 00:05:42.313 16:47:53 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:42.313 16:47:53 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:42.313 16:47:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.313 16:47:53 -- common/autotest_common.sh@10 -- # set +x 00:05:42.313 ************************************ 00:05:42.313 START TEST accel_missing_filename 00:05:42.313 ************************************ 00:05:42.313 16:47:53 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:42.313 16:47:53 -- common/autotest_common.sh@650 -- # local es=0 00:05:42.313 16:47:53 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:42.313 16:47:53 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:42.313 16:47:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:42.313 16:47:53 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:42.313 16:47:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:42.313 16:47:53 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:42.313 16:47:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:42.313 16:47:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.313 16:47:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.313 16:47:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.313 16:47:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.313 16:47:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.313 16:47:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.313 16:47:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.313 16:47:53 -- accel/accel.sh@42 -- # jq -r . 00:05:42.313 [2024-11-29 16:47:53.521923] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.313 [2024-11-29 16:47:53.522034] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91044 ] 00:05:42.313 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.313 [2024-11-29 16:47:53.584199] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.313 [2024-11-29 16:47:53.700078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.574 [2024-11-29 16:47:53.761955] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:42.574 [2024-11-29 16:47:53.847324] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:42.574 A filename is required. 00:05:42.574 16:47:53 -- common/autotest_common.sh@653 -- # es=234 00:05:42.574 16:47:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:42.574 16:47:53 -- common/autotest_common.sh@662 -- # es=106 00:05:42.574 16:47:53 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:42.574 16:47:53 -- common/autotest_common.sh@670 -- # es=1 00:05:42.574 16:47:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:42.574 00:05:42.574 real 0m0.464s 00:05:42.574 user 0m0.349s 00:05:42.574 sys 0m0.148s 00:05:42.574 16:47:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.574 16:47:53 -- common/autotest_common.sh@10 -- # set +x 00:05:42.574 ************************************ 00:05:42.574 END TEST accel_missing_filename 00:05:42.574 ************************************ 00:05:42.574 16:47:53 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:42.574 16:47:53 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:42.574 16:47:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.574 16:47:53 -- common/autotest_common.sh@10 -- # set +x 00:05:42.574 ************************************ 00:05:42.574 START TEST accel_compress_verify 00:05:42.574 ************************************ 00:05:42.574 16:47:53 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:42.574 16:47:53 -- common/autotest_common.sh@650 -- # local es=0 00:05:42.574 16:47:53 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:42.574 16:47:53 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:42.574 16:47:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:42.574 16:47:53 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:42.574 16:47:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:42.574 16:47:53 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:42.574 16:47:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:42.574 16:47:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.574 16:47:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.574 16:47:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.574 16:47:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.574 16:47:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.574 16:47:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.574 16:47:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.574 16:47:53 -- accel/accel.sh@42 -- # jq -r . 00:05:42.832 [2024-11-29 16:47:54.008528] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.832 [2024-11-29 16:47:54.008605] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91186 ] 00:05:42.832 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.832 [2024-11-29 16:47:54.069091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.832 [2024-11-29 16:47:54.183721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.832 [2024-11-29 16:47:54.243674] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:43.091 [2024-11-29 16:47:54.326309] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:43.091 00:05:43.091 Compression does not support the verify option, aborting. 00:05:43.091 16:47:54 -- common/autotest_common.sh@653 -- # es=161 00:05:43.091 16:47:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:43.091 16:47:54 -- common/autotest_common.sh@662 -- # es=33 00:05:43.091 16:47:54 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:43.091 16:47:54 -- common/autotest_common.sh@670 -- # es=1 00:05:43.091 16:47:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:43.091 00:05:43.091 real 0m0.460s 00:05:43.091 user 0m0.358s 00:05:43.091 sys 0m0.137s 00:05:43.091 16:47:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.091 16:47:54 -- common/autotest_common.sh@10 -- # set +x 00:05:43.091 ************************************ 00:05:43.091 END TEST accel_compress_verify 00:05:43.091 ************************************ 00:05:43.091 16:47:54 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:43.091 16:47:54 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:43.091 16:47:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.091 16:47:54 -- common/autotest_common.sh@10 -- # set +x 00:05:43.091 ************************************ 00:05:43.091 START TEST accel_wrong_workload 00:05:43.091 ************************************ 00:05:43.091 16:47:54 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:43.091 16:47:54 -- common/autotest_common.sh@650 -- # local es=0 00:05:43.091 16:47:54 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:43.091 16:47:54 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:43.091 16:47:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:43.091 16:47:54 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:43.091 16:47:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:43.091 16:47:54 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:43.091 16:47:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:43.091 16:47:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.091 16:47:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.091 16:47:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.091 16:47:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.091 16:47:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.091 16:47:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.091 16:47:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.091 16:47:54 -- accel/accel.sh@42 -- # jq -r . 00:05:43.091 Unsupported workload type: foobar 00:05:43.091 [2024-11-29 16:47:54.488334] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:43.091 accel_perf options: 00:05:43.091 [-h help message] 00:05:43.091 [-q queue depth per core] 00:05:43.091 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:43.091 [-T number of threads per core 00:05:43.091 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:43.091 [-t time in seconds] 00:05:43.091 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:43.091 [ dif_verify, , dif_generate, dif_generate_copy 00:05:43.091 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:43.091 [-l for compress/decompress workloads, name of uncompressed input file 00:05:43.091 [-S for crc32c workload, use this seed value (default 0) 00:05:43.091 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:43.091 [-f for fill workload, use this BYTE value (default 255) 00:05:43.091 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:43.091 [-y verify result if this switch is on] 00:05:43.091 [-a tasks to allocate per core (default: same value as -q)] 00:05:43.091 Can be used to spread operations across a wider range of memory. 00:05:43.091 16:47:54 -- common/autotest_common.sh@653 -- # es=1 00:05:43.091 16:47:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:43.091 16:47:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:43.091 16:47:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:43.091 00:05:43.091 real 0m0.020s 00:05:43.091 user 0m0.010s 00:05:43.091 sys 0m0.009s 00:05:43.091 16:47:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.091 16:47:54 -- common/autotest_common.sh@10 -- # set +x 00:05:43.091 ************************************ 00:05:43.091 END TEST accel_wrong_workload 00:05:43.091 ************************************ 00:05:43.091 Error: writing output failed: Broken pipe 00:05:43.091 16:47:54 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:43.091 16:47:54 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:43.091 16:47:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.091 16:47:54 -- common/autotest_common.sh@10 -- # set +x 00:05:43.091 ************************************ 00:05:43.091 START TEST accel_negative_buffers 00:05:43.091 ************************************ 00:05:43.091 16:47:54 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:43.091 16:47:54 -- common/autotest_common.sh@650 -- # local es=0 00:05:43.091 16:47:54 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:43.091 16:47:54 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:43.091 16:47:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:43.091 16:47:54 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:43.350 16:47:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:43.350 16:47:54 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:43.350 16:47:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:43.350 16:47:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.350 16:47:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.350 16:47:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.350 16:47:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.350 16:47:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.350 16:47:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.350 16:47:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.350 16:47:54 -- accel/accel.sh@42 -- # jq -r . 00:05:43.350 -x option must be non-negative. 00:05:43.350 [2024-11-29 16:47:54.537673] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:43.350 accel_perf options: 00:05:43.350 [-h help message] 00:05:43.350 [-q queue depth per core] 00:05:43.350 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:43.350 [-T number of threads per core 00:05:43.350 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:43.350 [-t time in seconds] 00:05:43.350 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:43.350 [ dif_verify, , dif_generate, dif_generate_copy 00:05:43.350 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:43.350 [-l for compress/decompress workloads, name of uncompressed input file 00:05:43.350 [-S for crc32c workload, use this seed value (default 0) 00:05:43.350 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:43.350 [-f for fill workload, use this BYTE value (default 255) 00:05:43.350 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:43.350 [-y verify result if this switch is on] 00:05:43.350 [-a tasks to allocate per core (default: same value as -q)] 00:05:43.350 Can be used to spread operations across a wider range of memory. 00:05:43.350 16:47:54 -- common/autotest_common.sh@653 -- # es=1 00:05:43.350 16:47:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:43.350 16:47:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:43.350 16:47:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:43.350 00:05:43.350 real 0m0.024s 00:05:43.350 user 0m0.013s 00:05:43.350 sys 0m0.011s 00:05:43.350 16:47:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.350 16:47:54 -- common/autotest_common.sh@10 -- # set +x 00:05:43.350 ************************************ 00:05:43.350 END TEST accel_negative_buffers 00:05:43.350 ************************************ 00:05:43.350 Error: writing output failed: Broken pipe 00:05:43.350 16:47:54 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:43.350 16:47:54 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:43.350 16:47:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.350 16:47:54 -- common/autotest_common.sh@10 -- # set +x 00:05:43.350 ************************************ 00:05:43.350 START TEST accel_crc32c 00:05:43.350 ************************************ 00:05:43.350 16:47:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:43.350 16:47:54 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.350 16:47:54 -- accel/accel.sh@17 -- # local accel_module 00:05:43.350 16:47:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:43.350 16:47:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:43.350 16:47:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.350 16:47:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.350 16:47:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.350 16:47:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.350 16:47:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.350 16:47:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.350 16:47:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.350 16:47:54 -- accel/accel.sh@42 -- # jq -r . 00:05:43.350 [2024-11-29 16:47:54.584231] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.350 [2024-11-29 16:47:54.584293] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91251 ] 00:05:43.350 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.350 [2024-11-29 16:47:54.646876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.350 [2024-11-29 16:47:54.762759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.725 16:47:56 -- accel/accel.sh@18 -- # out=' 00:05:44.725 SPDK Configuration: 00:05:44.725 Core mask: 0x1 00:05:44.725 00:05:44.725 Accel Perf Configuration: 00:05:44.725 Workload Type: crc32c 00:05:44.725 CRC-32C seed: 32 00:05:44.725 Transfer size: 4096 bytes 00:05:44.725 Vector count 1 00:05:44.725 Module: software 00:05:44.725 Queue depth: 32 00:05:44.725 Allocate depth: 32 00:05:44.725 # threads/core: 1 00:05:44.725 Run time: 1 seconds 00:05:44.725 Verify: Yes 00:05:44.725 00:05:44.725 Running for 1 seconds... 00:05:44.725 00:05:44.725 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:44.725 ------------------------------------------------------------------------------------ 00:05:44.725 0,0 406496/s 1587 MiB/s 0 0 00:05:44.725 ==================================================================================== 00:05:44.725 Total 406496/s 1587 MiB/s 0 0' 00:05:44.725 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.725 16:47:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:44.725 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.725 16:47:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:44.725 16:47:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.725 16:47:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.725 16:47:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.725 16:47:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.725 16:47:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.725 16:47:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.725 16:47:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.725 16:47:56 -- accel/accel.sh@42 -- # jq -r . 00:05:44.725 [2024-11-29 16:47:56.051691] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.725 [2024-11-29 16:47:56.051782] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91391 ] 00:05:44.725 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.725 [2024-11-29 16:47:56.112951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.984 [2024-11-29 16:47:56.227490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val= 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val= 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val=0x1 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val= 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val= 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val=crc32c 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val=32 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val= 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val=software 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val=32 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val=32 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val=1 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val=Yes 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val= 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:44.984 16:47:56 -- accel/accel.sh@21 -- # val= 00:05:44.984 16:47:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # IFS=: 00:05:44.984 16:47:56 -- accel/accel.sh@20 -- # read -r var val 00:05:46.358 16:47:57 -- accel/accel.sh@21 -- # val= 00:05:46.358 16:47:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # IFS=: 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # read -r var val 00:05:46.358 16:47:57 -- accel/accel.sh@21 -- # val= 00:05:46.358 16:47:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # IFS=: 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # read -r var val 00:05:46.358 16:47:57 -- accel/accel.sh@21 -- # val= 00:05:46.358 16:47:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # IFS=: 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # read -r var val 00:05:46.358 16:47:57 -- accel/accel.sh@21 -- # val= 00:05:46.358 16:47:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # IFS=: 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # read -r var val 00:05:46.358 16:47:57 -- accel/accel.sh@21 -- # val= 00:05:46.358 16:47:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # IFS=: 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # read -r var val 00:05:46.358 16:47:57 -- accel/accel.sh@21 -- # val= 00:05:46.358 16:47:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # IFS=: 00:05:46.358 16:47:57 -- accel/accel.sh@20 -- # read -r var val 00:05:46.358 16:47:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.358 16:47:57 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:46.358 16:47:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.358 00:05:46.358 real 0m2.925s 00:05:46.358 user 0m2.632s 00:05:46.358 sys 0m0.285s 00:05:46.358 16:47:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.358 16:47:57 -- common/autotest_common.sh@10 -- # set +x 00:05:46.358 ************************************ 00:05:46.358 END TEST accel_crc32c 00:05:46.358 ************************************ 00:05:46.358 16:47:57 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:46.358 16:47:57 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:46.358 16:47:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.358 16:47:57 -- common/autotest_common.sh@10 -- # set +x 00:05:46.358 ************************************ 00:05:46.358 START TEST accel_crc32c_C2 00:05:46.358 ************************************ 00:05:46.358 16:47:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:46.358 16:47:57 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.358 16:47:57 -- accel/accel.sh@17 -- # local accel_module 00:05:46.358 16:47:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:46.358 16:47:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:46.358 16:47:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.358 16:47:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.358 16:47:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.358 16:47:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.358 16:47:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.358 16:47:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.358 16:47:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.358 16:47:57 -- accel/accel.sh@42 -- # jq -r . 00:05:46.358 [2024-11-29 16:47:57.531816] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.358 [2024-11-29 16:47:57.531902] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91675 ] 00:05:46.358 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.358 [2024-11-29 16:47:57.592425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.358 [2024-11-29 16:47:57.707998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.733 16:47:58 -- accel/accel.sh@18 -- # out=' 00:05:47.733 SPDK Configuration: 00:05:47.733 Core mask: 0x1 00:05:47.733 00:05:47.733 Accel Perf Configuration: 00:05:47.733 Workload Type: crc32c 00:05:47.733 CRC-32C seed: 0 00:05:47.733 Transfer size: 4096 bytes 00:05:47.733 Vector count 2 00:05:47.733 Module: software 00:05:47.733 Queue depth: 32 00:05:47.733 Allocate depth: 32 00:05:47.733 # threads/core: 1 00:05:47.733 Run time: 1 seconds 00:05:47.733 Verify: Yes 00:05:47.733 00:05:47.733 Running for 1 seconds... 00:05:47.733 00:05:47.733 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:47.733 ------------------------------------------------------------------------------------ 00:05:47.733 0,0 315648/s 2466 MiB/s 0 0 00:05:47.733 ==================================================================================== 00:05:47.733 Total 315648/s 1233 MiB/s 0 0' 00:05:47.733 16:47:58 -- accel/accel.sh@20 -- # IFS=: 00:05:47.733 16:47:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:47.733 16:47:58 -- accel/accel.sh@20 -- # read -r var val 00:05:47.733 16:47:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:47.733 16:47:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.733 16:47:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.733 16:47:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.733 16:47:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.733 16:47:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.733 16:47:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.733 16:47:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.733 16:47:58 -- accel/accel.sh@42 -- # jq -r . 00:05:47.733 [2024-11-29 16:47:58.996785] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.733 [2024-11-29 16:47:58.996875] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91819 ] 00:05:47.733 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.733 [2024-11-29 16:47:59.060367] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.992 [2024-11-29 16:47:59.177299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val= 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val= 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val=0x1 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val= 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val= 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val=crc32c 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val=0 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val= 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val=software 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val=32 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val=32 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val=1 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val=Yes 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val= 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:47.992 16:47:59 -- accel/accel.sh@21 -- # val= 00:05:47.992 16:47:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # IFS=: 00:05:47.992 16:47:59 -- accel/accel.sh@20 -- # read -r var val 00:05:49.368 16:48:00 -- accel/accel.sh@21 -- # val= 00:05:49.368 16:48:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # IFS=: 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # read -r var val 00:05:49.368 16:48:00 -- accel/accel.sh@21 -- # val= 00:05:49.368 16:48:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # IFS=: 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # read -r var val 00:05:49.368 16:48:00 -- accel/accel.sh@21 -- # val= 00:05:49.368 16:48:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # IFS=: 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # read -r var val 00:05:49.368 16:48:00 -- accel/accel.sh@21 -- # val= 00:05:49.368 16:48:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # IFS=: 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # read -r var val 00:05:49.368 16:48:00 -- accel/accel.sh@21 -- # val= 00:05:49.368 16:48:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # IFS=: 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # read -r var val 00:05:49.368 16:48:00 -- accel/accel.sh@21 -- # val= 00:05:49.368 16:48:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # IFS=: 00:05:49.368 16:48:00 -- accel/accel.sh@20 -- # read -r var val 00:05:49.368 16:48:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.368 16:48:00 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:49.368 16:48:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.368 00:05:49.368 real 0m2.931s 00:05:49.368 user 0m2.624s 00:05:49.368 sys 0m0.298s 00:05:49.368 16:48:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:49.368 16:48:00 -- common/autotest_common.sh@10 -- # set +x 00:05:49.368 ************************************ 00:05:49.368 END TEST accel_crc32c_C2 00:05:49.368 ************************************ 00:05:49.368 16:48:00 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:49.368 16:48:00 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:49.368 16:48:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.368 16:48:00 -- common/autotest_common.sh@10 -- # set +x 00:05:49.368 ************************************ 00:05:49.368 START TEST accel_copy 00:05:49.368 ************************************ 00:05:49.368 16:48:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:49.368 16:48:00 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.368 16:48:00 -- accel/accel.sh@17 -- # local accel_module 00:05:49.368 16:48:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:49.368 16:48:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:49.368 16:48:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.368 16:48:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.368 16:48:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.368 16:48:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.368 16:48:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.368 16:48:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.368 16:48:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.368 16:48:00 -- accel/accel.sh@42 -- # jq -r . 00:05:49.368 [2024-11-29 16:48:00.486635] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.368 [2024-11-29 16:48:00.486721] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92017 ] 00:05:49.368 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.368 [2024-11-29 16:48:00.547563] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.368 [2024-11-29 16:48:00.666739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.743 16:48:01 -- accel/accel.sh@18 -- # out=' 00:05:50.743 SPDK Configuration: 00:05:50.743 Core mask: 0x1 00:05:50.743 00:05:50.743 Accel Perf Configuration: 00:05:50.743 Workload Type: copy 00:05:50.743 Transfer size: 4096 bytes 00:05:50.743 Vector count 1 00:05:50.743 Module: software 00:05:50.743 Queue depth: 32 00:05:50.743 Allocate depth: 32 00:05:50.743 # threads/core: 1 00:05:50.743 Run time: 1 seconds 00:05:50.743 Verify: Yes 00:05:50.743 00:05:50.743 Running for 1 seconds... 00:05:50.743 00:05:50.743 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:50.743 ------------------------------------------------------------------------------------ 00:05:50.743 0,0 283616/s 1107 MiB/s 0 0 00:05:50.743 ==================================================================================== 00:05:50.743 Total 283616/s 1107 MiB/s 0 0' 00:05:50.743 16:48:01 -- accel/accel.sh@20 -- # IFS=: 00:05:50.743 16:48:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:50.743 16:48:01 -- accel/accel.sh@20 -- # read -r var val 00:05:50.743 16:48:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:50.743 16:48:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.743 16:48:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.743 16:48:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.743 16:48:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.743 16:48:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.743 16:48:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.743 16:48:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.743 16:48:01 -- accel/accel.sh@42 -- # jq -r . 00:05:50.743 [2024-11-29 16:48:01.943877] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.743 [2024-11-29 16:48:01.943972] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92355 ] 00:05:50.743 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.743 [2024-11-29 16:48:02.003642] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.743 [2024-11-29 16:48:02.118693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val= 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val= 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val=0x1 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val= 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val= 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val=copy 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val= 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val=software 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val=32 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val=32 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val=1 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val=Yes 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val= 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:51.001 16:48:02 -- accel/accel.sh@21 -- # val= 00:05:51.001 16:48:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # IFS=: 00:05:51.001 16:48:02 -- accel/accel.sh@20 -- # read -r var val 00:05:52.377 16:48:03 -- accel/accel.sh@21 -- # val= 00:05:52.377 16:48:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # IFS=: 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # read -r var val 00:05:52.377 16:48:03 -- accel/accel.sh@21 -- # val= 00:05:52.377 16:48:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # IFS=: 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # read -r var val 00:05:52.377 16:48:03 -- accel/accel.sh@21 -- # val= 00:05:52.377 16:48:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # IFS=: 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # read -r var val 00:05:52.377 16:48:03 -- accel/accel.sh@21 -- # val= 00:05:52.377 16:48:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # IFS=: 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # read -r var val 00:05:52.377 16:48:03 -- accel/accel.sh@21 -- # val= 00:05:52.377 16:48:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # IFS=: 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # read -r var val 00:05:52.377 16:48:03 -- accel/accel.sh@21 -- # val= 00:05:52.377 16:48:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # IFS=: 00:05:52.377 16:48:03 -- accel/accel.sh@20 -- # read -r var val 00:05:52.377 16:48:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.377 16:48:03 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:52.377 16:48:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.377 00:05:52.377 real 0m2.921s 00:05:52.377 user 0m2.623s 00:05:52.377 sys 0m0.287s 00:05:52.377 16:48:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.377 16:48:03 -- common/autotest_common.sh@10 -- # set +x 00:05:52.377 ************************************ 00:05:52.377 END TEST accel_copy 00:05:52.377 ************************************ 00:05:52.377 16:48:03 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:52.377 16:48:03 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:52.377 16:48:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.377 16:48:03 -- common/autotest_common.sh@10 -- # set +x 00:05:52.377 ************************************ 00:05:52.377 START TEST accel_fill 00:05:52.377 ************************************ 00:05:52.377 16:48:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:52.377 16:48:03 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.377 16:48:03 -- accel/accel.sh@17 -- # local accel_module 00:05:52.377 16:48:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:52.377 16:48:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:52.377 16:48:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.377 16:48:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.377 16:48:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.377 16:48:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.377 16:48:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.377 16:48:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.377 16:48:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.377 16:48:03 -- accel/accel.sh@42 -- # jq -r . 00:05:52.377 [2024-11-29 16:48:03.431542] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.377 [2024-11-29 16:48:03.431625] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92517 ] 00:05:52.377 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.377 [2024-11-29 16:48:03.493234] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.377 [2024-11-29 16:48:03.609331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.752 16:48:04 -- accel/accel.sh@18 -- # out=' 00:05:53.752 SPDK Configuration: 00:05:53.752 Core mask: 0x1 00:05:53.752 00:05:53.752 Accel Perf Configuration: 00:05:53.752 Workload Type: fill 00:05:53.752 Fill pattern: 0x80 00:05:53.752 Transfer size: 4096 bytes 00:05:53.752 Vector count 1 00:05:53.752 Module: software 00:05:53.752 Queue depth: 64 00:05:53.752 Allocate depth: 64 00:05:53.752 # threads/core: 1 00:05:53.752 Run time: 1 seconds 00:05:53.752 Verify: Yes 00:05:53.752 00:05:53.752 Running for 1 seconds... 00:05:53.752 00:05:53.752 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:53.752 ------------------------------------------------------------------------------------ 00:05:53.752 0,0 406720/s 1588 MiB/s 0 0 00:05:53.752 ==================================================================================== 00:05:53.752 Total 406720/s 1588 MiB/s 0 0' 00:05:53.752 16:48:04 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:53.752 16:48:04 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:53.752 16:48:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.752 16:48:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.752 16:48:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.752 16:48:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.752 16:48:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.752 16:48:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.752 16:48:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.752 16:48:04 -- accel/accel.sh@42 -- # jq -r . 00:05:53.752 [2024-11-29 16:48:04.900158] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.752 [2024-11-29 16:48:04.900258] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92660 ] 00:05:53.752 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.752 [2024-11-29 16:48:04.960383] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.752 [2024-11-29 16:48:05.076907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val= 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val= 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val=0x1 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val= 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val= 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val=fill 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.752 16:48:05 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val=0x80 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val= 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.752 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.752 16:48:05 -- accel/accel.sh@21 -- # val=software 00:05:53.752 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.753 16:48:05 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.753 16:48:05 -- accel/accel.sh@21 -- # val=64 00:05:53.753 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.753 16:48:05 -- accel/accel.sh@21 -- # val=64 00:05:53.753 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.753 16:48:05 -- accel/accel.sh@21 -- # val=1 00:05:53.753 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.753 16:48:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.753 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.753 16:48:05 -- accel/accel.sh@21 -- # val=Yes 00:05:53.753 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.753 16:48:05 -- accel/accel.sh@21 -- # val= 00:05:53.753 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:53.753 16:48:05 -- accel/accel.sh@21 -- # val= 00:05:53.753 16:48:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # IFS=: 00:05:53.753 16:48:05 -- accel/accel.sh@20 -- # read -r var val 00:05:55.127 16:48:06 -- accel/accel.sh@21 -- # val= 00:05:55.127 16:48:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # IFS=: 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # read -r var val 00:05:55.127 16:48:06 -- accel/accel.sh@21 -- # val= 00:05:55.127 16:48:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # IFS=: 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # read -r var val 00:05:55.127 16:48:06 -- accel/accel.sh@21 -- # val= 00:05:55.127 16:48:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # IFS=: 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # read -r var val 00:05:55.127 16:48:06 -- accel/accel.sh@21 -- # val= 00:05:55.127 16:48:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # IFS=: 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # read -r var val 00:05:55.127 16:48:06 -- accel/accel.sh@21 -- # val= 00:05:55.127 16:48:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # IFS=: 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # read -r var val 00:05:55.127 16:48:06 -- accel/accel.sh@21 -- # val= 00:05:55.127 16:48:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # IFS=: 00:05:55.127 16:48:06 -- accel/accel.sh@20 -- # read -r var val 00:05:55.127 16:48:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.127 16:48:06 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:55.127 16:48:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.127 00:05:55.127 real 0m2.940s 00:05:55.127 user 0m2.643s 00:05:55.127 sys 0m0.286s 00:05:55.127 16:48:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.127 16:48:06 -- common/autotest_common.sh@10 -- # set +x 00:05:55.127 ************************************ 00:05:55.127 END TEST accel_fill 00:05:55.127 ************************************ 00:05:55.127 16:48:06 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:55.127 16:48:06 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:55.127 16:48:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.127 16:48:06 -- common/autotest_common.sh@10 -- # set +x 00:05:55.127 ************************************ 00:05:55.127 START TEST accel_copy_crc32c 00:05:55.127 ************************************ 00:05:55.127 16:48:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:55.127 16:48:06 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.127 16:48:06 -- accel/accel.sh@17 -- # local accel_module 00:05:55.127 16:48:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:55.127 16:48:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:55.127 16:48:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.127 16:48:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.127 16:48:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.127 16:48:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.128 16:48:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.128 16:48:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.128 16:48:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.128 16:48:06 -- accel/accel.sh@42 -- # jq -r . 00:05:55.128 [2024-11-29 16:48:06.392555] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.128 [2024-11-29 16:48:06.392635] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92849 ] 00:05:55.128 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.128 [2024-11-29 16:48:06.453847] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.386 [2024-11-29 16:48:06.568709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.761 16:48:07 -- accel/accel.sh@18 -- # out=' 00:05:56.761 SPDK Configuration: 00:05:56.761 Core mask: 0x1 00:05:56.761 00:05:56.761 Accel Perf Configuration: 00:05:56.761 Workload Type: copy_crc32c 00:05:56.761 CRC-32C seed: 0 00:05:56.761 Vector size: 4096 bytes 00:05:56.761 Transfer size: 4096 bytes 00:05:56.761 Vector count 1 00:05:56.761 Module: software 00:05:56.761 Queue depth: 32 00:05:56.761 Allocate depth: 32 00:05:56.761 # threads/core: 1 00:05:56.761 Run time: 1 seconds 00:05:56.761 Verify: Yes 00:05:56.761 00:05:56.761 Running for 1 seconds... 00:05:56.761 00:05:56.761 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:56.761 ------------------------------------------------------------------------------------ 00:05:56.761 0,0 219136/s 856 MiB/s 0 0 00:05:56.761 ==================================================================================== 00:05:56.761 Total 219136/s 856 MiB/s 0 0' 00:05:56.761 16:48:07 -- accel/accel.sh@20 -- # IFS=: 00:05:56.761 16:48:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:56.761 16:48:07 -- accel/accel.sh@20 -- # read -r var val 00:05:56.761 16:48:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:56.761 16:48:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.761 16:48:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.761 16:48:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.761 16:48:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.761 16:48:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.761 16:48:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.761 16:48:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.761 16:48:07 -- accel/accel.sh@42 -- # jq -r . 00:05:56.761 [2024-11-29 16:48:07.843468] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.761 [2024-11-29 16:48:07.843549] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93331 ] 00:05:56.761 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.761 [2024-11-29 16:48:07.904539] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.761 [2024-11-29 16:48:08.018554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.761 16:48:08 -- accel/accel.sh@21 -- # val= 00:05:56.761 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.761 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.761 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val= 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val=0x1 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val= 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val= 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val=0 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val= 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val=software 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val=32 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val=32 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val=1 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val=Yes 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val= 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:56.762 16:48:08 -- accel/accel.sh@21 -- # val= 00:05:56.762 16:48:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # IFS=: 00:05:56.762 16:48:08 -- accel/accel.sh@20 -- # read -r var val 00:05:58.136 16:48:09 -- accel/accel.sh@21 -- # val= 00:05:58.136 16:48:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # IFS=: 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # read -r var val 00:05:58.136 16:48:09 -- accel/accel.sh@21 -- # val= 00:05:58.136 16:48:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # IFS=: 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # read -r var val 00:05:58.136 16:48:09 -- accel/accel.sh@21 -- # val= 00:05:58.136 16:48:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # IFS=: 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # read -r var val 00:05:58.136 16:48:09 -- accel/accel.sh@21 -- # val= 00:05:58.136 16:48:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # IFS=: 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # read -r var val 00:05:58.136 16:48:09 -- accel/accel.sh@21 -- # val= 00:05:58.136 16:48:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # IFS=: 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # read -r var val 00:05:58.136 16:48:09 -- accel/accel.sh@21 -- # val= 00:05:58.136 16:48:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # IFS=: 00:05:58.136 16:48:09 -- accel/accel.sh@20 -- # read -r var val 00:05:58.136 16:48:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.136 16:48:09 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:58.136 16:48:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.136 00:05:58.136 real 0m2.913s 00:05:58.136 user 0m2.616s 00:05:58.136 sys 0m0.287s 00:05:58.136 16:48:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.136 16:48:09 -- common/autotest_common.sh@10 -- # set +x 00:05:58.136 ************************************ 00:05:58.136 END TEST accel_copy_crc32c 00:05:58.136 ************************************ 00:05:58.136 16:48:09 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:58.136 16:48:09 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:58.136 16:48:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.136 16:48:09 -- common/autotest_common.sh@10 -- # set +x 00:05:58.136 ************************************ 00:05:58.136 START TEST accel_copy_crc32c_C2 00:05:58.136 ************************************ 00:05:58.136 16:48:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:58.136 16:48:09 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.136 16:48:09 -- accel/accel.sh@17 -- # local accel_module 00:05:58.136 16:48:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:58.136 16:48:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:58.136 16:48:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.136 16:48:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.136 16:48:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.136 16:48:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.136 16:48:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.136 16:48:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.136 16:48:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.136 16:48:09 -- accel/accel.sh@42 -- # jq -r . 00:05:58.136 [2024-11-29 16:48:09.328139] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.136 [2024-11-29 16:48:09.328214] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93744 ] 00:05:58.136 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.136 [2024-11-29 16:48:09.390849] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.136 [2024-11-29 16:48:09.508665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.510 16:48:10 -- accel/accel.sh@18 -- # out=' 00:05:59.510 SPDK Configuration: 00:05:59.510 Core mask: 0x1 00:05:59.510 00:05:59.510 Accel Perf Configuration: 00:05:59.510 Workload Type: copy_crc32c 00:05:59.510 CRC-32C seed: 0 00:05:59.510 Vector size: 4096 bytes 00:05:59.510 Transfer size: 8192 bytes 00:05:59.510 Vector count 2 00:05:59.510 Module: software 00:05:59.510 Queue depth: 32 00:05:59.510 Allocate depth: 32 00:05:59.510 # threads/core: 1 00:05:59.510 Run time: 1 seconds 00:05:59.510 Verify: Yes 00:05:59.510 00:05:59.510 Running for 1 seconds... 00:05:59.510 00:05:59.510 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:59.510 ------------------------------------------------------------------------------------ 00:05:59.510 0,0 155680/s 1216 MiB/s 0 0 00:05:59.510 ==================================================================================== 00:05:59.510 Total 155680/s 608 MiB/s 0 0' 00:05:59.510 16:48:10 -- accel/accel.sh@20 -- # IFS=: 00:05:59.510 16:48:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:59.510 16:48:10 -- accel/accel.sh@20 -- # read -r var val 00:05:59.510 16:48:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:59.510 16:48:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.510 16:48:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.510 16:48:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.510 16:48:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.510 16:48:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.510 16:48:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.510 16:48:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.510 16:48:10 -- accel/accel.sh@42 -- # jq -r . 00:05:59.510 [2024-11-29 16:48:10.799007] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.510 [2024-11-29 16:48:10.799105] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93893 ] 00:05:59.510 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.510 [2024-11-29 16:48:10.862664] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.769 [2024-11-29 16:48:10.977536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val= 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val= 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val=0x1 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val= 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val= 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val=0 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val= 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val=software 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@23 -- # accel_module=software 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val=32 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val=32 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val=1 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val=Yes 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val= 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:05:59.769 16:48:11 -- accel/accel.sh@21 -- # val= 00:05:59.769 16:48:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # IFS=: 00:05:59.769 16:48:11 -- accel/accel.sh@20 -- # read -r var val 00:06:01.144 16:48:12 -- accel/accel.sh@21 -- # val= 00:06:01.144 16:48:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # IFS=: 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # read -r var val 00:06:01.144 16:48:12 -- accel/accel.sh@21 -- # val= 00:06:01.144 16:48:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # IFS=: 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # read -r var val 00:06:01.144 16:48:12 -- accel/accel.sh@21 -- # val= 00:06:01.144 16:48:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # IFS=: 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # read -r var val 00:06:01.144 16:48:12 -- accel/accel.sh@21 -- # val= 00:06:01.144 16:48:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # IFS=: 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # read -r var val 00:06:01.144 16:48:12 -- accel/accel.sh@21 -- # val= 00:06:01.144 16:48:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # IFS=: 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # read -r var val 00:06:01.144 16:48:12 -- accel/accel.sh@21 -- # val= 00:06:01.144 16:48:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # IFS=: 00:06:01.144 16:48:12 -- accel/accel.sh@20 -- # read -r var val 00:06:01.144 16:48:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:01.144 16:48:12 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:01.144 16:48:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.144 00:06:01.144 real 0m2.923s 00:06:01.144 user 0m2.639s 00:06:01.144 sys 0m0.275s 00:06:01.144 16:48:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.144 16:48:12 -- common/autotest_common.sh@10 -- # set +x 00:06:01.144 ************************************ 00:06:01.144 END TEST accel_copy_crc32c_C2 00:06:01.144 ************************************ 00:06:01.144 16:48:12 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:01.144 16:48:12 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:01.144 16:48:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.144 16:48:12 -- common/autotest_common.sh@10 -- # set +x 00:06:01.144 ************************************ 00:06:01.144 START TEST accel_dualcast 00:06:01.144 ************************************ 00:06:01.144 16:48:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:06:01.144 16:48:12 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.144 16:48:12 -- accel/accel.sh@17 -- # local accel_module 00:06:01.144 16:48:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:06:01.144 16:48:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:01.144 16:48:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.144 16:48:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.144 16:48:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.144 16:48:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.144 16:48:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.144 16:48:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.144 16:48:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.144 16:48:12 -- accel/accel.sh@42 -- # jq -r . 00:06:01.144 [2024-11-29 16:48:12.275922] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.144 [2024-11-29 16:48:12.276040] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94170 ] 00:06:01.144 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.144 [2024-11-29 16:48:12.340372] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.144 [2024-11-29 16:48:12.456425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.519 16:48:13 -- accel/accel.sh@18 -- # out=' 00:06:02.519 SPDK Configuration: 00:06:02.519 Core mask: 0x1 00:06:02.519 00:06:02.519 Accel Perf Configuration: 00:06:02.519 Workload Type: dualcast 00:06:02.519 Transfer size: 4096 bytes 00:06:02.519 Vector count 1 00:06:02.519 Module: software 00:06:02.519 Queue depth: 32 00:06:02.519 Allocate depth: 32 00:06:02.519 # threads/core: 1 00:06:02.519 Run time: 1 seconds 00:06:02.519 Verify: Yes 00:06:02.519 00:06:02.519 Running for 1 seconds... 00:06:02.519 00:06:02.519 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.519 ------------------------------------------------------------------------------------ 00:06:02.519 0,0 304800/s 1190 MiB/s 0 0 00:06:02.519 ==================================================================================== 00:06:02.519 Total 304800/s 1190 MiB/s 0 0' 00:06:02.519 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.519 16:48:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:02.519 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.519 16:48:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:02.519 16:48:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.519 16:48:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.519 16:48:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.519 16:48:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.519 16:48:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.519 16:48:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.519 16:48:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.519 16:48:13 -- accel/accel.sh@42 -- # jq -r . 00:06:02.519 [2024-11-29 16:48:13.743403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.519 [2024-11-29 16:48:13.743490] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94316 ] 00:06:02.519 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.519 [2024-11-29 16:48:13.807065] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.519 [2024-11-29 16:48:13.923308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.777 16:48:13 -- accel/accel.sh@21 -- # val= 00:06:02.777 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.777 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.777 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.777 16:48:13 -- accel/accel.sh@21 -- # val= 00:06:02.777 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.777 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.777 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.777 16:48:13 -- accel/accel.sh@21 -- # val=0x1 00:06:02.777 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.777 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.777 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.777 16:48:13 -- accel/accel.sh@21 -- # val= 00:06:02.777 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.777 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.777 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.777 16:48:13 -- accel/accel.sh@21 -- # val= 00:06:02.777 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val=dualcast 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val= 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val=software 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val=32 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val=32 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val=1 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val=Yes 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val= 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:02.778 16:48:13 -- accel/accel.sh@21 -- # val= 00:06:02.778 16:48:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # IFS=: 00:06:02.778 16:48:13 -- accel/accel.sh@20 -- # read -r var val 00:06:04.152 16:48:15 -- accel/accel.sh@21 -- # val= 00:06:04.152 16:48:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # IFS=: 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # read -r var val 00:06:04.152 16:48:15 -- accel/accel.sh@21 -- # val= 00:06:04.152 16:48:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # IFS=: 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # read -r var val 00:06:04.152 16:48:15 -- accel/accel.sh@21 -- # val= 00:06:04.152 16:48:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # IFS=: 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # read -r var val 00:06:04.152 16:48:15 -- accel/accel.sh@21 -- # val= 00:06:04.152 16:48:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # IFS=: 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # read -r var val 00:06:04.152 16:48:15 -- accel/accel.sh@21 -- # val= 00:06:04.152 16:48:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # IFS=: 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # read -r var val 00:06:04.152 16:48:15 -- accel/accel.sh@21 -- # val= 00:06:04.152 16:48:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # IFS=: 00:06:04.152 16:48:15 -- accel/accel.sh@20 -- # read -r var val 00:06:04.152 16:48:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:04.152 16:48:15 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:04.152 16:48:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.152 00:06:04.152 real 0m2.930s 00:06:04.152 user 0m2.638s 00:06:04.152 sys 0m0.283s 00:06:04.152 16:48:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.152 16:48:15 -- common/autotest_common.sh@10 -- # set +x 00:06:04.152 ************************************ 00:06:04.152 END TEST accel_dualcast 00:06:04.152 ************************************ 00:06:04.152 16:48:15 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:04.152 16:48:15 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:04.152 16:48:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.152 16:48:15 -- common/autotest_common.sh@10 -- # set +x 00:06:04.152 ************************************ 00:06:04.152 START TEST accel_compare 00:06:04.152 ************************************ 00:06:04.152 16:48:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:06:04.152 16:48:15 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.152 16:48:15 -- accel/accel.sh@17 -- # local accel_module 00:06:04.152 16:48:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:04.152 16:48:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:04.152 16:48:15 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.152 16:48:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.152 16:48:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.152 16:48:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.152 16:48:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.152 16:48:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.152 16:48:15 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.152 16:48:15 -- accel/accel.sh@42 -- # jq -r . 00:06:04.152 [2024-11-29 16:48:15.233369] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.152 [2024-11-29 16:48:15.233447] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94474 ] 00:06:04.152 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.152 [2024-11-29 16:48:15.295324] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.152 [2024-11-29 16:48:15.409949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.529 16:48:16 -- accel/accel.sh@18 -- # out=' 00:06:05.529 SPDK Configuration: 00:06:05.529 Core mask: 0x1 00:06:05.529 00:06:05.529 Accel Perf Configuration: 00:06:05.529 Workload Type: compare 00:06:05.529 Transfer size: 4096 bytes 00:06:05.529 Vector count 1 00:06:05.529 Module: software 00:06:05.529 Queue depth: 32 00:06:05.529 Allocate depth: 32 00:06:05.529 # threads/core: 1 00:06:05.529 Run time: 1 seconds 00:06:05.529 Verify: Yes 00:06:05.529 00:06:05.529 Running for 1 seconds... 00:06:05.529 00:06:05.529 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:05.529 ------------------------------------------------------------------------------------ 00:06:05.529 0,0 398912/s 1558 MiB/s 0 0 00:06:05.529 ==================================================================================== 00:06:05.529 Total 398912/s 1558 MiB/s 0 0' 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:05.529 16:48:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.529 16:48:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.529 16:48:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.529 16:48:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.529 16:48:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.529 16:48:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.529 16:48:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.529 16:48:16 -- accel/accel.sh@42 -- # jq -r . 00:06:05.529 [2024-11-29 16:48:16.698351] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.529 [2024-11-29 16:48:16.698441] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94739 ] 00:06:05.529 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.529 [2024-11-29 16:48:16.759256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.529 [2024-11-29 16:48:16.871991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val= 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val= 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val=0x1 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val= 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val= 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val=compare 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val= 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val=software 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val=32 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val=32 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val=1 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val=Yes 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val= 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:05.529 16:48:16 -- accel/accel.sh@21 -- # val= 00:06:05.529 16:48:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # IFS=: 00:06:05.529 16:48:16 -- accel/accel.sh@20 -- # read -r var val 00:06:06.904 16:48:18 -- accel/accel.sh@21 -- # val= 00:06:06.904 16:48:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # IFS=: 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # read -r var val 00:06:06.904 16:48:18 -- accel/accel.sh@21 -- # val= 00:06:06.904 16:48:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # IFS=: 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # read -r var val 00:06:06.904 16:48:18 -- accel/accel.sh@21 -- # val= 00:06:06.904 16:48:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # IFS=: 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # read -r var val 00:06:06.904 16:48:18 -- accel/accel.sh@21 -- # val= 00:06:06.904 16:48:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # IFS=: 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # read -r var val 00:06:06.904 16:48:18 -- accel/accel.sh@21 -- # val= 00:06:06.904 16:48:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # IFS=: 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # read -r var val 00:06:06.904 16:48:18 -- accel/accel.sh@21 -- # val= 00:06:06.904 16:48:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # IFS=: 00:06:06.904 16:48:18 -- accel/accel.sh@20 -- # read -r var val 00:06:06.904 16:48:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:06.904 16:48:18 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:06.904 16:48:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:06.904 00:06:06.904 real 0m2.928s 00:06:06.904 user 0m2.638s 00:06:06.904 sys 0m0.282s 00:06:06.904 16:48:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.904 16:48:18 -- common/autotest_common.sh@10 -- # set +x 00:06:06.904 ************************************ 00:06:06.904 END TEST accel_compare 00:06:06.904 ************************************ 00:06:06.904 16:48:18 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:06.904 16:48:18 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:06.904 16:48:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.904 16:48:18 -- common/autotest_common.sh@10 -- # set +x 00:06:06.904 ************************************ 00:06:06.904 START TEST accel_xor 00:06:06.904 ************************************ 00:06:06.904 16:48:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:06.904 16:48:18 -- accel/accel.sh@16 -- # local accel_opc 00:06:06.904 16:48:18 -- accel/accel.sh@17 -- # local accel_module 00:06:06.904 16:48:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:06.904 16:48:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:06.904 16:48:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.904 16:48:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.904 16:48:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.904 16:48:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.904 16:48:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.904 16:48:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.904 16:48:18 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.904 16:48:18 -- accel/accel.sh@42 -- # jq -r . 00:06:06.904 [2024-11-29 16:48:18.183419] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.904 [2024-11-29 16:48:18.183508] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94897 ] 00:06:06.904 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.904 [2024-11-29 16:48:18.244522] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.162 [2024-11-29 16:48:18.361107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.537 16:48:19 -- accel/accel.sh@18 -- # out=' 00:06:08.537 SPDK Configuration: 00:06:08.537 Core mask: 0x1 00:06:08.537 00:06:08.537 Accel Perf Configuration: 00:06:08.537 Workload Type: xor 00:06:08.537 Source buffers: 2 00:06:08.537 Transfer size: 4096 bytes 00:06:08.537 Vector count 1 00:06:08.537 Module: software 00:06:08.537 Queue depth: 32 00:06:08.537 Allocate depth: 32 00:06:08.537 # threads/core: 1 00:06:08.537 Run time: 1 seconds 00:06:08.537 Verify: Yes 00:06:08.537 00:06:08.537 Running for 1 seconds... 00:06:08.537 00:06:08.537 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:08.537 ------------------------------------------------------------------------------------ 00:06:08.537 0,0 192192/s 750 MiB/s 0 0 00:06:08.537 ==================================================================================== 00:06:08.537 Total 192192/s 750 MiB/s 0 0' 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:08.537 16:48:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.537 16:48:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.537 16:48:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.537 16:48:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.537 16:48:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.537 16:48:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.537 16:48:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.537 16:48:19 -- accel/accel.sh@42 -- # jq -r . 00:06:08.537 [2024-11-29 16:48:19.650803] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.537 [2024-11-29 16:48:19.650887] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95043 ] 00:06:08.537 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.537 [2024-11-29 16:48:19.714248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.537 [2024-11-29 16:48:19.829590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val= 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val= 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val=0x1 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val= 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val= 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val=xor 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val=2 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val= 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val=software 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val=32 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val=32 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val=1 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val=Yes 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val= 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:08.537 16:48:19 -- accel/accel.sh@21 -- # val= 00:06:08.537 16:48:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # IFS=: 00:06:08.537 16:48:19 -- accel/accel.sh@20 -- # read -r var val 00:06:09.911 16:48:21 -- accel/accel.sh@21 -- # val= 00:06:09.911 16:48:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # IFS=: 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # read -r var val 00:06:09.911 16:48:21 -- accel/accel.sh@21 -- # val= 00:06:09.911 16:48:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # IFS=: 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # read -r var val 00:06:09.911 16:48:21 -- accel/accel.sh@21 -- # val= 00:06:09.911 16:48:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # IFS=: 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # read -r var val 00:06:09.911 16:48:21 -- accel/accel.sh@21 -- # val= 00:06:09.911 16:48:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # IFS=: 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # read -r var val 00:06:09.911 16:48:21 -- accel/accel.sh@21 -- # val= 00:06:09.911 16:48:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # IFS=: 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # read -r var val 00:06:09.911 16:48:21 -- accel/accel.sh@21 -- # val= 00:06:09.911 16:48:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # IFS=: 00:06:09.911 16:48:21 -- accel/accel.sh@20 -- # read -r var val 00:06:09.911 16:48:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:09.911 16:48:21 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:09.911 16:48:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:09.911 00:06:09.911 real 0m2.937s 00:06:09.911 user 0m2.632s 00:06:09.911 sys 0m0.296s 00:06:09.911 16:48:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.911 16:48:21 -- common/autotest_common.sh@10 -- # set +x 00:06:09.911 ************************************ 00:06:09.911 END TEST accel_xor 00:06:09.911 ************************************ 00:06:09.911 16:48:21 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:09.911 16:48:21 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:09.911 16:48:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.911 16:48:21 -- common/autotest_common.sh@10 -- # set +x 00:06:09.911 ************************************ 00:06:09.911 START TEST accel_xor 00:06:09.911 ************************************ 00:06:09.911 16:48:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:09.911 16:48:21 -- accel/accel.sh@16 -- # local accel_opc 00:06:09.911 16:48:21 -- accel/accel.sh@17 -- # local accel_module 00:06:09.911 16:48:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:09.911 16:48:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:09.911 16:48:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.911 16:48:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.911 16:48:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.911 16:48:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.911 16:48:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.911 16:48:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.911 16:48:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.911 16:48:21 -- accel/accel.sh@42 -- # jq -r . 00:06:09.911 [2024-11-29 16:48:21.143107] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.911 [2024-11-29 16:48:21.143185] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95220 ] 00:06:09.911 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.911 [2024-11-29 16:48:21.203888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.911 [2024-11-29 16:48:21.320267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.285 16:48:22 -- accel/accel.sh@18 -- # out=' 00:06:11.286 SPDK Configuration: 00:06:11.286 Core mask: 0x1 00:06:11.286 00:06:11.286 Accel Perf Configuration: 00:06:11.286 Workload Type: xor 00:06:11.286 Source buffers: 3 00:06:11.286 Transfer size: 4096 bytes 00:06:11.286 Vector count 1 00:06:11.286 Module: software 00:06:11.286 Queue depth: 32 00:06:11.286 Allocate depth: 32 00:06:11.286 # threads/core: 1 00:06:11.286 Run time: 1 seconds 00:06:11.286 Verify: Yes 00:06:11.286 00:06:11.286 Running for 1 seconds... 00:06:11.286 00:06:11.286 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:11.286 ------------------------------------------------------------------------------------ 00:06:11.286 0,0 184416/s 720 MiB/s 0 0 00:06:11.286 ==================================================================================== 00:06:11.286 Total 184416/s 720 MiB/s 0 0' 00:06:11.286 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.286 16:48:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:11.286 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.286 16:48:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:11.286 16:48:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.286 16:48:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.286 16:48:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.286 16:48:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.286 16:48:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.286 16:48:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.286 16:48:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.286 16:48:22 -- accel/accel.sh@42 -- # jq -r . 00:06:11.286 [2024-11-29 16:48:22.591464] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.286 [2024-11-29 16:48:22.591551] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95466 ] 00:06:11.286 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.286 [2024-11-29 16:48:22.651946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.544 [2024-11-29 16:48:22.767937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val= 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val= 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val=0x1 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val= 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val= 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val=xor 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val=3 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val= 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val=software 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val=32 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val=32 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val=1 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.544 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.544 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.544 16:48:22 -- accel/accel.sh@21 -- # val=Yes 00:06:11.545 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.545 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.545 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.545 16:48:22 -- accel/accel.sh@21 -- # val= 00:06:11.545 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.545 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.545 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:11.545 16:48:22 -- accel/accel.sh@21 -- # val= 00:06:11.545 16:48:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.545 16:48:22 -- accel/accel.sh@20 -- # IFS=: 00:06:11.545 16:48:22 -- accel/accel.sh@20 -- # read -r var val 00:06:12.918 16:48:24 -- accel/accel.sh@21 -- # val= 00:06:12.918 16:48:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # IFS=: 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # read -r var val 00:06:12.918 16:48:24 -- accel/accel.sh@21 -- # val= 00:06:12.918 16:48:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # IFS=: 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # read -r var val 00:06:12.918 16:48:24 -- accel/accel.sh@21 -- # val= 00:06:12.918 16:48:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # IFS=: 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # read -r var val 00:06:12.918 16:48:24 -- accel/accel.sh@21 -- # val= 00:06:12.918 16:48:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # IFS=: 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # read -r var val 00:06:12.918 16:48:24 -- accel/accel.sh@21 -- # val= 00:06:12.918 16:48:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # IFS=: 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # read -r var val 00:06:12.918 16:48:24 -- accel/accel.sh@21 -- # val= 00:06:12.918 16:48:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # IFS=: 00:06:12.918 16:48:24 -- accel/accel.sh@20 -- # read -r var val 00:06:12.918 16:48:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:12.918 16:48:24 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:12.918 16:48:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:12.918 00:06:12.918 real 0m2.919s 00:06:12.918 user 0m2.634s 00:06:12.918 sys 0m0.276s 00:06:12.918 16:48:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.918 16:48:24 -- common/autotest_common.sh@10 -- # set +x 00:06:12.918 ************************************ 00:06:12.918 END TEST accel_xor 00:06:12.918 ************************************ 00:06:12.918 16:48:24 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:12.918 16:48:24 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:12.918 16:48:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.918 16:48:24 -- common/autotest_common.sh@10 -- # set +x 00:06:12.918 ************************************ 00:06:12.918 START TEST accel_dif_verify 00:06:12.918 ************************************ 00:06:12.918 16:48:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:12.918 16:48:24 -- accel/accel.sh@16 -- # local accel_opc 00:06:12.918 16:48:24 -- accel/accel.sh@17 -- # local accel_module 00:06:12.918 16:48:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:12.918 16:48:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:12.918 16:48:24 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.918 16:48:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.918 16:48:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.918 16:48:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.918 16:48:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.918 16:48:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.918 16:48:24 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.918 16:48:24 -- accel/accel.sh@42 -- # jq -r . 00:06:12.918 [2024-11-29 16:48:24.088839] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.918 [2024-11-29 16:48:24.088922] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95625 ] 00:06:12.919 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.919 [2024-11-29 16:48:24.151752] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.919 [2024-11-29 16:48:24.266351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.291 16:48:25 -- accel/accel.sh@18 -- # out=' 00:06:14.291 SPDK Configuration: 00:06:14.291 Core mask: 0x1 00:06:14.291 00:06:14.291 Accel Perf Configuration: 00:06:14.291 Workload Type: dif_verify 00:06:14.291 Vector size: 4096 bytes 00:06:14.291 Transfer size: 4096 bytes 00:06:14.291 Block size: 512 bytes 00:06:14.291 Metadata size: 8 bytes 00:06:14.291 Vector count 1 00:06:14.291 Module: software 00:06:14.291 Queue depth: 32 00:06:14.291 Allocate depth: 32 00:06:14.291 # threads/core: 1 00:06:14.291 Run time: 1 seconds 00:06:14.291 Verify: No 00:06:14.291 00:06:14.291 Running for 1 seconds... 00:06:14.291 00:06:14.291 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:14.291 ------------------------------------------------------------------------------------ 00:06:14.291 0,0 81728/s 324 MiB/s 0 0 00:06:14.291 ==================================================================================== 00:06:14.291 Total 81728/s 319 MiB/s 0 0' 00:06:14.291 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.291 16:48:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:14.291 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.291 16:48:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:14.291 16:48:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.291 16:48:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:14.291 16:48:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.291 16:48:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.291 16:48:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:14.291 16:48:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:14.291 16:48:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:14.291 16:48:25 -- accel/accel.sh@42 -- # jq -r . 00:06:14.291 [2024-11-29 16:48:25.550251] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:14.291 [2024-11-29 16:48:25.550356] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95769 ] 00:06:14.291 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.291 [2024-11-29 16:48:25.610940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.547 [2024-11-29 16:48:25.727060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val= 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val= 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val=0x1 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val= 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val= 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val=dif_verify 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val= 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val=software 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@23 -- # accel_module=software 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val=32 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val=32 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val=1 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val=No 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val= 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:14.548 16:48:25 -- accel/accel.sh@21 -- # val= 00:06:14.548 16:48:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # IFS=: 00:06:14.548 16:48:25 -- accel/accel.sh@20 -- # read -r var val 00:06:15.922 16:48:26 -- accel/accel.sh@21 -- # val= 00:06:15.922 16:48:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # IFS=: 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # read -r var val 00:06:15.922 16:48:26 -- accel/accel.sh@21 -- # val= 00:06:15.922 16:48:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # IFS=: 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # read -r var val 00:06:15.922 16:48:26 -- accel/accel.sh@21 -- # val= 00:06:15.922 16:48:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # IFS=: 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # read -r var val 00:06:15.922 16:48:26 -- accel/accel.sh@21 -- # val= 00:06:15.922 16:48:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # IFS=: 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # read -r var val 00:06:15.922 16:48:26 -- accel/accel.sh@21 -- # val= 00:06:15.922 16:48:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # IFS=: 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # read -r var val 00:06:15.922 16:48:26 -- accel/accel.sh@21 -- # val= 00:06:15.922 16:48:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # IFS=: 00:06:15.922 16:48:26 -- accel/accel.sh@20 -- # read -r var val 00:06:15.922 16:48:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:15.922 16:48:26 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:15.922 16:48:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:15.922 00:06:15.922 real 0m2.920s 00:06:15.922 user 0m2.639s 00:06:15.922 sys 0m0.275s 00:06:15.922 16:48:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.922 16:48:26 -- common/autotest_common.sh@10 -- # set +x 00:06:15.922 ************************************ 00:06:15.922 END TEST accel_dif_verify 00:06:15.922 ************************************ 00:06:15.922 16:48:27 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:15.922 16:48:27 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:15.922 16:48:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.922 16:48:27 -- common/autotest_common.sh@10 -- # set +x 00:06:15.922 ************************************ 00:06:15.922 START TEST accel_dif_generate 00:06:15.922 ************************************ 00:06:15.922 16:48:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:15.922 16:48:27 -- accel/accel.sh@16 -- # local accel_opc 00:06:15.922 16:48:27 -- accel/accel.sh@17 -- # local accel_module 00:06:15.922 16:48:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:15.922 16:48:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:15.922 16:48:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.922 16:48:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.922 16:48:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.922 16:48:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.922 16:48:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.922 16:48:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.922 16:48:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.922 16:48:27 -- accel/accel.sh@42 -- # jq -r . 00:06:15.922 [2024-11-29 16:48:27.031352] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.922 [2024-11-29 16:48:27.031430] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96052 ] 00:06:15.922 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.922 [2024-11-29 16:48:27.092595] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.922 [2024-11-29 16:48:27.208708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.296 16:48:28 -- accel/accel.sh@18 -- # out=' 00:06:17.296 SPDK Configuration: 00:06:17.296 Core mask: 0x1 00:06:17.296 00:06:17.296 Accel Perf Configuration: 00:06:17.296 Workload Type: dif_generate 00:06:17.296 Vector size: 4096 bytes 00:06:17.296 Transfer size: 4096 bytes 00:06:17.296 Block size: 512 bytes 00:06:17.296 Metadata size: 8 bytes 00:06:17.296 Vector count 1 00:06:17.296 Module: software 00:06:17.296 Queue depth: 32 00:06:17.296 Allocate depth: 32 00:06:17.296 # threads/core: 1 00:06:17.296 Run time: 1 seconds 00:06:17.296 Verify: No 00:06:17.296 00:06:17.296 Running for 1 seconds... 00:06:17.296 00:06:17.296 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:17.296 ------------------------------------------------------------------------------------ 00:06:17.296 0,0 96192/s 381 MiB/s 0 0 00:06:17.296 ==================================================================================== 00:06:17.296 Total 96192/s 375 MiB/s 0 0' 00:06:17.296 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.296 16:48:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:17.296 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.296 16:48:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:17.296 16:48:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.296 16:48:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.296 16:48:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.296 16:48:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.296 16:48:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.296 16:48:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.296 16:48:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.296 16:48:28 -- accel/accel.sh@42 -- # jq -r . 00:06:17.296 [2024-11-29 16:48:28.497819] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.296 [2024-11-29 16:48:28.497905] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96193 ] 00:06:17.296 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.296 [2024-11-29 16:48:28.558374] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.296 [2024-11-29 16:48:28.674175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.555 16:48:28 -- accel/accel.sh@21 -- # val= 00:06:17.555 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.555 16:48:28 -- accel/accel.sh@21 -- # val= 00:06:17.555 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.555 16:48:28 -- accel/accel.sh@21 -- # val=0x1 00:06:17.555 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.555 16:48:28 -- accel/accel.sh@21 -- # val= 00:06:17.555 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.555 16:48:28 -- accel/accel.sh@21 -- # val= 00:06:17.555 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.555 16:48:28 -- accel/accel.sh@21 -- # val=dif_generate 00:06:17.555 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.555 16:48:28 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.555 16:48:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:17.555 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.555 16:48:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:17.555 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.555 16:48:28 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:17.555 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.555 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val= 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val=software 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val=32 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val=32 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val=1 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val=No 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val= 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:17.556 16:48:28 -- accel/accel.sh@21 -- # val= 00:06:17.556 16:48:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # IFS=: 00:06:17.556 16:48:28 -- accel/accel.sh@20 -- # read -r var val 00:06:18.931 16:48:29 -- accel/accel.sh@21 -- # val= 00:06:18.931 16:48:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # IFS=: 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # read -r var val 00:06:18.931 16:48:29 -- accel/accel.sh@21 -- # val= 00:06:18.931 16:48:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # IFS=: 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # read -r var val 00:06:18.931 16:48:29 -- accel/accel.sh@21 -- # val= 00:06:18.931 16:48:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # IFS=: 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # read -r var val 00:06:18.931 16:48:29 -- accel/accel.sh@21 -- # val= 00:06:18.931 16:48:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # IFS=: 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # read -r var val 00:06:18.931 16:48:29 -- accel/accel.sh@21 -- # val= 00:06:18.931 16:48:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # IFS=: 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # read -r var val 00:06:18.931 16:48:29 -- accel/accel.sh@21 -- # val= 00:06:18.931 16:48:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # IFS=: 00:06:18.931 16:48:29 -- accel/accel.sh@20 -- # read -r var val 00:06:18.931 16:48:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:18.931 16:48:29 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:18.931 16:48:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.931 00:06:18.931 real 0m2.940s 00:06:18.932 user 0m2.649s 00:06:18.932 sys 0m0.285s 00:06:18.932 16:48:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.932 16:48:29 -- common/autotest_common.sh@10 -- # set +x 00:06:18.932 ************************************ 00:06:18.932 END TEST accel_dif_generate 00:06:18.932 ************************************ 00:06:18.932 16:48:29 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:18.932 16:48:29 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:18.932 16:48:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.932 16:48:29 -- common/autotest_common.sh@10 -- # set +x 00:06:18.932 ************************************ 00:06:18.932 START TEST accel_dif_generate_copy 00:06:18.932 ************************************ 00:06:18.932 16:48:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:18.932 16:48:29 -- accel/accel.sh@16 -- # local accel_opc 00:06:18.932 16:48:29 -- accel/accel.sh@17 -- # local accel_module 00:06:18.932 16:48:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:18.932 16:48:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:18.932 16:48:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.932 16:48:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.932 16:48:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.932 16:48:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.932 16:48:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.932 16:48:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.932 16:48:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.932 16:48:29 -- accel/accel.sh@42 -- # jq -r . 00:06:18.932 [2024-11-29 16:48:29.994407] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.932 [2024-11-29 16:48:29.994491] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96354 ] 00:06:18.932 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.932 [2024-11-29 16:48:30.059193] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.932 [2024-11-29 16:48:30.175040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.308 16:48:31 -- accel/accel.sh@18 -- # out=' 00:06:20.308 SPDK Configuration: 00:06:20.308 Core mask: 0x1 00:06:20.308 00:06:20.308 Accel Perf Configuration: 00:06:20.308 Workload Type: dif_generate_copy 00:06:20.308 Vector size: 4096 bytes 00:06:20.308 Transfer size: 4096 bytes 00:06:20.308 Vector count 1 00:06:20.308 Module: software 00:06:20.308 Queue depth: 32 00:06:20.308 Allocate depth: 32 00:06:20.308 # threads/core: 1 00:06:20.308 Run time: 1 seconds 00:06:20.308 Verify: No 00:06:20.308 00:06:20.308 Running for 1 seconds... 00:06:20.308 00:06:20.308 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:20.308 ------------------------------------------------------------------------------------ 00:06:20.308 0,0 76128/s 302 MiB/s 0 0 00:06:20.308 ==================================================================================== 00:06:20.308 Total 76128/s 297 MiB/s 0 0' 00:06:20.308 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.308 16:48:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:20.308 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:20.309 16:48:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:20.309 16:48:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:20.309 16:48:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:20.309 16:48:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:20.309 16:48:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:20.309 16:48:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:20.309 16:48:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:20.309 16:48:31 -- accel/accel.sh@42 -- # jq -r . 00:06:20.309 [2024-11-29 16:48:31.458875] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.309 [2024-11-29 16:48:31.458973] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96611 ] 00:06:20.309 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.309 [2024-11-29 16:48:31.520699] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.309 [2024-11-29 16:48:31.633836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val= 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val= 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val=0x1 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val= 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val= 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val= 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val=software 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@23 -- # accel_module=software 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val=32 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val=32 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val=1 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val=No 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val= 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:20.309 16:48:31 -- accel/accel.sh@21 -- # val= 00:06:20.309 16:48:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # IFS=: 00:06:20.309 16:48:31 -- accel/accel.sh@20 -- # read -r var val 00:06:21.685 16:48:32 -- accel/accel.sh@21 -- # val= 00:06:21.685 16:48:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # IFS=: 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # read -r var val 00:06:21.685 16:48:32 -- accel/accel.sh@21 -- # val= 00:06:21.685 16:48:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # IFS=: 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # read -r var val 00:06:21.685 16:48:32 -- accel/accel.sh@21 -- # val= 00:06:21.685 16:48:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # IFS=: 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # read -r var val 00:06:21.685 16:48:32 -- accel/accel.sh@21 -- # val= 00:06:21.685 16:48:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # IFS=: 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # read -r var val 00:06:21.685 16:48:32 -- accel/accel.sh@21 -- # val= 00:06:21.685 16:48:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # IFS=: 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # read -r var val 00:06:21.685 16:48:32 -- accel/accel.sh@21 -- # val= 00:06:21.685 16:48:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # IFS=: 00:06:21.685 16:48:32 -- accel/accel.sh@20 -- # read -r var val 00:06:21.685 16:48:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:21.685 16:48:32 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:21.685 16:48:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:21.685 00:06:21.685 real 0m2.925s 00:06:21.685 user 0m2.625s 00:06:21.685 sys 0m0.290s 00:06:21.685 16:48:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.685 16:48:32 -- common/autotest_common.sh@10 -- # set +x 00:06:21.685 ************************************ 00:06:21.685 END TEST accel_dif_generate_copy 00:06:21.685 ************************************ 00:06:21.685 16:48:32 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:21.685 16:48:32 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.685 16:48:32 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:21.685 16:48:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.686 16:48:32 -- common/autotest_common.sh@10 -- # set +x 00:06:21.686 ************************************ 00:06:21.686 START TEST accel_comp 00:06:21.686 ************************************ 00:06:21.686 16:48:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.686 16:48:32 -- accel/accel.sh@16 -- # local accel_opc 00:06:21.686 16:48:32 -- accel/accel.sh@17 -- # local accel_module 00:06:21.686 16:48:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.686 16:48:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.686 16:48:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.686 16:48:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.686 16:48:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.686 16:48:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.686 16:48:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.686 16:48:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.686 16:48:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.686 16:48:32 -- accel/accel.sh@42 -- # jq -r . 00:06:21.686 [2024-11-29 16:48:32.941939] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.686 [2024-11-29 16:48:32.942037] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96782 ] 00:06:21.686 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.686 [2024-11-29 16:48:33.004695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.944 [2024-11-29 16:48:33.122165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.321 16:48:34 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:23.321 00:06:23.321 SPDK Configuration: 00:06:23.321 Core mask: 0x1 00:06:23.321 00:06:23.321 Accel Perf Configuration: 00:06:23.321 Workload Type: compress 00:06:23.321 Transfer size: 4096 bytes 00:06:23.321 Vector count 1 00:06:23.321 Module: software 00:06:23.321 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.321 Queue depth: 32 00:06:23.321 Allocate depth: 32 00:06:23.321 # threads/core: 1 00:06:23.321 Run time: 1 seconds 00:06:23.321 Verify: No 00:06:23.321 00:06:23.321 Running for 1 seconds... 00:06:23.321 00:06:23.321 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:23.321 ------------------------------------------------------------------------------------ 00:06:23.321 0,0 32352/s 134 MiB/s 0 0 00:06:23.321 ==================================================================================== 00:06:23.321 Total 32352/s 126 MiB/s 0 0' 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.321 16:48:34 -- accel/accel.sh@12 -- # build_accel_config 00:06:23.321 16:48:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.321 16:48:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.321 16:48:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.321 16:48:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.321 16:48:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.321 16:48:34 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.321 16:48:34 -- accel/accel.sh@42 -- # jq -r . 00:06:23.321 [2024-11-29 16:48:34.421935] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.321 [2024-11-29 16:48:34.422045] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96920 ] 00:06:23.321 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.321 [2024-11-29 16:48:34.483094] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.321 [2024-11-29 16:48:34.599076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val= 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val= 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val= 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val=0x1 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val= 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val= 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val=compress 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val= 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val=software 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@23 -- # accel_module=software 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.321 16:48:34 -- accel/accel.sh@21 -- # val=32 00:06:23.321 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.321 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.322 16:48:34 -- accel/accel.sh@21 -- # val=32 00:06:23.322 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.322 16:48:34 -- accel/accel.sh@21 -- # val=1 00:06:23.322 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.322 16:48:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:23.322 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.322 16:48:34 -- accel/accel.sh@21 -- # val=No 00:06:23.322 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.322 16:48:34 -- accel/accel.sh@21 -- # val= 00:06:23.322 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:23.322 16:48:34 -- accel/accel.sh@21 -- # val= 00:06:23.322 16:48:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # IFS=: 00:06:23.322 16:48:34 -- accel/accel.sh@20 -- # read -r var val 00:06:24.695 16:48:35 -- accel/accel.sh@21 -- # val= 00:06:24.695 16:48:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # IFS=: 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # read -r var val 00:06:24.695 16:48:35 -- accel/accel.sh@21 -- # val= 00:06:24.695 16:48:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # IFS=: 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # read -r var val 00:06:24.695 16:48:35 -- accel/accel.sh@21 -- # val= 00:06:24.695 16:48:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # IFS=: 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # read -r var val 00:06:24.695 16:48:35 -- accel/accel.sh@21 -- # val= 00:06:24.695 16:48:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # IFS=: 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # read -r var val 00:06:24.695 16:48:35 -- accel/accel.sh@21 -- # val= 00:06:24.695 16:48:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # IFS=: 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # read -r var val 00:06:24.695 16:48:35 -- accel/accel.sh@21 -- # val= 00:06:24.695 16:48:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # IFS=: 00:06:24.695 16:48:35 -- accel/accel.sh@20 -- # read -r var val 00:06:24.695 16:48:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:24.695 16:48:35 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:24.695 16:48:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:24.695 00:06:24.695 real 0m2.948s 00:06:24.695 user 0m2.653s 00:06:24.695 sys 0m0.287s 00:06:24.695 16:48:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.695 16:48:35 -- common/autotest_common.sh@10 -- # set +x 00:06:24.695 ************************************ 00:06:24.695 END TEST accel_comp 00:06:24.695 ************************************ 00:06:24.695 16:48:35 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:24.695 16:48:35 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:24.695 16:48:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.695 16:48:35 -- common/autotest_common.sh@10 -- # set +x 00:06:24.695 ************************************ 00:06:24.695 START TEST accel_decomp 00:06:24.695 ************************************ 00:06:24.695 16:48:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:24.695 16:48:35 -- accel/accel.sh@16 -- # local accel_opc 00:06:24.695 16:48:35 -- accel/accel.sh@17 -- # local accel_module 00:06:24.695 16:48:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:24.695 16:48:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:24.695 16:48:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.695 16:48:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.695 16:48:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.695 16:48:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.695 16:48:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.695 16:48:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.695 16:48:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.695 16:48:35 -- accel/accel.sh@42 -- # jq -r . 00:06:24.695 [2024-11-29 16:48:35.914473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.695 [2024-11-29 16:48:35.914554] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97100 ] 00:06:24.695 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.695 [2024-11-29 16:48:35.976120] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.695 [2024-11-29 16:48:36.091879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.071 16:48:37 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:26.071 00:06:26.071 SPDK Configuration: 00:06:26.071 Core mask: 0x1 00:06:26.071 00:06:26.071 Accel Perf Configuration: 00:06:26.071 Workload Type: decompress 00:06:26.071 Transfer size: 4096 bytes 00:06:26.071 Vector count 1 00:06:26.071 Module: software 00:06:26.071 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.071 Queue depth: 32 00:06:26.071 Allocate depth: 32 00:06:26.071 # threads/core: 1 00:06:26.071 Run time: 1 seconds 00:06:26.071 Verify: Yes 00:06:26.071 00:06:26.071 Running for 1 seconds... 00:06:26.071 00:06:26.071 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:26.071 ------------------------------------------------------------------------------------ 00:06:26.071 0,0 55456/s 102 MiB/s 0 0 00:06:26.071 ==================================================================================== 00:06:26.071 Total 55456/s 216 MiB/s 0 0' 00:06:26.071 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.071 16:48:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:26.071 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.071 16:48:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:26.071 16:48:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.071 16:48:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.071 16:48:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.071 16:48:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.071 16:48:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.071 16:48:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.071 16:48:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.071 16:48:37 -- accel/accel.sh@42 -- # jq -r . 00:06:26.071 [2024-11-29 16:48:37.380632] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.071 [2024-11-29 16:48:37.380721] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97347 ] 00:06:26.071 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.071 [2024-11-29 16:48:37.440053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.336 [2024-11-29 16:48:37.555367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val= 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val= 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val= 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val=0x1 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val= 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val= 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val=decompress 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val= 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val=software 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@23 -- # accel_module=software 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val=32 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val=32 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val=1 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val=Yes 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val= 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:26.336 16:48:37 -- accel/accel.sh@21 -- # val= 00:06:26.336 16:48:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # IFS=: 00:06:26.336 16:48:37 -- accel/accel.sh@20 -- # read -r var val 00:06:27.711 16:48:38 -- accel/accel.sh@21 -- # val= 00:06:27.711 16:48:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # IFS=: 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # read -r var val 00:06:27.711 16:48:38 -- accel/accel.sh@21 -- # val= 00:06:27.711 16:48:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # IFS=: 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # read -r var val 00:06:27.711 16:48:38 -- accel/accel.sh@21 -- # val= 00:06:27.711 16:48:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # IFS=: 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # read -r var val 00:06:27.711 16:48:38 -- accel/accel.sh@21 -- # val= 00:06:27.711 16:48:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # IFS=: 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # read -r var val 00:06:27.711 16:48:38 -- accel/accel.sh@21 -- # val= 00:06:27.711 16:48:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # IFS=: 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # read -r var val 00:06:27.711 16:48:38 -- accel/accel.sh@21 -- # val= 00:06:27.711 16:48:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # IFS=: 00:06:27.711 16:48:38 -- accel/accel.sh@20 -- # read -r var val 00:06:27.711 16:48:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:27.711 16:48:38 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:27.711 16:48:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:27.711 00:06:27.711 real 0m2.939s 00:06:27.711 user 0m2.647s 00:06:27.711 sys 0m0.283s 00:06:27.711 16:48:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.711 16:48:38 -- common/autotest_common.sh@10 -- # set +x 00:06:27.711 ************************************ 00:06:27.711 END TEST accel_decomp 00:06:27.711 ************************************ 00:06:27.711 16:48:38 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:27.711 16:48:38 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:27.711 16:48:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.711 16:48:38 -- common/autotest_common.sh@10 -- # set +x 00:06:27.711 ************************************ 00:06:27.711 START TEST accel_decmop_full 00:06:27.711 ************************************ 00:06:27.711 16:48:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:27.711 16:48:38 -- accel/accel.sh@16 -- # local accel_opc 00:06:27.711 16:48:38 -- accel/accel.sh@17 -- # local accel_module 00:06:27.711 16:48:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:27.711 16:48:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:27.711 16:48:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.711 16:48:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.711 16:48:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.711 16:48:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.711 16:48:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.711 16:48:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.711 16:48:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.711 16:48:38 -- accel/accel.sh@42 -- # jq -r . 00:06:27.711 [2024-11-29 16:48:38.875788] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.711 [2024-11-29 16:48:38.875878] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97506 ] 00:06:27.711 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.711 [2024-11-29 16:48:38.940206] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.711 [2024-11-29 16:48:39.056532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.088 16:48:40 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:29.088 00:06:29.088 SPDK Configuration: 00:06:29.088 Core mask: 0x1 00:06:29.088 00:06:29.088 Accel Perf Configuration: 00:06:29.088 Workload Type: decompress 00:06:29.088 Transfer size: 111250 bytes 00:06:29.088 Vector count 1 00:06:29.088 Module: software 00:06:29.088 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.088 Queue depth: 32 00:06:29.088 Allocate depth: 32 00:06:29.088 # threads/core: 1 00:06:29.088 Run time: 1 seconds 00:06:29.088 Verify: Yes 00:06:29.088 00:06:29.088 Running for 1 seconds... 00:06:29.088 00:06:29.088 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:29.088 ------------------------------------------------------------------------------------ 00:06:29.088 0,0 3808/s 157 MiB/s 0 0 00:06:29.088 ==================================================================================== 00:06:29.088 Total 3808/s 404 MiB/s 0 0' 00:06:29.088 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.088 16:48:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:29.088 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.088 16:48:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:29.088 16:48:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.088 16:48:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.088 16:48:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.088 16:48:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.088 16:48:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.088 16:48:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.088 16:48:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.088 16:48:40 -- accel/accel.sh@42 -- # jq -r . 00:06:29.088 [2024-11-29 16:48:40.363110] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.088 [2024-11-29 16:48:40.363194] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97650 ] 00:06:29.088 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.088 [2024-11-29 16:48:40.429145] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.348 [2024-11-29 16:48:40.548472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val= 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val= 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val= 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val=0x1 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val= 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val= 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val=decompress 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val= 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val=software 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@23 -- # accel_module=software 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.348 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.348 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.348 16:48:40 -- accel/accel.sh@21 -- # val=32 00:06:29.349 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.349 16:48:40 -- accel/accel.sh@21 -- # val=32 00:06:29.349 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.349 16:48:40 -- accel/accel.sh@21 -- # val=1 00:06:29.349 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.349 16:48:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:29.349 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.349 16:48:40 -- accel/accel.sh@21 -- # val=Yes 00:06:29.349 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.349 16:48:40 -- accel/accel.sh@21 -- # val= 00:06:29.349 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:29.349 16:48:40 -- accel/accel.sh@21 -- # val= 00:06:29.349 16:48:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # IFS=: 00:06:29.349 16:48:40 -- accel/accel.sh@20 -- # read -r var val 00:06:30.723 16:48:41 -- accel/accel.sh@21 -- # val= 00:06:30.723 16:48:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # IFS=: 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # read -r var val 00:06:30.723 16:48:41 -- accel/accel.sh@21 -- # val= 00:06:30.723 16:48:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # IFS=: 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # read -r var val 00:06:30.723 16:48:41 -- accel/accel.sh@21 -- # val= 00:06:30.723 16:48:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # IFS=: 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # read -r var val 00:06:30.723 16:48:41 -- accel/accel.sh@21 -- # val= 00:06:30.723 16:48:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # IFS=: 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # read -r var val 00:06:30.723 16:48:41 -- accel/accel.sh@21 -- # val= 00:06:30.723 16:48:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # IFS=: 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # read -r var val 00:06:30.723 16:48:41 -- accel/accel.sh@21 -- # val= 00:06:30.723 16:48:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # IFS=: 00:06:30.723 16:48:41 -- accel/accel.sh@20 -- # read -r var val 00:06:30.723 16:48:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:30.723 16:48:41 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:30.723 16:48:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:30.723 00:06:30.723 real 0m2.985s 00:06:30.723 user 0m2.688s 00:06:30.723 sys 0m0.288s 00:06:30.723 16:48:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.723 16:48:41 -- common/autotest_common.sh@10 -- # set +x 00:06:30.723 ************************************ 00:06:30.723 END TEST accel_decmop_full 00:06:30.723 ************************************ 00:06:30.723 16:48:41 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:30.723 16:48:41 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:30.723 16:48:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.723 16:48:41 -- common/autotest_common.sh@10 -- # set +x 00:06:30.723 ************************************ 00:06:30.724 START TEST accel_decomp_mcore 00:06:30.724 ************************************ 00:06:30.724 16:48:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:30.724 16:48:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:30.724 16:48:41 -- accel/accel.sh@17 -- # local accel_module 00:06:30.724 16:48:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:30.724 16:48:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:30.724 16:48:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.724 16:48:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.724 16:48:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.724 16:48:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.724 16:48:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.724 16:48:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.724 16:48:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.724 16:48:41 -- accel/accel.sh@42 -- # jq -r . 00:06:30.724 [2024-11-29 16:48:41.886319] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.724 [2024-11-29 16:48:41.886404] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97927 ] 00:06:30.724 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.724 [2024-11-29 16:48:41.950764] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:30.724 [2024-11-29 16:48:42.068363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:30.724 [2024-11-29 16:48:42.068430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:30.724 [2024-11-29 16:48:42.068529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:30.724 [2024-11-29 16:48:42.068533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.097 16:48:43 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:32.097 00:06:32.097 SPDK Configuration: 00:06:32.097 Core mask: 0xf 00:06:32.097 00:06:32.097 Accel Perf Configuration: 00:06:32.097 Workload Type: decompress 00:06:32.097 Transfer size: 4096 bytes 00:06:32.097 Vector count 1 00:06:32.097 Module: software 00:06:32.097 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:32.097 Queue depth: 32 00:06:32.097 Allocate depth: 32 00:06:32.097 # threads/core: 1 00:06:32.097 Run time: 1 seconds 00:06:32.097 Verify: Yes 00:06:32.097 00:06:32.097 Running for 1 seconds... 00:06:32.097 00:06:32.097 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:32.097 ------------------------------------------------------------------------------------ 00:06:32.097 0,0 56736/s 104 MiB/s 0 0 00:06:32.097 3,0 57280/s 105 MiB/s 0 0 00:06:32.097 2,0 57088/s 105 MiB/s 0 0 00:06:32.098 1,0 57024/s 105 MiB/s 0 0 00:06:32.098 ==================================================================================== 00:06:32.098 Total 228128/s 891 MiB/s 0 0' 00:06:32.098 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.098 16:48:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:32.098 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.098 16:48:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:32.098 16:48:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.098 16:48:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.098 16:48:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.098 16:48:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.098 16:48:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.098 16:48:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.098 16:48:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.098 16:48:43 -- accel/accel.sh@42 -- # jq -r . 00:06:32.098 [2024-11-29 16:48:43.353190] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:32.098 [2024-11-29 16:48:43.353285] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98078 ] 00:06:32.098 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.098 [2024-11-29 16:48:43.415822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:32.356 [2024-11-29 16:48:43.535794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:32.356 [2024-11-29 16:48:43.535863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:32.356 [2024-11-29 16:48:43.535954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:32.356 [2024-11-29 16:48:43.535965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val= 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val= 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val= 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val=0xf 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val= 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val= 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val=decompress 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val= 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val=software 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@23 -- # accel_module=software 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val=32 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val=32 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val=1 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val=Yes 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val= 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:32.356 16:48:43 -- accel/accel.sh@21 -- # val= 00:06:32.356 16:48:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # IFS=: 00:06:32.356 16:48:43 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@21 -- # val= 00:06:33.730 16:48:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # IFS=: 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@21 -- # val= 00:06:33.730 16:48:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # IFS=: 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@21 -- # val= 00:06:33.730 16:48:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # IFS=: 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@21 -- # val= 00:06:33.730 16:48:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # IFS=: 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@21 -- # val= 00:06:33.730 16:48:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # IFS=: 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@21 -- # val= 00:06:33.730 16:48:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # IFS=: 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@21 -- # val= 00:06:33.730 16:48:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # IFS=: 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@21 -- # val= 00:06:33.730 16:48:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # IFS=: 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@21 -- # val= 00:06:33.730 16:48:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # IFS=: 00:06:33.730 16:48:44 -- accel/accel.sh@20 -- # read -r var val 00:06:33.730 16:48:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:33.730 16:48:44 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:33.730 16:48:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:33.730 00:06:33.730 real 0m2.953s 00:06:33.730 user 0m9.519s 00:06:33.730 sys 0m0.303s 00:06:33.730 16:48:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.730 16:48:44 -- common/autotest_common.sh@10 -- # set +x 00:06:33.730 ************************************ 00:06:33.730 END TEST accel_decomp_mcore 00:06:33.730 ************************************ 00:06:33.730 16:48:44 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:33.730 16:48:44 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:33.730 16:48:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.730 16:48:44 -- common/autotest_common.sh@10 -- # set +x 00:06:33.730 ************************************ 00:06:33.730 START TEST accel_decomp_full_mcore 00:06:33.730 ************************************ 00:06:33.730 16:48:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:33.730 16:48:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:33.730 16:48:44 -- accel/accel.sh@17 -- # local accel_module 00:06:33.730 16:48:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:33.730 16:48:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:33.730 16:48:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.730 16:48:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.730 16:48:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.730 16:48:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.730 16:48:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.730 16:48:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.730 16:48:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.730 16:48:44 -- accel/accel.sh@42 -- # jq -r . 00:06:33.730 [2024-11-29 16:48:44.865043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.730 [2024-11-29 16:48:44.865132] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98237 ] 00:06:33.730 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.730 [2024-11-29 16:48:44.928897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:33.730 [2024-11-29 16:48:45.050504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:33.730 [2024-11-29 16:48:45.050571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:33.730 [2024-11-29 16:48:45.050663] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:33.730 [2024-11-29 16:48:45.050665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.101 16:48:46 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:35.101 00:06:35.101 SPDK Configuration: 00:06:35.101 Core mask: 0xf 00:06:35.101 00:06:35.101 Accel Perf Configuration: 00:06:35.101 Workload Type: decompress 00:06:35.101 Transfer size: 111250 bytes 00:06:35.101 Vector count 1 00:06:35.101 Module: software 00:06:35.101 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:35.101 Queue depth: 32 00:06:35.101 Allocate depth: 32 00:06:35.101 # threads/core: 1 00:06:35.101 Run time: 1 seconds 00:06:35.101 Verify: Yes 00:06:35.101 00:06:35.101 Running for 1 seconds... 00:06:35.101 00:06:35.101 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:35.101 ------------------------------------------------------------------------------------ 00:06:35.101 0,0 4288/s 177 MiB/s 0 0 00:06:35.101 3,0 4288/s 177 MiB/s 0 0 00:06:35.101 2,0 4288/s 177 MiB/s 0 0 00:06:35.101 1,0 4288/s 177 MiB/s 0 0 00:06:35.101 ==================================================================================== 00:06:35.101 Total 17152/s 1819 MiB/s 0 0' 00:06:35.101 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.101 16:48:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:35.101 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.101 16:48:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:35.101 16:48:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:35.101 16:48:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.101 16:48:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.101 16:48:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.101 16:48:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.101 16:48:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.101 16:48:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.101 16:48:46 -- accel/accel.sh@42 -- # jq -r . 00:06:35.101 [2024-11-29 16:48:46.355707] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:35.101 [2024-11-29 16:48:46.355804] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98508 ] 00:06:35.101 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.101 [2024-11-29 16:48:46.417593] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:35.360 [2024-11-29 16:48:46.537764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:35.360 [2024-11-29 16:48:46.537829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:35.360 [2024-11-29 16:48:46.537921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:35.360 [2024-11-29 16:48:46.537924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val= 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val= 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val= 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val=0xf 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val= 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val= 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val=decompress 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val= 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val=software 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@23 -- # accel_module=software 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val=32 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val=32 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val=1 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val=Yes 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val= 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:35.360 16:48:46 -- accel/accel.sh@21 -- # val= 00:06:35.360 16:48:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # IFS=: 00:06:35.360 16:48:46 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@21 -- # val= 00:06:36.737 16:48:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # IFS=: 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@21 -- # val= 00:06:36.737 16:48:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # IFS=: 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@21 -- # val= 00:06:36.737 16:48:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # IFS=: 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@21 -- # val= 00:06:36.737 16:48:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # IFS=: 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@21 -- # val= 00:06:36.737 16:48:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # IFS=: 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@21 -- # val= 00:06:36.737 16:48:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # IFS=: 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@21 -- # val= 00:06:36.737 16:48:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # IFS=: 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@21 -- # val= 00:06:36.737 16:48:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # IFS=: 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@21 -- # val= 00:06:36.737 16:48:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # IFS=: 00:06:36.737 16:48:47 -- accel/accel.sh@20 -- # read -r var val 00:06:36.737 16:48:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:36.737 16:48:47 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:36.737 16:48:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:36.737 00:06:36.737 real 0m2.989s 00:06:36.737 user 0m9.623s 00:06:36.737 sys 0m0.309s 00:06:36.737 16:48:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.737 16:48:47 -- common/autotest_common.sh@10 -- # set +x 00:06:36.737 ************************************ 00:06:36.737 END TEST accel_decomp_full_mcore 00:06:36.737 ************************************ 00:06:36.737 16:48:47 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:36.737 16:48:47 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:36.737 16:48:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.737 16:48:47 -- common/autotest_common.sh@10 -- # set +x 00:06:36.737 ************************************ 00:06:36.737 START TEST accel_decomp_mthread 00:06:36.737 ************************************ 00:06:36.737 16:48:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:36.737 16:48:47 -- accel/accel.sh@16 -- # local accel_opc 00:06:36.737 16:48:47 -- accel/accel.sh@17 -- # local accel_module 00:06:36.737 16:48:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:36.737 16:48:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:36.737 16:48:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.737 16:48:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.737 16:48:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.737 16:48:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.737 16:48:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.737 16:48:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.737 16:48:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.737 16:48:47 -- accel/accel.sh@42 -- # jq -r . 00:06:36.737 [2024-11-29 16:48:47.878754] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.737 [2024-11-29 16:48:47.878845] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98666 ] 00:06:36.737 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.737 [2024-11-29 16:48:47.944577] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.737 [2024-11-29 16:48:48.062261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.114 16:48:49 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:38.114 00:06:38.114 SPDK Configuration: 00:06:38.114 Core mask: 0x1 00:06:38.114 00:06:38.114 Accel Perf Configuration: 00:06:38.114 Workload Type: decompress 00:06:38.114 Transfer size: 4096 bytes 00:06:38.114 Vector count 1 00:06:38.114 Module: software 00:06:38.114 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:38.114 Queue depth: 32 00:06:38.114 Allocate depth: 32 00:06:38.114 # threads/core: 2 00:06:38.114 Run time: 1 seconds 00:06:38.114 Verify: Yes 00:06:38.114 00:06:38.114 Running for 1 seconds... 00:06:38.114 00:06:38.114 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:38.114 ------------------------------------------------------------------------------------ 00:06:38.114 0,1 28064/s 51 MiB/s 0 0 00:06:38.114 0,0 27968/s 51 MiB/s 0 0 00:06:38.114 ==================================================================================== 00:06:38.114 Total 56032/s 218 MiB/s 0 0' 00:06:38.114 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.114 16:48:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:38.114 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.114 16:48:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:38.114 16:48:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.114 16:48:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.114 16:48:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.114 16:48:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.114 16:48:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.114 16:48:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.114 16:48:49 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.114 16:48:49 -- accel/accel.sh@42 -- # jq -r . 00:06:38.114 [2024-11-29 16:48:49.359631] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:38.114 [2024-11-29 16:48:49.359730] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98815 ] 00:06:38.114 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.114 [2024-11-29 16:48:49.421786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.114 [2024-11-29 16:48:49.541803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val= 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val= 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val= 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val=0x1 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val= 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val= 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val=decompress 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val= 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val=software 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@23 -- # accel_module=software 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val=32 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val=32 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val=2 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val=Yes 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val= 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:38.373 16:48:49 -- accel/accel.sh@21 -- # val= 00:06:38.373 16:48:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # IFS=: 00:06:38.373 16:48:49 -- accel/accel.sh@20 -- # read -r var val 00:06:39.750 16:48:50 -- accel/accel.sh@21 -- # val= 00:06:39.750 16:48:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # IFS=: 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # read -r var val 00:06:39.750 16:48:50 -- accel/accel.sh@21 -- # val= 00:06:39.750 16:48:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # IFS=: 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # read -r var val 00:06:39.750 16:48:50 -- accel/accel.sh@21 -- # val= 00:06:39.750 16:48:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # IFS=: 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # read -r var val 00:06:39.750 16:48:50 -- accel/accel.sh@21 -- # val= 00:06:39.750 16:48:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # IFS=: 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # read -r var val 00:06:39.750 16:48:50 -- accel/accel.sh@21 -- # val= 00:06:39.750 16:48:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # IFS=: 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # read -r var val 00:06:39.750 16:48:50 -- accel/accel.sh@21 -- # val= 00:06:39.750 16:48:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # IFS=: 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # read -r var val 00:06:39.750 16:48:50 -- accel/accel.sh@21 -- # val= 00:06:39.750 16:48:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # IFS=: 00:06:39.750 16:48:50 -- accel/accel.sh@20 -- # read -r var val 00:06:39.750 16:48:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:39.750 16:48:50 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:39.750 16:48:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:39.750 00:06:39.750 real 0m2.963s 00:06:39.750 user 0m2.655s 00:06:39.750 sys 0m0.299s 00:06:39.750 16:48:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.750 16:48:50 -- common/autotest_common.sh@10 -- # set +x 00:06:39.750 ************************************ 00:06:39.750 END TEST accel_decomp_mthread 00:06:39.750 ************************************ 00:06:39.750 16:48:50 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:39.750 16:48:50 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:39.750 16:48:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.750 16:48:50 -- common/autotest_common.sh@10 -- # set +x 00:06:39.750 ************************************ 00:06:39.750 START TEST accel_deomp_full_mthread 00:06:39.750 ************************************ 00:06:39.750 16:48:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:39.750 16:48:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:39.751 16:48:50 -- accel/accel.sh@17 -- # local accel_module 00:06:39.751 16:48:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:39.751 16:48:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:39.751 16:48:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:39.751 16:48:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:39.751 16:48:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.751 16:48:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.751 16:48:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:39.751 16:48:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:39.751 16:48:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:39.751 16:48:50 -- accel/accel.sh@42 -- # jq -r . 00:06:39.751 [2024-11-29 16:48:50.870215] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.751 [2024-11-29 16:48:50.870302] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99094 ] 00:06:39.751 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.751 [2024-11-29 16:48:50.931906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.751 [2024-11-29 16:48:51.054582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.126 16:48:52 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:41.126 00:06:41.126 SPDK Configuration: 00:06:41.126 Core mask: 0x1 00:06:41.126 00:06:41.126 Accel Perf Configuration: 00:06:41.126 Workload Type: decompress 00:06:41.126 Transfer size: 111250 bytes 00:06:41.126 Vector count 1 00:06:41.126 Module: software 00:06:41.126 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:41.126 Queue depth: 32 00:06:41.126 Allocate depth: 32 00:06:41.126 # threads/core: 2 00:06:41.126 Run time: 1 seconds 00:06:41.126 Verify: Yes 00:06:41.126 00:06:41.126 Running for 1 seconds... 00:06:41.126 00:06:41.126 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:41.126 ------------------------------------------------------------------------------------ 00:06:41.126 0,1 1952/s 80 MiB/s 0 0 00:06:41.126 0,0 1920/s 79 MiB/s 0 0 00:06:41.126 ==================================================================================== 00:06:41.126 Total 3872/s 410 MiB/s 0 0' 00:06:41.126 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.126 16:48:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:41.126 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.126 16:48:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:41.126 16:48:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:41.126 16:48:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:41.126 16:48:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:41.126 16:48:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:41.126 16:48:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:41.126 16:48:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:41.126 16:48:52 -- accel/accel.sh@41 -- # local IFS=, 00:06:41.126 16:48:52 -- accel/accel.sh@42 -- # jq -r . 00:06:41.126 [2024-11-29 16:48:52.394346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:41.126 [2024-11-29 16:48:52.394435] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99238 ] 00:06:41.126 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.126 [2024-11-29 16:48:52.456674] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.385 [2024-11-29 16:48:52.577476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val= 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val= 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val= 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val=0x1 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val= 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val= 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val=decompress 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val= 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val=software 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@23 -- # accel_module=software 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val=32 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val=32 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val=2 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val=Yes 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val= 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:41.385 16:48:52 -- accel/accel.sh@21 -- # val= 00:06:41.385 16:48:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # IFS=: 00:06:41.385 16:48:52 -- accel/accel.sh@20 -- # read -r var val 00:06:42.760 16:48:53 -- accel/accel.sh@21 -- # val= 00:06:42.760 16:48:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # IFS=: 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # read -r var val 00:06:42.760 16:48:53 -- accel/accel.sh@21 -- # val= 00:06:42.760 16:48:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # IFS=: 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # read -r var val 00:06:42.760 16:48:53 -- accel/accel.sh@21 -- # val= 00:06:42.760 16:48:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # IFS=: 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # read -r var val 00:06:42.760 16:48:53 -- accel/accel.sh@21 -- # val= 00:06:42.760 16:48:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # IFS=: 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # read -r var val 00:06:42.760 16:48:53 -- accel/accel.sh@21 -- # val= 00:06:42.760 16:48:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # IFS=: 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # read -r var val 00:06:42.760 16:48:53 -- accel/accel.sh@21 -- # val= 00:06:42.760 16:48:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # IFS=: 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # read -r var val 00:06:42.760 16:48:53 -- accel/accel.sh@21 -- # val= 00:06:42.760 16:48:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # IFS=: 00:06:42.760 16:48:53 -- accel/accel.sh@20 -- # read -r var val 00:06:42.760 16:48:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:42.760 16:48:53 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:42.760 16:48:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:42.760 00:06:42.760 real 0m3.048s 00:06:42.760 user 0m2.749s 00:06:42.760 sys 0m0.291s 00:06:42.760 16:48:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.760 16:48:53 -- common/autotest_common.sh@10 -- # set +x 00:06:42.760 ************************************ 00:06:42.760 END TEST accel_deomp_full_mthread 00:06:42.760 ************************************ 00:06:42.760 16:48:53 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:42.760 16:48:53 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:42.760 16:48:53 -- accel/accel.sh@129 -- # build_accel_config 00:06:42.760 16:48:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:42.760 16:48:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:42.760 16:48:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.760 16:48:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:42.760 16:48:53 -- common/autotest_common.sh@10 -- # set +x 00:06:42.760 16:48:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:42.760 16:48:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:42.760 16:48:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:42.760 16:48:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:42.760 16:48:53 -- accel/accel.sh@42 -- # jq -r . 00:06:42.760 ************************************ 00:06:42.760 START TEST accel_dif_functional_tests 00:06:42.760 ************************************ 00:06:42.760 16:48:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:42.760 [2024-11-29 16:48:53.963294] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:42.760 [2024-11-29 16:48:53.963369] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99398 ] 00:06:42.760 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.760 [2024-11-29 16:48:54.024952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:42.760 [2024-11-29 16:48:54.151353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:42.760 [2024-11-29 16:48:54.151416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:42.760 [2024-11-29 16:48:54.151421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.019 00:06:43.019 00:06:43.019 CUnit - A unit testing framework for C - Version 2.1-3 00:06:43.019 http://cunit.sourceforge.net/ 00:06:43.019 00:06:43.019 00:06:43.019 Suite: accel_dif 00:06:43.019 Test: verify: DIF generated, GUARD check ...passed 00:06:43.019 Test: verify: DIF generated, APPTAG check ...passed 00:06:43.019 Test: verify: DIF generated, REFTAG check ...passed 00:06:43.019 Test: verify: DIF not generated, GUARD check ...[2024-11-29 16:48:54.249779] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:43.019 [2024-11-29 16:48:54.249846] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:43.019 passed 00:06:43.019 Test: verify: DIF not generated, APPTAG check ...[2024-11-29 16:48:54.249884] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:43.019 [2024-11-29 16:48:54.249934] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:43.019 passed 00:06:43.019 Test: verify: DIF not generated, REFTAG check ...[2024-11-29 16:48:54.249992] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:43.019 [2024-11-29 16:48:54.250031] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:43.019 passed 00:06:43.019 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:43.019 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-29 16:48:54.250112] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:43.019 passed 00:06:43.019 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:43.019 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:43.019 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:43.019 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-29 16:48:54.250286] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:43.019 passed 00:06:43.019 Test: generate copy: DIF generated, GUARD check ...passed 00:06:43.019 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:43.019 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:43.019 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:43.019 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:43.019 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:43.019 Test: generate copy: iovecs-len validate ...[2024-11-29 16:48:54.250538] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:43.019 passed 00:06:43.019 Test: generate copy: buffer alignment validate ...passed 00:06:43.019 00:06:43.019 Run Summary: Type Total Ran Passed Failed Inactive 00:06:43.019 suites 1 1 n/a 0 0 00:06:43.019 tests 20 20 20 0 0 00:06:43.019 asserts 204 204 204 0 n/a 00:06:43.019 00:06:43.019 Elapsed time = 0.002 seconds 00:06:43.278 00:06:43.278 real 0m0.589s 00:06:43.278 user 0m0.890s 00:06:43.278 sys 0m0.177s 00:06:43.279 16:48:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.279 16:48:54 -- common/autotest_common.sh@10 -- # set +x 00:06:43.279 ************************************ 00:06:43.279 END TEST accel_dif_functional_tests 00:06:43.279 ************************************ 00:06:43.279 00:06:43.279 real 1m2.778s 00:06:43.279 user 1m10.559s 00:06:43.279 sys 0m7.219s 00:06:43.279 16:48:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.279 16:48:54 -- common/autotest_common.sh@10 -- # set +x 00:06:43.279 ************************************ 00:06:43.279 END TEST accel 00:06:43.279 ************************************ 00:06:43.279 16:48:54 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:43.279 16:48:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:43.279 16:48:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.279 16:48:54 -- common/autotest_common.sh@10 -- # set +x 00:06:43.279 ************************************ 00:06:43.279 START TEST accel_rpc 00:06:43.279 ************************************ 00:06:43.279 16:48:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:43.279 * Looking for test storage... 00:06:43.279 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:43.279 16:48:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:43.279 16:48:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:43.279 16:48:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:43.537 16:48:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:43.537 16:48:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:43.537 16:48:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:43.537 16:48:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:43.537 16:48:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:43.537 16:48:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:43.537 16:48:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:43.537 16:48:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:43.537 16:48:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:43.537 16:48:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:43.537 16:48:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:43.537 16:48:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:43.538 16:48:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:43.538 16:48:54 -- scripts/common.sh@344 -- # : 1 00:06:43.538 16:48:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:43.538 16:48:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:43.538 16:48:54 -- scripts/common.sh@364 -- # decimal 1 00:06:43.538 16:48:54 -- scripts/common.sh@352 -- # local d=1 00:06:43.538 16:48:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:43.538 16:48:54 -- scripts/common.sh@354 -- # echo 1 00:06:43.538 16:48:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:43.538 16:48:54 -- scripts/common.sh@365 -- # decimal 2 00:06:43.538 16:48:54 -- scripts/common.sh@352 -- # local d=2 00:06:43.538 16:48:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:43.538 16:48:54 -- scripts/common.sh@354 -- # echo 2 00:06:43.538 16:48:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:43.538 16:48:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:43.538 16:48:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:43.538 16:48:54 -- scripts/common.sh@367 -- # return 0 00:06:43.538 16:48:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:43.538 16:48:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:43.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.538 --rc genhtml_branch_coverage=1 00:06:43.538 --rc genhtml_function_coverage=1 00:06:43.538 --rc genhtml_legend=1 00:06:43.538 --rc geninfo_all_blocks=1 00:06:43.538 --rc geninfo_unexecuted_blocks=1 00:06:43.538 00:06:43.538 ' 00:06:43.538 16:48:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:43.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.538 --rc genhtml_branch_coverage=1 00:06:43.538 --rc genhtml_function_coverage=1 00:06:43.538 --rc genhtml_legend=1 00:06:43.538 --rc geninfo_all_blocks=1 00:06:43.538 --rc geninfo_unexecuted_blocks=1 00:06:43.538 00:06:43.538 ' 00:06:43.538 16:48:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:43.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.538 --rc genhtml_branch_coverage=1 00:06:43.538 --rc genhtml_function_coverage=1 00:06:43.538 --rc genhtml_legend=1 00:06:43.538 --rc geninfo_all_blocks=1 00:06:43.538 --rc geninfo_unexecuted_blocks=1 00:06:43.538 00:06:43.538 ' 00:06:43.538 16:48:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:43.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.538 --rc genhtml_branch_coverage=1 00:06:43.538 --rc genhtml_function_coverage=1 00:06:43.538 --rc genhtml_legend=1 00:06:43.538 --rc geninfo_all_blocks=1 00:06:43.538 --rc geninfo_unexecuted_blocks=1 00:06:43.538 00:06:43.538 ' 00:06:43.538 16:48:54 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:43.538 16:48:54 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=99596 00:06:43.538 16:48:54 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:43.538 16:48:54 -- accel/accel_rpc.sh@15 -- # waitforlisten 99596 00:06:43.538 16:48:54 -- common/autotest_common.sh@829 -- # '[' -z 99596 ']' 00:06:43.538 16:48:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.538 16:48:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:43.538 16:48:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.538 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.538 16:48:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:43.538 16:48:54 -- common/autotest_common.sh@10 -- # set +x 00:06:43.538 [2024-11-29 16:48:54.768739] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:43.538 [2024-11-29 16:48:54.768835] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99596 ] 00:06:43.538 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.538 [2024-11-29 16:48:54.835716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.538 [2024-11-29 16:48:54.955629] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:43.538 [2024-11-29 16:48:54.955817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.795 16:48:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.795 16:48:55 -- common/autotest_common.sh@862 -- # return 0 00:06:43.795 16:48:55 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:43.795 16:48:55 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:43.795 16:48:55 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:43.795 16:48:55 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:43.795 16:48:55 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:43.795 16:48:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:43.795 16:48:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.795 16:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:43.795 ************************************ 00:06:43.795 START TEST accel_assign_opcode 00:06:43.795 ************************************ 00:06:43.796 16:48:55 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:43.796 16:48:55 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:43.796 16:48:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.796 16:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:43.796 [2024-11-29 16:48:55.032456] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:43.796 16:48:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.796 16:48:55 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:43.796 16:48:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.796 16:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:43.796 [2024-11-29 16:48:55.040471] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:43.796 16:48:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.796 16:48:55 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:43.796 16:48:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.796 16:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:44.054 16:48:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:44.054 16:48:55 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:44.054 16:48:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:44.054 16:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:44.054 16:48:55 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:44.054 16:48:55 -- accel/accel_rpc.sh@42 -- # grep software 00:06:44.054 16:48:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:44.054 software 00:06:44.054 00:06:44.054 real 0m0.302s 00:06:44.054 user 0m0.039s 00:06:44.054 sys 0m0.006s 00:06:44.054 16:48:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.054 16:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:44.054 ************************************ 00:06:44.054 END TEST accel_assign_opcode 00:06:44.054 ************************************ 00:06:44.054 16:48:55 -- accel/accel_rpc.sh@55 -- # killprocess 99596 00:06:44.054 16:48:55 -- common/autotest_common.sh@936 -- # '[' -z 99596 ']' 00:06:44.054 16:48:55 -- common/autotest_common.sh@940 -- # kill -0 99596 00:06:44.054 16:48:55 -- common/autotest_common.sh@941 -- # uname 00:06:44.054 16:48:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.054 16:48:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 99596 00:06:44.054 16:48:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.054 16:48:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.054 16:48:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 99596' 00:06:44.054 killing process with pid 99596 00:06:44.054 16:48:55 -- common/autotest_common.sh@955 -- # kill 99596 00:06:44.054 16:48:55 -- common/autotest_common.sh@960 -- # wait 99596 00:06:44.620 00:06:44.620 real 0m1.307s 00:06:44.620 user 0m1.244s 00:06:44.620 sys 0m0.463s 00:06:44.620 16:48:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.620 16:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:44.620 ************************************ 00:06:44.620 END TEST accel_rpc 00:06:44.620 ************************************ 00:06:44.620 16:48:55 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:44.620 16:48:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:44.620 16:48:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.620 16:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:44.620 ************************************ 00:06:44.620 START TEST app_cmdline 00:06:44.620 ************************************ 00:06:44.620 16:48:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:44.620 * Looking for test storage... 00:06:44.620 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:44.620 16:48:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:44.620 16:48:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:44.620 16:48:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:44.620 16:48:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:44.620 16:48:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:44.620 16:48:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:44.620 16:48:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:44.620 16:48:56 -- scripts/common.sh@335 -- # IFS=.-: 00:06:44.620 16:48:56 -- scripts/common.sh@335 -- # read -ra ver1 00:06:44.620 16:48:56 -- scripts/common.sh@336 -- # IFS=.-: 00:06:44.620 16:48:56 -- scripts/common.sh@336 -- # read -ra ver2 00:06:44.620 16:48:56 -- scripts/common.sh@337 -- # local 'op=<' 00:06:44.620 16:48:56 -- scripts/common.sh@339 -- # ver1_l=2 00:06:44.620 16:48:56 -- scripts/common.sh@340 -- # ver2_l=1 00:06:44.620 16:48:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:44.620 16:48:56 -- scripts/common.sh@343 -- # case "$op" in 00:06:44.620 16:48:56 -- scripts/common.sh@344 -- # : 1 00:06:44.620 16:48:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:44.620 16:48:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:44.620 16:48:56 -- scripts/common.sh@364 -- # decimal 1 00:06:44.620 16:48:56 -- scripts/common.sh@352 -- # local d=1 00:06:44.620 16:48:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:44.620 16:48:56 -- scripts/common.sh@354 -- # echo 1 00:06:44.620 16:48:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:44.620 16:48:56 -- scripts/common.sh@365 -- # decimal 2 00:06:44.620 16:48:56 -- scripts/common.sh@352 -- # local d=2 00:06:44.620 16:48:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:44.620 16:48:56 -- scripts/common.sh@354 -- # echo 2 00:06:44.620 16:48:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:44.620 16:48:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:44.620 16:48:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:44.620 16:48:56 -- scripts/common.sh@367 -- # return 0 00:06:44.620 16:48:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:44.620 16:48:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:44.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:44.620 --rc genhtml_branch_coverage=1 00:06:44.620 --rc genhtml_function_coverage=1 00:06:44.620 --rc genhtml_legend=1 00:06:44.620 --rc geninfo_all_blocks=1 00:06:44.620 --rc geninfo_unexecuted_blocks=1 00:06:44.620 00:06:44.620 ' 00:06:44.620 16:48:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:44.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:44.620 --rc genhtml_branch_coverage=1 00:06:44.620 --rc genhtml_function_coverage=1 00:06:44.620 --rc genhtml_legend=1 00:06:44.620 --rc geninfo_all_blocks=1 00:06:44.620 --rc geninfo_unexecuted_blocks=1 00:06:44.620 00:06:44.620 ' 00:06:44.620 16:48:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:44.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:44.620 --rc genhtml_branch_coverage=1 00:06:44.620 --rc genhtml_function_coverage=1 00:06:44.620 --rc genhtml_legend=1 00:06:44.620 --rc geninfo_all_blocks=1 00:06:44.620 --rc geninfo_unexecuted_blocks=1 00:06:44.620 00:06:44.620 ' 00:06:44.620 16:48:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:44.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:44.620 --rc genhtml_branch_coverage=1 00:06:44.620 --rc genhtml_function_coverage=1 00:06:44.620 --rc genhtml_legend=1 00:06:44.620 --rc geninfo_all_blocks=1 00:06:44.620 --rc geninfo_unexecuted_blocks=1 00:06:44.620 00:06:44.620 ' 00:06:44.620 16:48:56 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:44.620 16:48:56 -- app/cmdline.sh@17 -- # spdk_tgt_pid=99809 00:06:44.620 16:48:56 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:44.620 16:48:56 -- app/cmdline.sh@18 -- # waitforlisten 99809 00:06:44.620 16:48:56 -- common/autotest_common.sh@829 -- # '[' -z 99809 ']' 00:06:44.620 16:48:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:44.620 16:48:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:44.620 16:48:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:44.620 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:44.620 16:48:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:44.620 16:48:56 -- common/autotest_common.sh@10 -- # set +x 00:06:44.878 [2024-11-29 16:48:56.087848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:44.878 [2024-11-29 16:48:56.087943] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99809 ] 00:06:44.878 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.878 [2024-11-29 16:48:56.146287] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.878 [2024-11-29 16:48:56.257888] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:44.878 [2024-11-29 16:48:56.258067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.812 16:48:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:45.812 16:48:57 -- common/autotest_common.sh@862 -- # return 0 00:06:45.812 16:48:57 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:46.071 { 00:06:46.071 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:46.071 "fields": { 00:06:46.071 "major": 24, 00:06:46.071 "minor": 1, 00:06:46.071 "patch": 1, 00:06:46.071 "suffix": "-pre", 00:06:46.071 "commit": "c13c99a5e" 00:06:46.071 } 00:06:46.071 } 00:06:46.071 16:48:57 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:46.071 16:48:57 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:46.071 16:48:57 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:46.071 16:48:57 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:46.071 16:48:57 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:46.071 16:48:57 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:46.071 16:48:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.071 16:48:57 -- common/autotest_common.sh@10 -- # set +x 00:06:46.071 16:48:57 -- app/cmdline.sh@26 -- # sort 00:06:46.071 16:48:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.071 16:48:57 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:46.071 16:48:57 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:46.071 16:48:57 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:46.071 16:48:57 -- common/autotest_common.sh@650 -- # local es=0 00:06:46.071 16:48:57 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:46.071 16:48:57 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:46.071 16:48:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:46.071 16:48:57 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:46.071 16:48:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:46.071 16:48:57 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:46.071 16:48:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:46.071 16:48:57 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:46.071 16:48:57 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:46.071 16:48:57 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:46.329 request: 00:06:46.329 { 00:06:46.329 "method": "env_dpdk_get_mem_stats", 00:06:46.329 "req_id": 1 00:06:46.329 } 00:06:46.329 Got JSON-RPC error response 00:06:46.329 response: 00:06:46.329 { 00:06:46.329 "code": -32601, 00:06:46.329 "message": "Method not found" 00:06:46.329 } 00:06:46.329 16:48:57 -- common/autotest_common.sh@653 -- # es=1 00:06:46.329 16:48:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:46.329 16:48:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:46.329 16:48:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:46.329 16:48:57 -- app/cmdline.sh@1 -- # killprocess 99809 00:06:46.329 16:48:57 -- common/autotest_common.sh@936 -- # '[' -z 99809 ']' 00:06:46.329 16:48:57 -- common/autotest_common.sh@940 -- # kill -0 99809 00:06:46.329 16:48:57 -- common/autotest_common.sh@941 -- # uname 00:06:46.329 16:48:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:46.329 16:48:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 99809 00:06:46.329 16:48:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:46.329 16:48:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:46.329 16:48:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 99809' 00:06:46.329 killing process with pid 99809 00:06:46.329 16:48:57 -- common/autotest_common.sh@955 -- # kill 99809 00:06:46.329 16:48:57 -- common/autotest_common.sh@960 -- # wait 99809 00:06:46.894 00:06:46.894 real 0m2.337s 00:06:46.894 user 0m3.010s 00:06:46.894 sys 0m0.512s 00:06:46.894 16:48:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:46.894 16:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:46.894 ************************************ 00:06:46.894 END TEST app_cmdline 00:06:46.894 ************************************ 00:06:46.894 16:48:58 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:46.894 16:48:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:46.894 16:48:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.894 16:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:46.894 ************************************ 00:06:46.894 START TEST version 00:06:46.894 ************************************ 00:06:46.894 16:48:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:46.894 * Looking for test storage... 00:06:46.894 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:46.894 16:48:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:46.894 16:48:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:46.894 16:48:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:47.152 16:48:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:47.152 16:48:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:47.152 16:48:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:47.152 16:48:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:47.152 16:48:58 -- scripts/common.sh@335 -- # IFS=.-: 00:06:47.152 16:48:58 -- scripts/common.sh@335 -- # read -ra ver1 00:06:47.152 16:48:58 -- scripts/common.sh@336 -- # IFS=.-: 00:06:47.152 16:48:58 -- scripts/common.sh@336 -- # read -ra ver2 00:06:47.152 16:48:58 -- scripts/common.sh@337 -- # local 'op=<' 00:06:47.152 16:48:58 -- scripts/common.sh@339 -- # ver1_l=2 00:06:47.152 16:48:58 -- scripts/common.sh@340 -- # ver2_l=1 00:06:47.152 16:48:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:47.152 16:48:58 -- scripts/common.sh@343 -- # case "$op" in 00:06:47.152 16:48:58 -- scripts/common.sh@344 -- # : 1 00:06:47.152 16:48:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:47.152 16:48:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:47.152 16:48:58 -- scripts/common.sh@364 -- # decimal 1 00:06:47.152 16:48:58 -- scripts/common.sh@352 -- # local d=1 00:06:47.152 16:48:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:47.152 16:48:58 -- scripts/common.sh@354 -- # echo 1 00:06:47.152 16:48:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:47.152 16:48:58 -- scripts/common.sh@365 -- # decimal 2 00:06:47.152 16:48:58 -- scripts/common.sh@352 -- # local d=2 00:06:47.152 16:48:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:47.152 16:48:58 -- scripts/common.sh@354 -- # echo 2 00:06:47.152 16:48:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:47.152 16:48:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:47.152 16:48:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:47.152 16:48:58 -- scripts/common.sh@367 -- # return 0 00:06:47.152 16:48:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:47.152 16:48:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:47.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.152 --rc genhtml_branch_coverage=1 00:06:47.152 --rc genhtml_function_coverage=1 00:06:47.152 --rc genhtml_legend=1 00:06:47.152 --rc geninfo_all_blocks=1 00:06:47.152 --rc geninfo_unexecuted_blocks=1 00:06:47.152 00:06:47.152 ' 00:06:47.152 16:48:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:47.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.152 --rc genhtml_branch_coverage=1 00:06:47.152 --rc genhtml_function_coverage=1 00:06:47.152 --rc genhtml_legend=1 00:06:47.152 --rc geninfo_all_blocks=1 00:06:47.152 --rc geninfo_unexecuted_blocks=1 00:06:47.152 00:06:47.152 ' 00:06:47.152 16:48:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:47.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.152 --rc genhtml_branch_coverage=1 00:06:47.152 --rc genhtml_function_coverage=1 00:06:47.152 --rc genhtml_legend=1 00:06:47.152 --rc geninfo_all_blocks=1 00:06:47.152 --rc geninfo_unexecuted_blocks=1 00:06:47.152 00:06:47.152 ' 00:06:47.152 16:48:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:47.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.152 --rc genhtml_branch_coverage=1 00:06:47.152 --rc genhtml_function_coverage=1 00:06:47.152 --rc genhtml_legend=1 00:06:47.152 --rc geninfo_all_blocks=1 00:06:47.152 --rc geninfo_unexecuted_blocks=1 00:06:47.152 00:06:47.152 ' 00:06:47.152 16:48:58 -- app/version.sh@17 -- # get_header_version major 00:06:47.152 16:48:58 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:47.152 16:48:58 -- app/version.sh@14 -- # cut -f2 00:06:47.152 16:48:58 -- app/version.sh@14 -- # tr -d '"' 00:06:47.152 16:48:58 -- app/version.sh@17 -- # major=24 00:06:47.152 16:48:58 -- app/version.sh@18 -- # get_header_version minor 00:06:47.152 16:48:58 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:47.152 16:48:58 -- app/version.sh@14 -- # cut -f2 00:06:47.152 16:48:58 -- app/version.sh@14 -- # tr -d '"' 00:06:47.152 16:48:58 -- app/version.sh@18 -- # minor=1 00:06:47.152 16:48:58 -- app/version.sh@19 -- # get_header_version patch 00:06:47.152 16:48:58 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:47.152 16:48:58 -- app/version.sh@14 -- # cut -f2 00:06:47.152 16:48:58 -- app/version.sh@14 -- # tr -d '"' 00:06:47.152 16:48:58 -- app/version.sh@19 -- # patch=1 00:06:47.152 16:48:58 -- app/version.sh@20 -- # get_header_version suffix 00:06:47.152 16:48:58 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:47.152 16:48:58 -- app/version.sh@14 -- # cut -f2 00:06:47.152 16:48:58 -- app/version.sh@14 -- # tr -d '"' 00:06:47.152 16:48:58 -- app/version.sh@20 -- # suffix=-pre 00:06:47.153 16:48:58 -- app/version.sh@22 -- # version=24.1 00:06:47.153 16:48:58 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:47.153 16:48:58 -- app/version.sh@25 -- # version=24.1.1 00:06:47.153 16:48:58 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:47.153 16:48:58 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:47.153 16:48:58 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:47.153 16:48:58 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:47.153 16:48:58 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:47.153 00:06:47.153 real 0m0.188s 00:06:47.153 user 0m0.128s 00:06:47.153 sys 0m0.084s 00:06:47.153 16:48:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.153 16:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:47.153 ************************************ 00:06:47.153 END TEST version 00:06:47.153 ************************************ 00:06:47.153 16:48:58 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:47.153 16:48:58 -- spdk/autotest.sh@191 -- # uname -s 00:06:47.153 16:48:58 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:47.153 16:48:58 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:47.153 16:48:58 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:47.153 16:48:58 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:47.153 16:48:58 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:47.153 16:48:58 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:47.153 16:48:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:47.153 16:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:47.153 16:48:58 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:47.153 16:48:58 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:47.153 16:48:58 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:47.153 16:48:58 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:47.153 16:48:58 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:47.153 16:48:58 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:47.153 16:48:58 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:47.153 16:48:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:47.153 16:48:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.153 16:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:47.153 ************************************ 00:06:47.153 START TEST nvmf_tcp 00:06:47.153 ************************************ 00:06:47.153 16:48:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:47.153 * Looking for test storage... 00:06:47.153 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:47.153 16:48:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:47.153 16:48:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:47.153 16:48:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:47.412 16:48:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:47.412 16:48:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:47.412 16:48:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:47.412 16:48:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:47.412 16:48:58 -- scripts/common.sh@335 -- # IFS=.-: 00:06:47.412 16:48:58 -- scripts/common.sh@335 -- # read -ra ver1 00:06:47.412 16:48:58 -- scripts/common.sh@336 -- # IFS=.-: 00:06:47.412 16:48:58 -- scripts/common.sh@336 -- # read -ra ver2 00:06:47.412 16:48:58 -- scripts/common.sh@337 -- # local 'op=<' 00:06:47.412 16:48:58 -- scripts/common.sh@339 -- # ver1_l=2 00:06:47.412 16:48:58 -- scripts/common.sh@340 -- # ver2_l=1 00:06:47.412 16:48:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:47.412 16:48:58 -- scripts/common.sh@343 -- # case "$op" in 00:06:47.412 16:48:58 -- scripts/common.sh@344 -- # : 1 00:06:47.412 16:48:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:47.412 16:48:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:47.412 16:48:58 -- scripts/common.sh@364 -- # decimal 1 00:06:47.412 16:48:58 -- scripts/common.sh@352 -- # local d=1 00:06:47.412 16:48:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:47.412 16:48:58 -- scripts/common.sh@354 -- # echo 1 00:06:47.412 16:48:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:47.412 16:48:58 -- scripts/common.sh@365 -- # decimal 2 00:06:47.412 16:48:58 -- scripts/common.sh@352 -- # local d=2 00:06:47.412 16:48:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:47.412 16:48:58 -- scripts/common.sh@354 -- # echo 2 00:06:47.412 16:48:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:47.412 16:48:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:47.412 16:48:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:47.412 16:48:58 -- scripts/common.sh@367 -- # return 0 00:06:47.412 16:48:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:47.412 16:48:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:47.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.412 --rc genhtml_branch_coverage=1 00:06:47.412 --rc genhtml_function_coverage=1 00:06:47.412 --rc genhtml_legend=1 00:06:47.412 --rc geninfo_all_blocks=1 00:06:47.412 --rc geninfo_unexecuted_blocks=1 00:06:47.412 00:06:47.412 ' 00:06:47.412 16:48:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:47.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.412 --rc genhtml_branch_coverage=1 00:06:47.412 --rc genhtml_function_coverage=1 00:06:47.412 --rc genhtml_legend=1 00:06:47.412 --rc geninfo_all_blocks=1 00:06:47.412 --rc geninfo_unexecuted_blocks=1 00:06:47.412 00:06:47.412 ' 00:06:47.412 16:48:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:47.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.412 --rc genhtml_branch_coverage=1 00:06:47.412 --rc genhtml_function_coverage=1 00:06:47.412 --rc genhtml_legend=1 00:06:47.412 --rc geninfo_all_blocks=1 00:06:47.412 --rc geninfo_unexecuted_blocks=1 00:06:47.412 00:06:47.412 ' 00:06:47.412 16:48:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:47.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.412 --rc genhtml_branch_coverage=1 00:06:47.412 --rc genhtml_function_coverage=1 00:06:47.412 --rc genhtml_legend=1 00:06:47.412 --rc geninfo_all_blocks=1 00:06:47.412 --rc geninfo_unexecuted_blocks=1 00:06:47.412 00:06:47.412 ' 00:06:47.412 16:48:58 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:47.412 16:48:58 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:47.412 16:48:58 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:47.412 16:48:58 -- nvmf/common.sh@7 -- # uname -s 00:06:47.412 16:48:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:47.412 16:48:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:47.412 16:48:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:47.412 16:48:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:47.412 16:48:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:47.412 16:48:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:47.412 16:48:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:47.412 16:48:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:47.412 16:48:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:47.412 16:48:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:47.412 16:48:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:47.412 16:48:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:47.412 16:48:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:47.412 16:48:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:47.412 16:48:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:47.412 16:48:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:47.412 16:48:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:47.412 16:48:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:47.412 16:48:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:47.412 16:48:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.412 16:48:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.412 16:48:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.412 16:48:58 -- paths/export.sh@5 -- # export PATH 00:06:47.412 16:48:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.412 16:48:58 -- nvmf/common.sh@46 -- # : 0 00:06:47.412 16:48:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:47.412 16:48:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:47.413 16:48:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:47.413 16:48:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:47.413 16:48:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:47.413 16:48:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:47.413 16:48:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:47.413 16:48:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:47.413 16:48:58 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:47.413 16:48:58 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:47.413 16:48:58 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:47.413 16:48:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:47.413 16:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:47.413 16:48:58 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:47.413 16:48:58 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:47.413 16:48:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:47.413 16:48:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.413 16:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:47.413 ************************************ 00:06:47.413 START TEST nvmf_example 00:06:47.413 ************************************ 00:06:47.413 16:48:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:47.413 * Looking for test storage... 00:06:47.413 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:47.413 16:48:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:47.413 16:48:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:47.413 16:48:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:47.413 16:48:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:47.413 16:48:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:47.413 16:48:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:47.413 16:48:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:47.413 16:48:58 -- scripts/common.sh@335 -- # IFS=.-: 00:06:47.413 16:48:58 -- scripts/common.sh@335 -- # read -ra ver1 00:06:47.413 16:48:58 -- scripts/common.sh@336 -- # IFS=.-: 00:06:47.413 16:48:58 -- scripts/common.sh@336 -- # read -ra ver2 00:06:47.413 16:48:58 -- scripts/common.sh@337 -- # local 'op=<' 00:06:47.413 16:48:58 -- scripts/common.sh@339 -- # ver1_l=2 00:06:47.413 16:48:58 -- scripts/common.sh@340 -- # ver2_l=1 00:06:47.413 16:48:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:47.413 16:48:58 -- scripts/common.sh@343 -- # case "$op" in 00:06:47.413 16:48:58 -- scripts/common.sh@344 -- # : 1 00:06:47.413 16:48:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:47.413 16:48:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:47.413 16:48:58 -- scripts/common.sh@364 -- # decimal 1 00:06:47.413 16:48:58 -- scripts/common.sh@352 -- # local d=1 00:06:47.413 16:48:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:47.413 16:48:58 -- scripts/common.sh@354 -- # echo 1 00:06:47.413 16:48:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:47.413 16:48:58 -- scripts/common.sh@365 -- # decimal 2 00:06:47.413 16:48:58 -- scripts/common.sh@352 -- # local d=2 00:06:47.413 16:48:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:47.413 16:48:58 -- scripts/common.sh@354 -- # echo 2 00:06:47.413 16:48:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:47.413 16:48:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:47.413 16:48:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:47.413 16:48:58 -- scripts/common.sh@367 -- # return 0 00:06:47.413 16:48:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:47.413 16:48:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:47.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.413 --rc genhtml_branch_coverage=1 00:06:47.413 --rc genhtml_function_coverage=1 00:06:47.413 --rc genhtml_legend=1 00:06:47.413 --rc geninfo_all_blocks=1 00:06:47.413 --rc geninfo_unexecuted_blocks=1 00:06:47.413 00:06:47.413 ' 00:06:47.413 16:48:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:47.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.413 --rc genhtml_branch_coverage=1 00:06:47.413 --rc genhtml_function_coverage=1 00:06:47.413 --rc genhtml_legend=1 00:06:47.413 --rc geninfo_all_blocks=1 00:06:47.413 --rc geninfo_unexecuted_blocks=1 00:06:47.413 00:06:47.413 ' 00:06:47.413 16:48:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:47.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.413 --rc genhtml_branch_coverage=1 00:06:47.413 --rc genhtml_function_coverage=1 00:06:47.413 --rc genhtml_legend=1 00:06:47.413 --rc geninfo_all_blocks=1 00:06:47.413 --rc geninfo_unexecuted_blocks=1 00:06:47.413 00:06:47.413 ' 00:06:47.413 16:48:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:47.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:47.413 --rc genhtml_branch_coverage=1 00:06:47.413 --rc genhtml_function_coverage=1 00:06:47.413 --rc genhtml_legend=1 00:06:47.413 --rc geninfo_all_blocks=1 00:06:47.413 --rc geninfo_unexecuted_blocks=1 00:06:47.413 00:06:47.413 ' 00:06:47.413 16:48:58 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:47.413 16:48:58 -- nvmf/common.sh@7 -- # uname -s 00:06:47.413 16:48:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:47.413 16:48:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:47.413 16:48:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:47.413 16:48:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:47.413 16:48:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:47.413 16:48:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:47.413 16:48:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:47.413 16:48:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:47.413 16:48:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:47.413 16:48:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:47.413 16:48:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:47.413 16:48:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:47.413 16:48:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:47.413 16:48:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:47.413 16:48:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:47.413 16:48:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:47.413 16:48:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:47.413 16:48:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:47.413 16:48:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:47.413 16:48:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.413 16:48:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.413 16:48:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.413 16:48:58 -- paths/export.sh@5 -- # export PATH 00:06:47.413 16:48:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.413 16:48:58 -- nvmf/common.sh@46 -- # : 0 00:06:47.413 16:48:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:47.413 16:48:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:47.413 16:48:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:47.413 16:48:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:47.413 16:48:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:47.413 16:48:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:47.413 16:48:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:47.413 16:48:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:47.413 16:48:58 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:47.413 16:48:58 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:47.413 16:48:58 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:47.413 16:48:58 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:47.413 16:48:58 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:47.413 16:48:58 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:47.413 16:48:58 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:47.413 16:48:58 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:47.413 16:48:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:47.413 16:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:47.413 16:48:58 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:47.413 16:48:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:47.413 16:48:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:47.413 16:48:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:47.413 16:48:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:47.413 16:48:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:47.413 16:48:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:47.413 16:48:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:47.413 16:48:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:47.413 16:48:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:47.414 16:48:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:47.414 16:48:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:47.414 16:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:49.316 16:49:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:49.316 16:49:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:49.316 16:49:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:49.316 16:49:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:49.316 16:49:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:49.316 16:49:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:49.316 16:49:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:49.316 16:49:00 -- nvmf/common.sh@294 -- # net_devs=() 00:06:49.316 16:49:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:49.316 16:49:00 -- nvmf/common.sh@295 -- # e810=() 00:06:49.316 16:49:00 -- nvmf/common.sh@295 -- # local -ga e810 00:06:49.316 16:49:00 -- nvmf/common.sh@296 -- # x722=() 00:06:49.316 16:49:00 -- nvmf/common.sh@296 -- # local -ga x722 00:06:49.316 16:49:00 -- nvmf/common.sh@297 -- # mlx=() 00:06:49.316 16:49:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:49.316 16:49:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:49.316 16:49:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:49.316 16:49:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:49.316 16:49:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:49.316 16:49:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:49.316 16:49:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:49.316 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:49.316 16:49:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:49.316 16:49:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:49.316 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:49.316 16:49:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:49.316 16:49:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:49.316 16:49:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:49.316 16:49:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:49.316 16:49:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:49.316 16:49:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:49.316 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:49.316 16:49:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:49.316 16:49:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:49.316 16:49:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:49.316 16:49:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:49.316 16:49:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:49.316 16:49:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:49.316 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:49.316 16:49:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:49.316 16:49:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:49.316 16:49:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:49.316 16:49:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:49.316 16:49:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:49.316 16:49:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:49.316 16:49:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:49.316 16:49:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:49.316 16:49:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:49.316 16:49:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:49.317 16:49:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:49.317 16:49:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:49.317 16:49:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:49.317 16:49:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:49.317 16:49:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:49.317 16:49:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:49.317 16:49:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:49.317 16:49:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:49.575 16:49:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:49.575 16:49:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:49.575 16:49:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:49.575 16:49:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:49.575 16:49:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:49.575 16:49:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:49.575 16:49:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:49.575 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:49.575 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:06:49.575 00:06:49.575 --- 10.0.0.2 ping statistics --- 00:06:49.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:49.576 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:06:49.576 16:49:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:49.576 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:49.576 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:06:49.576 00:06:49.576 --- 10.0.0.1 ping statistics --- 00:06:49.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:49.576 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:06:49.576 16:49:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:49.576 16:49:00 -- nvmf/common.sh@410 -- # return 0 00:06:49.576 16:49:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:49.576 16:49:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:49.576 16:49:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:49.576 16:49:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:49.576 16:49:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:49.576 16:49:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:49.576 16:49:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:49.576 16:49:01 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:49.576 16:49:01 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:49.576 16:49:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:49.576 16:49:01 -- common/autotest_common.sh@10 -- # set +x 00:06:49.576 16:49:01 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:49.834 16:49:01 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:49.834 16:49:01 -- target/nvmf_example.sh@34 -- # nvmfpid=101998 00:06:49.834 16:49:01 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:49.834 16:49:01 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:49.834 16:49:01 -- target/nvmf_example.sh@36 -- # waitforlisten 101998 00:06:49.834 16:49:01 -- common/autotest_common.sh@829 -- # '[' -z 101998 ']' 00:06:49.834 16:49:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:49.834 16:49:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:49.834 16:49:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:49.834 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:49.834 16:49:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:49.834 16:49:01 -- common/autotest_common.sh@10 -- # set +x 00:06:49.834 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.767 16:49:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:50.767 16:49:02 -- common/autotest_common.sh@862 -- # return 0 00:06:50.767 16:49:02 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:50.767 16:49:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:50.767 16:49:02 -- common/autotest_common.sh@10 -- # set +x 00:06:50.767 16:49:02 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:50.767 16:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.767 16:49:02 -- common/autotest_common.sh@10 -- # set +x 00:06:50.767 16:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.767 16:49:02 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:50.767 16:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.767 16:49:02 -- common/autotest_common.sh@10 -- # set +x 00:06:50.767 16:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.767 16:49:02 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:50.767 16:49:02 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:50.767 16:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.767 16:49:02 -- common/autotest_common.sh@10 -- # set +x 00:06:50.767 16:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.767 16:49:02 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:50.767 16:49:02 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:50.767 16:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.767 16:49:02 -- common/autotest_common.sh@10 -- # set +x 00:06:50.767 16:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.767 16:49:02 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:50.767 16:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.767 16:49:02 -- common/autotest_common.sh@10 -- # set +x 00:06:50.767 16:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.767 16:49:02 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:50.767 16:49:02 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:50.767 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.966 Initializing NVMe Controllers 00:07:02.966 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:02.966 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:02.966 Initialization complete. Launching workers. 00:07:02.966 ======================================================== 00:07:02.966 Latency(us) 00:07:02.966 Device Information : IOPS MiB/s Average min max 00:07:02.966 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 16024.22 62.59 3993.80 870.63 15320.03 00:07:02.966 ======================================================== 00:07:02.966 Total : 16024.22 62.59 3993.80 870.63 15320.03 00:07:02.966 00:07:02.966 16:49:12 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:02.966 16:49:12 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:02.966 16:49:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:02.966 16:49:12 -- nvmf/common.sh@116 -- # sync 00:07:02.966 16:49:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:02.966 16:49:12 -- nvmf/common.sh@119 -- # set +e 00:07:02.966 16:49:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:02.966 16:49:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:02.966 rmmod nvme_tcp 00:07:02.966 rmmod nvme_fabrics 00:07:02.966 rmmod nvme_keyring 00:07:02.966 16:49:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:02.966 16:49:12 -- nvmf/common.sh@123 -- # set -e 00:07:02.966 16:49:12 -- nvmf/common.sh@124 -- # return 0 00:07:02.966 16:49:12 -- nvmf/common.sh@477 -- # '[' -n 101998 ']' 00:07:02.966 16:49:12 -- nvmf/common.sh@478 -- # killprocess 101998 00:07:02.966 16:49:12 -- common/autotest_common.sh@936 -- # '[' -z 101998 ']' 00:07:02.966 16:49:12 -- common/autotest_common.sh@940 -- # kill -0 101998 00:07:02.966 16:49:12 -- common/autotest_common.sh@941 -- # uname 00:07:02.966 16:49:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:02.966 16:49:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 101998 00:07:02.966 16:49:12 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:07:02.966 16:49:12 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:07:02.966 16:49:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 101998' 00:07:02.966 killing process with pid 101998 00:07:02.966 16:49:12 -- common/autotest_common.sh@955 -- # kill 101998 00:07:02.966 16:49:12 -- common/autotest_common.sh@960 -- # wait 101998 00:07:02.966 nvmf threads initialize successfully 00:07:02.966 bdev subsystem init successfully 00:07:02.966 created a nvmf target service 00:07:02.966 create targets's poll groups done 00:07:02.966 all subsystems of target started 00:07:02.966 nvmf target is running 00:07:02.966 all subsystems of target stopped 00:07:02.966 destroy targets's poll groups done 00:07:02.966 destroyed the nvmf target service 00:07:02.966 bdev subsystem finish successfully 00:07:02.966 nvmf threads destroy successfully 00:07:02.966 16:49:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:02.966 16:49:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:02.966 16:49:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:02.966 16:49:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:02.966 16:49:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:02.966 16:49:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:02.966 16:49:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:02.966 16:49:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:03.538 16:49:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:03.538 16:49:14 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:03.538 16:49:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:03.538 16:49:14 -- common/autotest_common.sh@10 -- # set +x 00:07:03.538 00:07:03.538 real 0m16.087s 00:07:03.538 user 0m45.387s 00:07:03.538 sys 0m3.279s 00:07:03.538 16:49:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.538 16:49:14 -- common/autotest_common.sh@10 -- # set +x 00:07:03.538 ************************************ 00:07:03.538 END TEST nvmf_example 00:07:03.538 ************************************ 00:07:03.538 16:49:14 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:03.539 16:49:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:03.539 16:49:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.539 16:49:14 -- common/autotest_common.sh@10 -- # set +x 00:07:03.539 ************************************ 00:07:03.539 START TEST nvmf_filesystem 00:07:03.539 ************************************ 00:07:03.539 16:49:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:03.539 * Looking for test storage... 00:07:03.539 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:03.539 16:49:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:03.539 16:49:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:03.539 16:49:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:03.539 16:49:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:03.539 16:49:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:03.539 16:49:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:03.539 16:49:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:03.539 16:49:14 -- scripts/common.sh@335 -- # IFS=.-: 00:07:03.539 16:49:14 -- scripts/common.sh@335 -- # read -ra ver1 00:07:03.539 16:49:14 -- scripts/common.sh@336 -- # IFS=.-: 00:07:03.539 16:49:14 -- scripts/common.sh@336 -- # read -ra ver2 00:07:03.539 16:49:14 -- scripts/common.sh@337 -- # local 'op=<' 00:07:03.539 16:49:14 -- scripts/common.sh@339 -- # ver1_l=2 00:07:03.539 16:49:14 -- scripts/common.sh@340 -- # ver2_l=1 00:07:03.539 16:49:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:03.539 16:49:14 -- scripts/common.sh@343 -- # case "$op" in 00:07:03.539 16:49:14 -- scripts/common.sh@344 -- # : 1 00:07:03.539 16:49:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:03.539 16:49:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:03.539 16:49:14 -- scripts/common.sh@364 -- # decimal 1 00:07:03.539 16:49:14 -- scripts/common.sh@352 -- # local d=1 00:07:03.539 16:49:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:03.539 16:49:14 -- scripts/common.sh@354 -- # echo 1 00:07:03.539 16:49:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:03.539 16:49:14 -- scripts/common.sh@365 -- # decimal 2 00:07:03.539 16:49:14 -- scripts/common.sh@352 -- # local d=2 00:07:03.539 16:49:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:03.539 16:49:14 -- scripts/common.sh@354 -- # echo 2 00:07:03.539 16:49:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:03.539 16:49:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:03.539 16:49:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:03.539 16:49:14 -- scripts/common.sh@367 -- # return 0 00:07:03.539 16:49:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:03.539 16:49:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:03.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.539 --rc genhtml_branch_coverage=1 00:07:03.539 --rc genhtml_function_coverage=1 00:07:03.539 --rc genhtml_legend=1 00:07:03.539 --rc geninfo_all_blocks=1 00:07:03.539 --rc geninfo_unexecuted_blocks=1 00:07:03.539 00:07:03.539 ' 00:07:03.539 16:49:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:03.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.539 --rc genhtml_branch_coverage=1 00:07:03.539 --rc genhtml_function_coverage=1 00:07:03.539 --rc genhtml_legend=1 00:07:03.539 --rc geninfo_all_blocks=1 00:07:03.539 --rc geninfo_unexecuted_blocks=1 00:07:03.539 00:07:03.539 ' 00:07:03.539 16:49:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:03.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.539 --rc genhtml_branch_coverage=1 00:07:03.539 --rc genhtml_function_coverage=1 00:07:03.539 --rc genhtml_legend=1 00:07:03.539 --rc geninfo_all_blocks=1 00:07:03.539 --rc geninfo_unexecuted_blocks=1 00:07:03.539 00:07:03.539 ' 00:07:03.539 16:49:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:03.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.539 --rc genhtml_branch_coverage=1 00:07:03.539 --rc genhtml_function_coverage=1 00:07:03.539 --rc genhtml_legend=1 00:07:03.539 --rc geninfo_all_blocks=1 00:07:03.539 --rc geninfo_unexecuted_blocks=1 00:07:03.539 00:07:03.539 ' 00:07:03.539 16:49:14 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:07:03.539 16:49:14 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:03.539 16:49:14 -- common/autotest_common.sh@34 -- # set -e 00:07:03.539 16:49:14 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:03.539 16:49:14 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:03.539 16:49:14 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:03.539 16:49:14 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:07:03.539 16:49:14 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:03.539 16:49:14 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:03.539 16:49:14 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:03.539 16:49:14 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:03.539 16:49:14 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:03.539 16:49:14 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:03.539 16:49:14 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:03.539 16:49:14 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:03.539 16:49:14 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:03.539 16:49:14 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:03.539 16:49:14 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:03.539 16:49:14 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:03.539 16:49:14 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:03.539 16:49:14 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:03.539 16:49:14 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:03.539 16:49:14 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:03.539 16:49:14 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:03.539 16:49:14 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:03.539 16:49:14 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:03.539 16:49:14 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:03.539 16:49:14 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:03.539 16:49:14 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:03.539 16:49:14 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:03.539 16:49:14 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:03.539 16:49:14 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:03.539 16:49:14 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:03.539 16:49:14 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:03.539 16:49:14 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:03.539 16:49:14 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:03.539 16:49:14 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:03.539 16:49:14 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:03.539 16:49:14 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:03.539 16:49:14 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:03.539 16:49:14 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:03.539 16:49:14 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:03.539 16:49:14 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:07:03.539 16:49:14 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:03.539 16:49:14 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:03.539 16:49:14 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:03.539 16:49:14 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:03.539 16:49:14 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:07:03.539 16:49:14 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:03.539 16:49:14 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:03.539 16:49:14 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:03.539 16:49:14 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:03.539 16:49:14 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:03.539 16:49:14 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:03.539 16:49:14 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:03.539 16:49:14 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:03.539 16:49:14 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:03.539 16:49:14 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:07:03.539 16:49:14 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:03.539 16:49:14 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:07:03.539 16:49:14 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:07:03.539 16:49:14 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:07:03.539 16:49:14 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:07:03.539 16:49:14 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:07:03.539 16:49:14 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:07:03.539 16:49:14 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:07:03.539 16:49:14 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:07:03.539 16:49:14 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:07:03.539 16:49:14 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:07:03.539 16:49:14 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:07:03.539 16:49:14 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:07:03.539 16:49:14 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:07:03.539 16:49:14 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:03.539 16:49:14 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:07:03.539 16:49:14 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:07:03.539 16:49:14 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:07:03.539 16:49:14 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:07:03.539 16:49:14 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:07:03.539 16:49:14 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:07:03.539 16:49:14 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:07:03.539 16:49:14 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:07:03.539 16:49:14 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:07:03.539 16:49:14 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:07:03.539 16:49:14 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:03.539 16:49:14 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:07:03.540 16:49:14 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:07:03.540 16:49:14 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:03.540 16:49:14 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:03.540 16:49:14 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:03.540 16:49:14 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:03.540 16:49:14 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:03.540 16:49:14 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:03.540 16:49:14 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:03.540 16:49:14 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:03.540 16:49:14 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:03.540 16:49:14 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:03.540 16:49:14 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:03.540 16:49:14 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:03.540 16:49:14 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:03.540 16:49:14 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:03.540 16:49:14 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:07:03.540 16:49:14 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:03.540 #define SPDK_CONFIG_H 00:07:03.540 #define SPDK_CONFIG_APPS 1 00:07:03.540 #define SPDK_CONFIG_ARCH native 00:07:03.540 #undef SPDK_CONFIG_ASAN 00:07:03.540 #undef SPDK_CONFIG_AVAHI 00:07:03.540 #undef SPDK_CONFIG_CET 00:07:03.540 #define SPDK_CONFIG_COVERAGE 1 00:07:03.540 #define SPDK_CONFIG_CROSS_PREFIX 00:07:03.540 #undef SPDK_CONFIG_CRYPTO 00:07:03.540 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:03.540 #undef SPDK_CONFIG_CUSTOMOCF 00:07:03.540 #undef SPDK_CONFIG_DAOS 00:07:03.540 #define SPDK_CONFIG_DAOS_DIR 00:07:03.540 #define SPDK_CONFIG_DEBUG 1 00:07:03.540 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:03.540 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:07:03.540 #define SPDK_CONFIG_DPDK_INC_DIR 00:07:03.540 #define SPDK_CONFIG_DPDK_LIB_DIR 00:07:03.540 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:03.540 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:03.540 #define SPDK_CONFIG_EXAMPLES 1 00:07:03.540 #undef SPDK_CONFIG_FC 00:07:03.540 #define SPDK_CONFIG_FC_PATH 00:07:03.540 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:03.540 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:03.540 #undef SPDK_CONFIG_FUSE 00:07:03.540 #undef SPDK_CONFIG_FUZZER 00:07:03.540 #define SPDK_CONFIG_FUZZER_LIB 00:07:03.540 #undef SPDK_CONFIG_GOLANG 00:07:03.540 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:03.540 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:03.540 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:03.540 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:03.540 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:03.540 #define SPDK_CONFIG_IDXD 1 00:07:03.540 #define SPDK_CONFIG_IDXD_KERNEL 1 00:07:03.540 #undef SPDK_CONFIG_IPSEC_MB 00:07:03.540 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:03.540 #define SPDK_CONFIG_ISAL 1 00:07:03.540 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:03.540 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:03.540 #define SPDK_CONFIG_LIBDIR 00:07:03.540 #undef SPDK_CONFIG_LTO 00:07:03.540 #define SPDK_CONFIG_MAX_LCORES 00:07:03.540 #define SPDK_CONFIG_NVME_CUSE 1 00:07:03.540 #undef SPDK_CONFIG_OCF 00:07:03.540 #define SPDK_CONFIG_OCF_PATH 00:07:03.540 #define SPDK_CONFIG_OPENSSL_PATH 00:07:03.540 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:03.540 #undef SPDK_CONFIG_PGO_USE 00:07:03.540 #define SPDK_CONFIG_PREFIX /usr/local 00:07:03.540 #undef SPDK_CONFIG_RAID5F 00:07:03.540 #undef SPDK_CONFIG_RBD 00:07:03.540 #define SPDK_CONFIG_RDMA 1 00:07:03.540 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:03.540 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:03.540 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:03.540 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:03.540 #define SPDK_CONFIG_SHARED 1 00:07:03.540 #undef SPDK_CONFIG_SMA 00:07:03.540 #define SPDK_CONFIG_TESTS 1 00:07:03.540 #undef SPDK_CONFIG_TSAN 00:07:03.540 #define SPDK_CONFIG_UBLK 1 00:07:03.540 #define SPDK_CONFIG_UBSAN 1 00:07:03.540 #undef SPDK_CONFIG_UNIT_TESTS 00:07:03.540 #undef SPDK_CONFIG_URING 00:07:03.540 #define SPDK_CONFIG_URING_PATH 00:07:03.540 #undef SPDK_CONFIG_URING_ZNS 00:07:03.540 #undef SPDK_CONFIG_USDT 00:07:03.540 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:03.540 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:03.540 #undef SPDK_CONFIG_VFIO_USER 00:07:03.540 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:03.540 #define SPDK_CONFIG_VHOST 1 00:07:03.540 #define SPDK_CONFIG_VIRTIO 1 00:07:03.540 #undef SPDK_CONFIG_VTUNE 00:07:03.540 #define SPDK_CONFIG_VTUNE_DIR 00:07:03.540 #define SPDK_CONFIG_WERROR 1 00:07:03.540 #define SPDK_CONFIG_WPDK_DIR 00:07:03.540 #undef SPDK_CONFIG_XNVME 00:07:03.540 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:03.540 16:49:14 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:03.540 16:49:14 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:03.540 16:49:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:03.540 16:49:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:03.540 16:49:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:03.540 16:49:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.540 16:49:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.540 16:49:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.540 16:49:14 -- paths/export.sh@5 -- # export PATH 00:07:03.540 16:49:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.540 16:49:14 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:03.540 16:49:14 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:03.540 16:49:14 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:03.540 16:49:14 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:03.540 16:49:14 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:03.540 16:49:14 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:03.540 16:49:14 -- pm/common@16 -- # TEST_TAG=N/A 00:07:03.540 16:49:14 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:07:03.540 16:49:14 -- common/autotest_common.sh@52 -- # : 1 00:07:03.540 16:49:14 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:07:03.540 16:49:14 -- common/autotest_common.sh@56 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:03.540 16:49:14 -- common/autotest_common.sh@58 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:07:03.540 16:49:14 -- common/autotest_common.sh@60 -- # : 1 00:07:03.540 16:49:14 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:03.540 16:49:14 -- common/autotest_common.sh@62 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:07:03.540 16:49:14 -- common/autotest_common.sh@64 -- # : 00:07:03.540 16:49:14 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:07:03.540 16:49:14 -- common/autotest_common.sh@66 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:07:03.540 16:49:14 -- common/autotest_common.sh@68 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:07:03.540 16:49:14 -- common/autotest_common.sh@70 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:07:03.540 16:49:14 -- common/autotest_common.sh@72 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:03.540 16:49:14 -- common/autotest_common.sh@74 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:07:03.540 16:49:14 -- common/autotest_common.sh@76 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:07:03.540 16:49:14 -- common/autotest_common.sh@78 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:07:03.540 16:49:14 -- common/autotest_common.sh@80 -- # : 1 00:07:03.540 16:49:14 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:07:03.540 16:49:14 -- common/autotest_common.sh@82 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:07:03.540 16:49:14 -- common/autotest_common.sh@84 -- # : 0 00:07:03.540 16:49:14 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:07:03.540 16:49:14 -- common/autotest_common.sh@86 -- # : 1 00:07:03.540 16:49:14 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:07:03.541 16:49:14 -- common/autotest_common.sh@88 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:07:03.541 16:49:14 -- common/autotest_common.sh@90 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:03.541 16:49:14 -- common/autotest_common.sh@92 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:07:03.541 16:49:14 -- common/autotest_common.sh@94 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:07:03.541 16:49:14 -- common/autotest_common.sh@96 -- # : tcp 00:07:03.541 16:49:14 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:03.541 16:49:14 -- common/autotest_common.sh@98 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:07:03.541 16:49:14 -- common/autotest_common.sh@100 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:07:03.541 16:49:14 -- common/autotest_common.sh@102 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:07:03.541 16:49:14 -- common/autotest_common.sh@104 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:07:03.541 16:49:14 -- common/autotest_common.sh@106 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:07:03.541 16:49:14 -- common/autotest_common.sh@108 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:07:03.541 16:49:14 -- common/autotest_common.sh@110 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:07:03.541 16:49:14 -- common/autotest_common.sh@112 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:03.541 16:49:14 -- common/autotest_common.sh@114 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:07:03.541 16:49:14 -- common/autotest_common.sh@116 -- # : 1 00:07:03.541 16:49:14 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:07:03.541 16:49:14 -- common/autotest_common.sh@118 -- # : 00:07:03.541 16:49:14 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:03.541 16:49:14 -- common/autotest_common.sh@120 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:07:03.541 16:49:14 -- common/autotest_common.sh@122 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:07:03.541 16:49:14 -- common/autotest_common.sh@124 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:07:03.541 16:49:14 -- common/autotest_common.sh@126 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:07:03.541 16:49:14 -- common/autotest_common.sh@128 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:07:03.541 16:49:14 -- common/autotest_common.sh@130 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:07:03.541 16:49:14 -- common/autotest_common.sh@132 -- # : 00:07:03.541 16:49:14 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:07:03.541 16:49:14 -- common/autotest_common.sh@134 -- # : true 00:07:03.541 16:49:14 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:07:03.541 16:49:14 -- common/autotest_common.sh@136 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:07:03.541 16:49:14 -- common/autotest_common.sh@138 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:07:03.541 16:49:14 -- common/autotest_common.sh@140 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:07:03.541 16:49:14 -- common/autotest_common.sh@142 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:07:03.541 16:49:14 -- common/autotest_common.sh@144 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:07:03.541 16:49:14 -- common/autotest_common.sh@146 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:07:03.541 16:49:14 -- common/autotest_common.sh@148 -- # : e810 00:07:03.541 16:49:14 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:07:03.541 16:49:14 -- common/autotest_common.sh@150 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:07:03.541 16:49:14 -- common/autotest_common.sh@152 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:07:03.541 16:49:14 -- common/autotest_common.sh@154 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:07:03.541 16:49:14 -- common/autotest_common.sh@156 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:07:03.541 16:49:14 -- common/autotest_common.sh@158 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:07:03.541 16:49:14 -- common/autotest_common.sh@160 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:07:03.541 16:49:14 -- common/autotest_common.sh@163 -- # : 00:07:03.541 16:49:14 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:07:03.541 16:49:14 -- common/autotest_common.sh@165 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:07:03.541 16:49:14 -- common/autotest_common.sh@167 -- # : 0 00:07:03.541 16:49:14 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:03.541 16:49:14 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:03.541 16:49:14 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:03.541 16:49:14 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:07:03.541 16:49:14 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:07:03.541 16:49:14 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:03.541 16:49:14 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:03.541 16:49:14 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:03.541 16:49:14 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:03.541 16:49:14 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:03.541 16:49:14 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:03.541 16:49:14 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:03.541 16:49:14 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:03.541 16:49:14 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:03.541 16:49:14 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:07:03.541 16:49:14 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:03.541 16:49:14 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:03.541 16:49:14 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:03.541 16:49:14 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:03.541 16:49:14 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:03.541 16:49:14 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:07:03.541 16:49:14 -- common/autotest_common.sh@196 -- # cat 00:07:03.541 16:49:14 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:07:03.541 16:49:14 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:03.541 16:49:14 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:03.541 16:49:14 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:03.541 16:49:14 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:03.541 16:49:14 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:07:03.541 16:49:14 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:07:03.541 16:49:14 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:03.541 16:49:14 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:03.541 16:49:14 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:03.541 16:49:14 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:03.541 16:49:14 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:03.541 16:49:14 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:03.541 16:49:14 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:03.542 16:49:14 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:03.542 16:49:14 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:03.542 16:49:14 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:03.542 16:49:14 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:03.542 16:49:14 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:03.542 16:49:14 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:07:03.542 16:49:14 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:07:03.542 16:49:14 -- common/autotest_common.sh@249 -- # _LCOV= 00:07:03.542 16:49:14 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:07:03.542 16:49:14 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:07:03.542 16:49:14 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:07:03.542 16:49:14 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:07:03.542 16:49:14 -- common/autotest_common.sh@255 -- # lcov_opt= 00:07:03.542 16:49:14 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:07:03.542 16:49:14 -- common/autotest_common.sh@259 -- # export valgrind= 00:07:03.542 16:49:14 -- common/autotest_common.sh@259 -- # valgrind= 00:07:03.542 16:49:14 -- common/autotest_common.sh@265 -- # uname -s 00:07:03.542 16:49:14 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:07:03.542 16:49:14 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:07:03.542 16:49:14 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:07:03.542 16:49:14 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:07:03.542 16:49:14 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:03.542 16:49:14 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:03.542 16:49:14 -- common/autotest_common.sh@275 -- # MAKE=make 00:07:03.542 16:49:14 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:07:03.542 16:49:14 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:07:03.542 16:49:14 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:07:03.808 16:49:14 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:07:03.808 16:49:14 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:07:03.808 16:49:14 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:07:03.808 16:49:14 -- common/autotest_common.sh@301 -- # for i in "$@" 00:07:03.808 16:49:14 -- common/autotest_common.sh@302 -- # case "$i" in 00:07:03.808 16:49:14 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:07:03.808 16:49:14 -- common/autotest_common.sh@319 -- # [[ -z 103750 ]] 00:07:03.809 16:49:14 -- common/autotest_common.sh@319 -- # kill -0 103750 00:07:03.809 16:49:14 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:07:03.809 16:49:14 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:07:03.809 16:49:14 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:07:03.809 16:49:14 -- common/autotest_common.sh@332 -- # local mount target_dir 00:07:03.809 16:49:14 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:07:03.809 16:49:14 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:07:03.809 16:49:14 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:07:03.809 16:49:14 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:07:03.809 16:49:14 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.FcPbdM 00:07:03.809 16:49:14 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:03.809 16:49:14 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:07:03.809 16:49:14 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:07:03.809 16:49:14 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.FcPbdM/tests/target /tmp/spdk.FcPbdM 00:07:03.809 16:49:14 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:07:03.809 16:49:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:03.809 16:49:14 -- common/autotest_common.sh@328 -- # df -T 00:07:03.809 16:49:14 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:07:03.809 16:49:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:07:03.809 16:49:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:07:03.809 16:49:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:07:03.809 16:49:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:07:03.809 16:49:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:07:03.809 16:49:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:03.809 16:49:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:07:03.809 16:49:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:07:03.809 16:49:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:07:03.809 16:49:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:07:03.809 16:49:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:07:03.809 16:49:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:03.809 16:49:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:07:03.809 16:49:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:07:03.809 16:49:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=56691539968 00:07:03.809 16:49:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988528128 00:07:03.809 16:49:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=5296988160 00:07:03.809 16:49:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:03.810 16:49:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:03.810 16:49:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:03.810 16:49:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993006592 00:07:03.810 16:49:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:07:03.810 16:49:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:07:03.810 16:49:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:03.810 16:49:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:03.810 16:49:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:03.810 16:49:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388921344 00:07:03.810 16:49:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:07:03.810 16:49:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=8785920 00:07:03.810 16:49:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:03.810 16:49:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:03.810 16:49:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:03.810 16:49:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=30994092032 00:07:03.810 16:49:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:07:03.810 16:49:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=172032 00:07:03.810 16:49:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:03.810 16:49:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:03.810 16:49:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:03.810 16:49:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:07:03.810 16:49:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:07:03.810 16:49:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:07:03.810 16:49:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:03.810 16:49:14 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:07:03.810 * Looking for test storage... 00:07:03.810 16:49:14 -- common/autotest_common.sh@369 -- # local target_space new_size 00:07:03.810 16:49:14 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:07:03.810 16:49:14 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:03.810 16:49:14 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:03.810 16:49:14 -- common/autotest_common.sh@373 -- # mount=/ 00:07:03.810 16:49:14 -- common/autotest_common.sh@375 -- # target_space=56691539968 00:07:03.810 16:49:14 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:07:03.810 16:49:14 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:07:03.810 16:49:14 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:07:03.810 16:49:14 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:07:03.810 16:49:14 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:07:03.810 16:49:14 -- common/autotest_common.sh@382 -- # new_size=7511580672 00:07:03.810 16:49:14 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:03.810 16:49:14 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:03.810 16:49:14 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:03.810 16:49:14 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:03.810 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:03.810 16:49:14 -- common/autotest_common.sh@390 -- # return 0 00:07:03.810 16:49:14 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:07:03.810 16:49:14 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:07:03.810 16:49:14 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:03.810 16:49:14 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:03.810 16:49:14 -- common/autotest_common.sh@1682 -- # true 00:07:03.810 16:49:14 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:07:03.810 16:49:14 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:03.810 16:49:14 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:03.810 16:49:14 -- common/autotest_common.sh@27 -- # exec 00:07:03.810 16:49:14 -- common/autotest_common.sh@29 -- # exec 00:07:03.810 16:49:14 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:03.811 16:49:15 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:03.811 16:49:15 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:03.811 16:49:15 -- common/autotest_common.sh@18 -- # set -x 00:07:03.811 16:49:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:03.811 16:49:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:03.811 16:49:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:03.811 16:49:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:03.811 16:49:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:03.811 16:49:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:03.811 16:49:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:03.811 16:49:15 -- scripts/common.sh@335 -- # IFS=.-: 00:07:03.811 16:49:15 -- scripts/common.sh@335 -- # read -ra ver1 00:07:03.811 16:49:15 -- scripts/common.sh@336 -- # IFS=.-: 00:07:03.811 16:49:15 -- scripts/common.sh@336 -- # read -ra ver2 00:07:03.811 16:49:15 -- scripts/common.sh@337 -- # local 'op=<' 00:07:03.811 16:49:15 -- scripts/common.sh@339 -- # ver1_l=2 00:07:03.811 16:49:15 -- scripts/common.sh@340 -- # ver2_l=1 00:07:03.811 16:49:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:03.811 16:49:15 -- scripts/common.sh@343 -- # case "$op" in 00:07:03.811 16:49:15 -- scripts/common.sh@344 -- # : 1 00:07:03.811 16:49:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:03.811 16:49:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:03.811 16:49:15 -- scripts/common.sh@364 -- # decimal 1 00:07:03.811 16:49:15 -- scripts/common.sh@352 -- # local d=1 00:07:03.811 16:49:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:03.811 16:49:15 -- scripts/common.sh@354 -- # echo 1 00:07:03.811 16:49:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:03.811 16:49:15 -- scripts/common.sh@365 -- # decimal 2 00:07:03.811 16:49:15 -- scripts/common.sh@352 -- # local d=2 00:07:03.811 16:49:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:03.811 16:49:15 -- scripts/common.sh@354 -- # echo 2 00:07:03.811 16:49:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:03.811 16:49:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:03.811 16:49:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:03.811 16:49:15 -- scripts/common.sh@367 -- # return 0 00:07:03.811 16:49:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:03.811 16:49:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:03.811 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.811 --rc genhtml_branch_coverage=1 00:07:03.811 --rc genhtml_function_coverage=1 00:07:03.811 --rc genhtml_legend=1 00:07:03.811 --rc geninfo_all_blocks=1 00:07:03.811 --rc geninfo_unexecuted_blocks=1 00:07:03.811 00:07:03.811 ' 00:07:03.812 16:49:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:03.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.812 --rc genhtml_branch_coverage=1 00:07:03.812 --rc genhtml_function_coverage=1 00:07:03.812 --rc genhtml_legend=1 00:07:03.812 --rc geninfo_all_blocks=1 00:07:03.812 --rc geninfo_unexecuted_blocks=1 00:07:03.812 00:07:03.812 ' 00:07:03.812 16:49:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:03.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.812 --rc genhtml_branch_coverage=1 00:07:03.812 --rc genhtml_function_coverage=1 00:07:03.812 --rc genhtml_legend=1 00:07:03.812 --rc geninfo_all_blocks=1 00:07:03.812 --rc geninfo_unexecuted_blocks=1 00:07:03.812 00:07:03.812 ' 00:07:03.812 16:49:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:03.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.812 --rc genhtml_branch_coverage=1 00:07:03.812 --rc genhtml_function_coverage=1 00:07:03.812 --rc genhtml_legend=1 00:07:03.812 --rc geninfo_all_blocks=1 00:07:03.812 --rc geninfo_unexecuted_blocks=1 00:07:03.812 00:07:03.812 ' 00:07:03.812 16:49:15 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:03.812 16:49:15 -- nvmf/common.sh@7 -- # uname -s 00:07:03.812 16:49:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:03.812 16:49:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:03.812 16:49:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:03.812 16:49:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:03.812 16:49:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:03.812 16:49:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:03.812 16:49:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:03.812 16:49:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:03.812 16:49:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:03.812 16:49:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:03.812 16:49:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:03.812 16:49:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:03.812 16:49:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:03.812 16:49:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:03.812 16:49:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:03.812 16:49:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:03.812 16:49:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:03.812 16:49:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:03.812 16:49:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:03.812 16:49:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.812 16:49:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.812 16:49:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.812 16:49:15 -- paths/export.sh@5 -- # export PATH 00:07:03.812 16:49:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.812 16:49:15 -- nvmf/common.sh@46 -- # : 0 00:07:03.812 16:49:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:03.812 16:49:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:03.812 16:49:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:03.812 16:49:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:03.812 16:49:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:03.812 16:49:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:03.812 16:49:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:03.812 16:49:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:03.812 16:49:15 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:03.812 16:49:15 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:03.812 16:49:15 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:03.812 16:49:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:03.812 16:49:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:03.812 16:49:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:03.812 16:49:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:03.812 16:49:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:03.812 16:49:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:03.812 16:49:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:03.812 16:49:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:03.812 16:49:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:03.812 16:49:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:03.812 16:49:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:03.812 16:49:15 -- common/autotest_common.sh@10 -- # set +x 00:07:06.344 16:49:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:06.344 16:49:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:06.344 16:49:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:06.344 16:49:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:06.344 16:49:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:06.344 16:49:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:06.344 16:49:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:06.344 16:49:17 -- nvmf/common.sh@294 -- # net_devs=() 00:07:06.344 16:49:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:06.344 16:49:17 -- nvmf/common.sh@295 -- # e810=() 00:07:06.344 16:49:17 -- nvmf/common.sh@295 -- # local -ga e810 00:07:06.344 16:49:17 -- nvmf/common.sh@296 -- # x722=() 00:07:06.344 16:49:17 -- nvmf/common.sh@296 -- # local -ga x722 00:07:06.344 16:49:17 -- nvmf/common.sh@297 -- # mlx=() 00:07:06.344 16:49:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:06.344 16:49:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:06.344 16:49:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:06.344 16:49:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:06.344 16:49:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:06.344 16:49:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:06.344 16:49:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:06.344 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:06.344 16:49:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:06.344 16:49:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:06.344 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:06.344 16:49:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:06.344 16:49:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:06.345 16:49:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:06.345 16:49:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:06.345 16:49:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:06.345 16:49:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:06.345 16:49:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:06.345 16:49:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:06.345 16:49:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:06.345 16:49:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:06.345 16:49:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:06.345 16:49:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:06.345 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:06.345 16:49:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:06.345 16:49:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:06.345 16:49:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:06.345 16:49:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:06.345 16:49:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:06.345 16:49:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:06.345 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:06.345 16:49:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:06.345 16:49:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:06.345 16:49:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:06.345 16:49:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:06.345 16:49:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:06.345 16:49:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:06.345 16:49:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:06.345 16:49:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:06.345 16:49:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:06.345 16:49:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:06.345 16:49:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:06.345 16:49:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:06.345 16:49:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:06.345 16:49:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:06.345 16:49:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:06.345 16:49:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:06.345 16:49:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:06.345 16:49:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:06.345 16:49:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:06.345 16:49:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:06.345 16:49:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:06.345 16:49:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:06.345 16:49:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:06.345 16:49:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:06.345 16:49:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:06.345 16:49:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:06.345 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:06.345 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.276 ms 00:07:06.345 00:07:06.345 --- 10.0.0.2 ping statistics --- 00:07:06.345 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:06.345 rtt min/avg/max/mdev = 0.276/0.276/0.276/0.000 ms 00:07:06.345 16:49:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:06.345 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:06.345 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:07:06.345 00:07:06.345 --- 10.0.0.1 ping statistics --- 00:07:06.345 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:06.345 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:07:06.345 16:49:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:06.345 16:49:17 -- nvmf/common.sh@410 -- # return 0 00:07:06.345 16:49:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:06.345 16:49:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:06.345 16:49:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:06.345 16:49:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:06.345 16:49:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:06.345 16:49:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:06.345 16:49:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:06.345 16:49:17 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:06.345 16:49:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:06.345 16:49:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.345 16:49:17 -- common/autotest_common.sh@10 -- # set +x 00:07:06.345 ************************************ 00:07:06.345 START TEST nvmf_filesystem_no_in_capsule 00:07:06.345 ************************************ 00:07:06.345 16:49:17 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:06.345 16:49:17 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:06.345 16:49:17 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:06.345 16:49:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:06.345 16:49:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:06.345 16:49:17 -- common/autotest_common.sh@10 -- # set +x 00:07:06.345 16:49:17 -- nvmf/common.sh@469 -- # nvmfpid=105399 00:07:06.345 16:49:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:06.345 16:49:17 -- nvmf/common.sh@470 -- # waitforlisten 105399 00:07:06.345 16:49:17 -- common/autotest_common.sh@829 -- # '[' -z 105399 ']' 00:07:06.345 16:49:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:06.345 16:49:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:06.345 16:49:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:06.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:06.345 16:49:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:06.345 16:49:17 -- common/autotest_common.sh@10 -- # set +x 00:07:06.345 [2024-11-29 16:49:17.418761] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:06.345 [2024-11-29 16:49:17.418842] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:06.345 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.345 [2024-11-29 16:49:17.493813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:06.345 [2024-11-29 16:49:17.616992] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:06.345 [2024-11-29 16:49:17.617158] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:06.345 [2024-11-29 16:49:17.617177] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:06.345 [2024-11-29 16:49:17.617192] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:06.345 [2024-11-29 16:49:17.617273] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:06.345 [2024-11-29 16:49:17.617332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:06.345 [2024-11-29 16:49:17.617359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:06.345 [2024-11-29 16:49:17.617362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.279 16:49:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:07.279 16:49:18 -- common/autotest_common.sh@862 -- # return 0 00:07:07.279 16:49:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:07.279 16:49:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:07.279 16:49:18 -- common/autotest_common.sh@10 -- # set +x 00:07:07.279 16:49:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:07.279 16:49:18 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:07.279 16:49:18 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:07.279 16:49:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.279 16:49:18 -- common/autotest_common.sh@10 -- # set +x 00:07:07.279 [2024-11-29 16:49:18.455669] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:07.279 16:49:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.279 16:49:18 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:07.279 16:49:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.279 16:49:18 -- common/autotest_common.sh@10 -- # set +x 00:07:07.279 Malloc1 00:07:07.279 16:49:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.279 16:49:18 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:07.279 16:49:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.279 16:49:18 -- common/autotest_common.sh@10 -- # set +x 00:07:07.279 16:49:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.279 16:49:18 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:07.279 16:49:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.279 16:49:18 -- common/autotest_common.sh@10 -- # set +x 00:07:07.279 16:49:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.279 16:49:18 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:07.279 16:49:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.279 16:49:18 -- common/autotest_common.sh@10 -- # set +x 00:07:07.279 [2024-11-29 16:49:18.633475] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:07.279 16:49:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.279 16:49:18 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:07.279 16:49:18 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:07.279 16:49:18 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:07.279 16:49:18 -- common/autotest_common.sh@1369 -- # local bs 00:07:07.279 16:49:18 -- common/autotest_common.sh@1370 -- # local nb 00:07:07.279 16:49:18 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:07.279 16:49:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.279 16:49:18 -- common/autotest_common.sh@10 -- # set +x 00:07:07.279 16:49:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.279 16:49:18 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:07.279 { 00:07:07.279 "name": "Malloc1", 00:07:07.279 "aliases": [ 00:07:07.279 "28a43bea-8f00-4c2b-b69b-25cf24d4333e" 00:07:07.279 ], 00:07:07.279 "product_name": "Malloc disk", 00:07:07.279 "block_size": 512, 00:07:07.279 "num_blocks": 1048576, 00:07:07.279 "uuid": "28a43bea-8f00-4c2b-b69b-25cf24d4333e", 00:07:07.279 "assigned_rate_limits": { 00:07:07.279 "rw_ios_per_sec": 0, 00:07:07.279 "rw_mbytes_per_sec": 0, 00:07:07.279 "r_mbytes_per_sec": 0, 00:07:07.279 "w_mbytes_per_sec": 0 00:07:07.279 }, 00:07:07.279 "claimed": true, 00:07:07.279 "claim_type": "exclusive_write", 00:07:07.279 "zoned": false, 00:07:07.279 "supported_io_types": { 00:07:07.279 "read": true, 00:07:07.279 "write": true, 00:07:07.279 "unmap": true, 00:07:07.279 "write_zeroes": true, 00:07:07.279 "flush": true, 00:07:07.279 "reset": true, 00:07:07.279 "compare": false, 00:07:07.279 "compare_and_write": false, 00:07:07.279 "abort": true, 00:07:07.279 "nvme_admin": false, 00:07:07.279 "nvme_io": false 00:07:07.279 }, 00:07:07.279 "memory_domains": [ 00:07:07.279 { 00:07:07.279 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:07.279 "dma_device_type": 2 00:07:07.279 } 00:07:07.279 ], 00:07:07.279 "driver_specific": {} 00:07:07.279 } 00:07:07.279 ]' 00:07:07.279 16:49:18 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:07.279 16:49:18 -- common/autotest_common.sh@1372 -- # bs=512 00:07:07.279 16:49:18 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:07.537 16:49:18 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:07.537 16:49:18 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:07.537 16:49:18 -- common/autotest_common.sh@1377 -- # echo 512 00:07:07.537 16:49:18 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:07.537 16:49:18 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:08.102 16:49:19 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:08.102 16:49:19 -- common/autotest_common.sh@1187 -- # local i=0 00:07:08.102 16:49:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:08.102 16:49:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:08.102 16:49:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:10.002 16:49:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:10.002 16:49:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:10.002 16:49:21 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:10.002 16:49:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:10.002 16:49:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:10.002 16:49:21 -- common/autotest_common.sh@1197 -- # return 0 00:07:10.002 16:49:21 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:10.002 16:49:21 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:10.002 16:49:21 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:10.260 16:49:21 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:10.260 16:49:21 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:10.260 16:49:21 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:10.260 16:49:21 -- setup/common.sh@80 -- # echo 536870912 00:07:10.260 16:49:21 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:10.260 16:49:21 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:10.260 16:49:21 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:10.260 16:49:21 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:10.260 16:49:21 -- target/filesystem.sh@69 -- # partprobe 00:07:11.194 16:49:22 -- target/filesystem.sh@70 -- # sleep 1 00:07:12.128 16:49:23 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:12.128 16:49:23 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:12.128 16:49:23 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:12.128 16:49:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:12.128 16:49:23 -- common/autotest_common.sh@10 -- # set +x 00:07:12.128 ************************************ 00:07:12.128 START TEST filesystem_ext4 00:07:12.128 ************************************ 00:07:12.128 16:49:23 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:12.128 16:49:23 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:12.128 16:49:23 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:12.128 16:49:23 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:12.128 16:49:23 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:12.128 16:49:23 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:12.128 16:49:23 -- common/autotest_common.sh@914 -- # local i=0 00:07:12.128 16:49:23 -- common/autotest_common.sh@915 -- # local force 00:07:12.128 16:49:23 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:12.128 16:49:23 -- common/autotest_common.sh@918 -- # force=-F 00:07:12.128 16:49:23 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:12.128 mke2fs 1.47.0 (5-Feb-2023) 00:07:12.128 Discarding device blocks: 0/522240 done 00:07:12.128 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:12.128 Filesystem UUID: b1f34b78-02c3-4341-8287-748636b8efde 00:07:12.128 Superblock backups stored on blocks: 00:07:12.128 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:12.128 00:07:12.128 Allocating group tables: 0/64 done 00:07:12.128 Writing inode tables: 0/64 done 00:07:13.065 Creating journal (8192 blocks): done 00:07:13.065 Writing superblocks and filesystem accounting information: 0/64 done 00:07:13.065 00:07:13.065 16:49:24 -- common/autotest_common.sh@931 -- # return 0 00:07:13.065 16:49:24 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:19.634 16:49:29 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:19.634 16:49:29 -- target/filesystem.sh@25 -- # sync 00:07:19.634 16:49:29 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:19.634 16:49:29 -- target/filesystem.sh@27 -- # sync 00:07:19.634 16:49:29 -- target/filesystem.sh@29 -- # i=0 00:07:19.634 16:49:29 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:19.634 16:49:29 -- target/filesystem.sh@37 -- # kill -0 105399 00:07:19.634 16:49:29 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:19.634 16:49:29 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:19.634 16:49:29 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:19.634 16:49:29 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:19.634 00:07:19.634 real 0m6.626s 00:07:19.634 user 0m0.024s 00:07:19.634 sys 0m0.059s 00:07:19.634 16:49:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.634 16:49:29 -- common/autotest_common.sh@10 -- # set +x 00:07:19.634 ************************************ 00:07:19.634 END TEST filesystem_ext4 00:07:19.634 ************************************ 00:07:19.634 16:49:29 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:19.634 16:49:29 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:19.634 16:49:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.634 16:49:29 -- common/autotest_common.sh@10 -- # set +x 00:07:19.634 ************************************ 00:07:19.634 START TEST filesystem_btrfs 00:07:19.634 ************************************ 00:07:19.634 16:49:29 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:19.634 16:49:29 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:19.634 16:49:29 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:19.634 16:49:29 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:19.634 16:49:29 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:19.634 16:49:29 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:19.634 16:49:29 -- common/autotest_common.sh@914 -- # local i=0 00:07:19.634 16:49:29 -- common/autotest_common.sh@915 -- # local force 00:07:19.634 16:49:29 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:19.634 16:49:29 -- common/autotest_common.sh@920 -- # force=-f 00:07:19.634 16:49:29 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:19.634 btrfs-progs v6.8.1 00:07:19.634 See https://btrfs.readthedocs.io for more information. 00:07:19.634 00:07:19.634 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:19.634 NOTE: several default settings have changed in version 5.15, please make sure 00:07:19.634 this does not affect your deployments: 00:07:19.634 - DUP for metadata (-m dup) 00:07:19.634 - enabled no-holes (-O no-holes) 00:07:19.634 - enabled free-space-tree (-R free-space-tree) 00:07:19.634 00:07:19.634 Label: (null) 00:07:19.634 UUID: 4323e009-a4ca-4e5b-875d-7a0a939700fe 00:07:19.634 Node size: 16384 00:07:19.635 Sector size: 4096 (CPU page size: 4096) 00:07:19.635 Filesystem size: 510.00MiB 00:07:19.635 Block group profiles: 00:07:19.635 Data: single 8.00MiB 00:07:19.635 Metadata: DUP 32.00MiB 00:07:19.635 System: DUP 8.00MiB 00:07:19.635 SSD detected: yes 00:07:19.635 Zoned device: no 00:07:19.635 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:19.635 Checksum: crc32c 00:07:19.635 Number of devices: 1 00:07:19.635 Devices: 00:07:19.635 ID SIZE PATH 00:07:19.635 1 510.00MiB /dev/nvme0n1p1 00:07:19.635 00:07:19.635 16:49:30 -- common/autotest_common.sh@931 -- # return 0 00:07:19.635 16:49:30 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:19.635 16:49:31 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:19.635 16:49:31 -- target/filesystem.sh@25 -- # sync 00:07:19.635 16:49:31 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:19.635 16:49:31 -- target/filesystem.sh@27 -- # sync 00:07:19.635 16:49:31 -- target/filesystem.sh@29 -- # i=0 00:07:19.635 16:49:31 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:19.893 16:49:31 -- target/filesystem.sh@37 -- # kill -0 105399 00:07:19.893 16:49:31 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:19.893 16:49:31 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:19.893 16:49:31 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:19.893 16:49:31 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:19.893 00:07:19.893 real 0m1.150s 00:07:19.893 user 0m0.015s 00:07:19.893 sys 0m0.144s 00:07:19.893 16:49:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.893 16:49:31 -- common/autotest_common.sh@10 -- # set +x 00:07:19.893 ************************************ 00:07:19.893 END TEST filesystem_btrfs 00:07:19.893 ************************************ 00:07:19.893 16:49:31 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:19.893 16:49:31 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:19.893 16:49:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.893 16:49:31 -- common/autotest_common.sh@10 -- # set +x 00:07:19.893 ************************************ 00:07:19.893 START TEST filesystem_xfs 00:07:19.893 ************************************ 00:07:19.893 16:49:31 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:19.893 16:49:31 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:19.893 16:49:31 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:19.893 16:49:31 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:19.893 16:49:31 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:19.893 16:49:31 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:19.893 16:49:31 -- common/autotest_common.sh@914 -- # local i=0 00:07:19.893 16:49:31 -- common/autotest_common.sh@915 -- # local force 00:07:19.893 16:49:31 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:19.893 16:49:31 -- common/autotest_common.sh@920 -- # force=-f 00:07:19.893 16:49:31 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:19.893 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:19.893 = sectsz=512 attr=2, projid32bit=1 00:07:19.893 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:19.893 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:19.893 data = bsize=4096 blocks=130560, imaxpct=25 00:07:19.893 = sunit=0 swidth=0 blks 00:07:19.893 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:19.893 log =internal log bsize=4096 blocks=16384, version=2 00:07:19.893 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:19.893 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:20.827 Discarding blocks...Done. 00:07:20.828 16:49:32 -- common/autotest_common.sh@931 -- # return 0 00:07:20.828 16:49:32 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:23.357 16:49:34 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:23.357 16:49:34 -- target/filesystem.sh@25 -- # sync 00:07:23.357 16:49:34 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:23.357 16:49:34 -- target/filesystem.sh@27 -- # sync 00:07:23.357 16:49:34 -- target/filesystem.sh@29 -- # i=0 00:07:23.357 16:49:34 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:23.357 16:49:34 -- target/filesystem.sh@37 -- # kill -0 105399 00:07:23.357 16:49:34 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:23.357 16:49:34 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:23.357 16:49:34 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:23.357 16:49:34 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:23.357 00:07:23.357 real 0m3.270s 00:07:23.357 user 0m0.017s 00:07:23.357 sys 0m0.085s 00:07:23.357 16:49:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:23.357 16:49:34 -- common/autotest_common.sh@10 -- # set +x 00:07:23.357 ************************************ 00:07:23.357 END TEST filesystem_xfs 00:07:23.357 ************************************ 00:07:23.357 16:49:34 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:23.357 16:49:34 -- target/filesystem.sh@93 -- # sync 00:07:23.357 16:49:34 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:23.357 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:23.357 16:49:34 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:23.357 16:49:34 -- common/autotest_common.sh@1208 -- # local i=0 00:07:23.357 16:49:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:23.357 16:49:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:23.357 16:49:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:23.357 16:49:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:23.615 16:49:34 -- common/autotest_common.sh@1220 -- # return 0 00:07:23.615 16:49:34 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:23.615 16:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:23.615 16:49:34 -- common/autotest_common.sh@10 -- # set +x 00:07:23.615 16:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:23.615 16:49:34 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:23.615 16:49:34 -- target/filesystem.sh@101 -- # killprocess 105399 00:07:23.615 16:49:34 -- common/autotest_common.sh@936 -- # '[' -z 105399 ']' 00:07:23.615 16:49:34 -- common/autotest_common.sh@940 -- # kill -0 105399 00:07:23.615 16:49:34 -- common/autotest_common.sh@941 -- # uname 00:07:23.615 16:49:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:23.615 16:49:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 105399 00:07:23.615 16:49:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:23.615 16:49:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:23.615 16:49:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 105399' 00:07:23.615 killing process with pid 105399 00:07:23.615 16:49:34 -- common/autotest_common.sh@955 -- # kill 105399 00:07:23.615 16:49:34 -- common/autotest_common.sh@960 -- # wait 105399 00:07:24.184 16:49:35 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:24.184 00:07:24.184 real 0m17.960s 00:07:24.184 user 1m9.480s 00:07:24.184 sys 0m2.238s 00:07:24.184 16:49:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.184 16:49:35 -- common/autotest_common.sh@10 -- # set +x 00:07:24.184 ************************************ 00:07:24.184 END TEST nvmf_filesystem_no_in_capsule 00:07:24.184 ************************************ 00:07:24.184 16:49:35 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:24.184 16:49:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:24.184 16:49:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.184 16:49:35 -- common/autotest_common.sh@10 -- # set +x 00:07:24.184 ************************************ 00:07:24.184 START TEST nvmf_filesystem_in_capsule 00:07:24.184 ************************************ 00:07:24.184 16:49:35 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:24.184 16:49:35 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:24.184 16:49:35 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:24.184 16:49:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:24.184 16:49:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:24.184 16:49:35 -- common/autotest_common.sh@10 -- # set +x 00:07:24.184 16:49:35 -- nvmf/common.sh@469 -- # nvmfpid=107829 00:07:24.184 16:49:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:24.184 16:49:35 -- nvmf/common.sh@470 -- # waitforlisten 107829 00:07:24.184 16:49:35 -- common/autotest_common.sh@829 -- # '[' -z 107829 ']' 00:07:24.184 16:49:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:24.184 16:49:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:24.184 16:49:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:24.184 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:24.184 16:49:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:24.184 16:49:35 -- common/autotest_common.sh@10 -- # set +x 00:07:24.184 [2024-11-29 16:49:35.404732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:24.184 [2024-11-29 16:49:35.404809] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:24.184 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.184 [2024-11-29 16:49:35.467685] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:24.184 [2024-11-29 16:49:35.575680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:24.184 [2024-11-29 16:49:35.575836] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:24.184 [2024-11-29 16:49:35.575853] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:24.184 [2024-11-29 16:49:35.575866] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:24.184 [2024-11-29 16:49:35.575932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:24.184 [2024-11-29 16:49:35.575986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:24.184 [2024-11-29 16:49:35.576052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:24.184 [2024-11-29 16:49:35.576055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.118 16:49:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:25.118 16:49:36 -- common/autotest_common.sh@862 -- # return 0 00:07:25.118 16:49:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:25.118 16:49:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:25.118 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:07:25.118 16:49:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:25.118 16:49:36 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:25.118 16:49:36 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:25.118 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.118 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:07:25.118 [2024-11-29 16:49:36.466781] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:25.118 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.118 16:49:36 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:25.118 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.118 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:07:25.377 Malloc1 00:07:25.377 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.377 16:49:36 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:25.377 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.377 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:07:25.377 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.377 16:49:36 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:25.377 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.377 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:07:25.377 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.377 16:49:36 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:25.377 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.377 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:07:25.377 [2024-11-29 16:49:36.640636] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:25.377 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.377 16:49:36 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:25.377 16:49:36 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:25.377 16:49:36 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:25.377 16:49:36 -- common/autotest_common.sh@1369 -- # local bs 00:07:25.377 16:49:36 -- common/autotest_common.sh@1370 -- # local nb 00:07:25.377 16:49:36 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:25.377 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.377 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:07:25.377 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.377 16:49:36 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:25.377 { 00:07:25.377 "name": "Malloc1", 00:07:25.377 "aliases": [ 00:07:25.377 "2d47e6fe-0ced-49bf-a0f5-ba3f1ffad5bd" 00:07:25.377 ], 00:07:25.377 "product_name": "Malloc disk", 00:07:25.377 "block_size": 512, 00:07:25.377 "num_blocks": 1048576, 00:07:25.377 "uuid": "2d47e6fe-0ced-49bf-a0f5-ba3f1ffad5bd", 00:07:25.377 "assigned_rate_limits": { 00:07:25.377 "rw_ios_per_sec": 0, 00:07:25.377 "rw_mbytes_per_sec": 0, 00:07:25.377 "r_mbytes_per_sec": 0, 00:07:25.377 "w_mbytes_per_sec": 0 00:07:25.377 }, 00:07:25.377 "claimed": true, 00:07:25.377 "claim_type": "exclusive_write", 00:07:25.377 "zoned": false, 00:07:25.377 "supported_io_types": { 00:07:25.377 "read": true, 00:07:25.377 "write": true, 00:07:25.377 "unmap": true, 00:07:25.377 "write_zeroes": true, 00:07:25.377 "flush": true, 00:07:25.377 "reset": true, 00:07:25.377 "compare": false, 00:07:25.377 "compare_and_write": false, 00:07:25.377 "abort": true, 00:07:25.377 "nvme_admin": false, 00:07:25.377 "nvme_io": false 00:07:25.377 }, 00:07:25.377 "memory_domains": [ 00:07:25.377 { 00:07:25.377 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:25.377 "dma_device_type": 2 00:07:25.377 } 00:07:25.377 ], 00:07:25.377 "driver_specific": {} 00:07:25.377 } 00:07:25.377 ]' 00:07:25.377 16:49:36 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:25.377 16:49:36 -- common/autotest_common.sh@1372 -- # bs=512 00:07:25.377 16:49:36 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:25.377 16:49:36 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:25.377 16:49:36 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:25.377 16:49:36 -- common/autotest_common.sh@1377 -- # echo 512 00:07:25.377 16:49:36 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:25.377 16:49:36 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:25.944 16:49:37 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:25.944 16:49:37 -- common/autotest_common.sh@1187 -- # local i=0 00:07:25.944 16:49:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:25.944 16:49:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:25.944 16:49:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:28.471 16:49:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:28.471 16:49:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:28.471 16:49:39 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:28.471 16:49:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:28.471 16:49:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:28.471 16:49:39 -- common/autotest_common.sh@1197 -- # return 0 00:07:28.471 16:49:39 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:28.471 16:49:39 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:28.471 16:49:39 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:28.471 16:49:39 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:28.471 16:49:39 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:28.471 16:49:39 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:28.471 16:49:39 -- setup/common.sh@80 -- # echo 536870912 00:07:28.471 16:49:39 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:28.471 16:49:39 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:28.471 16:49:39 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:28.471 16:49:39 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:28.471 16:49:39 -- target/filesystem.sh@69 -- # partprobe 00:07:29.036 16:49:40 -- target/filesystem.sh@70 -- # sleep 1 00:07:29.971 16:49:41 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:29.971 16:49:41 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:29.971 16:49:41 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:29.971 16:49:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.971 16:49:41 -- common/autotest_common.sh@10 -- # set +x 00:07:29.971 ************************************ 00:07:29.971 START TEST filesystem_in_capsule_ext4 00:07:29.971 ************************************ 00:07:29.971 16:49:41 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:29.971 16:49:41 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:29.971 16:49:41 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:29.971 16:49:41 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:29.971 16:49:41 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:29.971 16:49:41 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:29.971 16:49:41 -- common/autotest_common.sh@914 -- # local i=0 00:07:29.971 16:49:41 -- common/autotest_common.sh@915 -- # local force 00:07:29.971 16:49:41 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:29.971 16:49:41 -- common/autotest_common.sh@918 -- # force=-F 00:07:29.971 16:49:41 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:29.971 mke2fs 1.47.0 (5-Feb-2023) 00:07:29.971 Discarding device blocks: 0/522240 done 00:07:29.971 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:29.971 Filesystem UUID: f5ca6449-ca62-4d17-8d06-4b59ab4a6a1a 00:07:29.971 Superblock backups stored on blocks: 00:07:29.971 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:29.971 00:07:29.971 Allocating group tables: 0/64 done 00:07:29.971 Writing inode tables: 0/64 done 00:07:30.536 Creating journal (8192 blocks): done 00:07:32.840 Writing superblocks and filesystem accounting information: 0/6428/64 done 00:07:32.840 00:07:32.840 16:49:44 -- common/autotest_common.sh@931 -- # return 0 00:07:32.840 16:49:44 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:38.112 16:49:49 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:38.112 16:49:49 -- target/filesystem.sh@25 -- # sync 00:07:38.112 16:49:49 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:38.112 16:49:49 -- target/filesystem.sh@27 -- # sync 00:07:38.112 16:49:49 -- target/filesystem.sh@29 -- # i=0 00:07:38.112 16:49:49 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:38.112 16:49:49 -- target/filesystem.sh@37 -- # kill -0 107829 00:07:38.112 16:49:49 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:38.112 16:49:49 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:38.112 16:49:49 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:38.112 16:49:49 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:38.112 00:07:38.112 real 0m8.087s 00:07:38.112 user 0m0.021s 00:07:38.112 sys 0m0.058s 00:07:38.112 16:49:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.112 16:49:49 -- common/autotest_common.sh@10 -- # set +x 00:07:38.112 ************************************ 00:07:38.112 END TEST filesystem_in_capsule_ext4 00:07:38.112 ************************************ 00:07:38.112 16:49:49 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:38.112 16:49:49 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:38.112 16:49:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.112 16:49:49 -- common/autotest_common.sh@10 -- # set +x 00:07:38.112 ************************************ 00:07:38.112 START TEST filesystem_in_capsule_btrfs 00:07:38.112 ************************************ 00:07:38.112 16:49:49 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:38.112 16:49:49 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:38.112 16:49:49 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:38.112 16:49:49 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:38.112 16:49:49 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:38.112 16:49:49 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:38.112 16:49:49 -- common/autotest_common.sh@914 -- # local i=0 00:07:38.112 16:49:49 -- common/autotest_common.sh@915 -- # local force 00:07:38.112 16:49:49 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:38.112 16:49:49 -- common/autotest_common.sh@920 -- # force=-f 00:07:38.112 16:49:49 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:38.112 btrfs-progs v6.8.1 00:07:38.112 See https://btrfs.readthedocs.io for more information. 00:07:38.112 00:07:38.112 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:38.112 NOTE: several default settings have changed in version 5.15, please make sure 00:07:38.112 this does not affect your deployments: 00:07:38.112 - DUP for metadata (-m dup) 00:07:38.112 - enabled no-holes (-O no-holes) 00:07:38.112 - enabled free-space-tree (-R free-space-tree) 00:07:38.112 00:07:38.112 Label: (null) 00:07:38.112 UUID: 543773ea-e908-4744-bdc6-ef3bb754fdd5 00:07:38.112 Node size: 16384 00:07:38.112 Sector size: 4096 (CPU page size: 4096) 00:07:38.112 Filesystem size: 510.00MiB 00:07:38.112 Block group profiles: 00:07:38.112 Data: single 8.00MiB 00:07:38.112 Metadata: DUP 32.00MiB 00:07:38.112 System: DUP 8.00MiB 00:07:38.112 SSD detected: yes 00:07:38.112 Zoned device: no 00:07:38.112 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:38.112 Checksum: crc32c 00:07:38.112 Number of devices: 1 00:07:38.112 Devices: 00:07:38.112 ID SIZE PATH 00:07:38.112 1 510.00MiB /dev/nvme0n1p1 00:07:38.112 00:07:38.112 16:49:49 -- common/autotest_common.sh@931 -- # return 0 00:07:38.112 16:49:49 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:38.370 16:49:49 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:38.370 16:49:49 -- target/filesystem.sh@25 -- # sync 00:07:38.370 16:49:49 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:38.370 16:49:49 -- target/filesystem.sh@27 -- # sync 00:07:38.370 16:49:49 -- target/filesystem.sh@29 -- # i=0 00:07:38.370 16:49:49 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:38.370 16:49:49 -- target/filesystem.sh@37 -- # kill -0 107829 00:07:38.370 16:49:49 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:38.370 16:49:49 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:38.370 16:49:49 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:38.370 16:49:49 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:38.370 00:07:38.370 real 0m0.453s 00:07:38.370 user 0m0.021s 00:07:38.370 sys 0m0.088s 00:07:38.370 16:49:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.370 16:49:49 -- common/autotest_common.sh@10 -- # set +x 00:07:38.370 ************************************ 00:07:38.370 END TEST filesystem_in_capsule_btrfs 00:07:38.370 ************************************ 00:07:38.628 16:49:49 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:38.629 16:49:49 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:38.629 16:49:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.629 16:49:49 -- common/autotest_common.sh@10 -- # set +x 00:07:38.629 ************************************ 00:07:38.629 START TEST filesystem_in_capsule_xfs 00:07:38.629 ************************************ 00:07:38.629 16:49:49 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:38.629 16:49:49 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:38.629 16:49:49 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:38.629 16:49:49 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:38.629 16:49:49 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:38.629 16:49:49 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:38.629 16:49:49 -- common/autotest_common.sh@914 -- # local i=0 00:07:38.629 16:49:49 -- common/autotest_common.sh@915 -- # local force 00:07:38.629 16:49:49 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:38.629 16:49:49 -- common/autotest_common.sh@920 -- # force=-f 00:07:38.629 16:49:49 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:38.629 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:38.629 = sectsz=512 attr=2, projid32bit=1 00:07:38.629 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:38.629 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:38.629 data = bsize=4096 blocks=130560, imaxpct=25 00:07:38.629 = sunit=0 swidth=0 blks 00:07:38.629 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:38.629 log =internal log bsize=4096 blocks=16384, version=2 00:07:38.629 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:38.629 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:39.561 Discarding blocks...Done. 00:07:39.561 16:49:50 -- common/autotest_common.sh@931 -- # return 0 00:07:39.561 16:49:50 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:42.088 16:49:53 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:42.088 16:49:53 -- target/filesystem.sh@25 -- # sync 00:07:42.089 16:49:53 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:42.089 16:49:53 -- target/filesystem.sh@27 -- # sync 00:07:42.089 16:49:53 -- target/filesystem.sh@29 -- # i=0 00:07:42.089 16:49:53 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:42.089 16:49:53 -- target/filesystem.sh@37 -- # kill -0 107829 00:07:42.089 16:49:53 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:42.089 16:49:53 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:42.089 16:49:53 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:42.089 16:49:53 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:42.089 00:07:42.089 real 0m3.678s 00:07:42.089 user 0m0.018s 00:07:42.089 sys 0m0.060s 00:07:42.089 16:49:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:42.089 16:49:53 -- common/autotest_common.sh@10 -- # set +x 00:07:42.089 ************************************ 00:07:42.089 END TEST filesystem_in_capsule_xfs 00:07:42.089 ************************************ 00:07:42.089 16:49:53 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:42.347 16:49:53 -- target/filesystem.sh@93 -- # sync 00:07:42.347 16:49:53 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:42.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:42.347 16:49:53 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:42.347 16:49:53 -- common/autotest_common.sh@1208 -- # local i=0 00:07:42.347 16:49:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:42.347 16:49:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:42.347 16:49:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:42.347 16:49:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:42.347 16:49:53 -- common/autotest_common.sh@1220 -- # return 0 00:07:42.347 16:49:53 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:42.347 16:49:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.347 16:49:53 -- common/autotest_common.sh@10 -- # set +x 00:07:42.347 16:49:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.347 16:49:53 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:42.347 16:49:53 -- target/filesystem.sh@101 -- # killprocess 107829 00:07:42.347 16:49:53 -- common/autotest_common.sh@936 -- # '[' -z 107829 ']' 00:07:42.347 16:49:53 -- common/autotest_common.sh@940 -- # kill -0 107829 00:07:42.347 16:49:53 -- common/autotest_common.sh@941 -- # uname 00:07:42.347 16:49:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:42.347 16:49:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 107829 00:07:42.347 16:49:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:42.347 16:49:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:42.347 16:49:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 107829' 00:07:42.347 killing process with pid 107829 00:07:42.347 16:49:53 -- common/autotest_common.sh@955 -- # kill 107829 00:07:42.347 16:49:53 -- common/autotest_common.sh@960 -- # wait 107829 00:07:42.912 16:49:54 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:42.912 00:07:42.912 real 0m18.883s 00:07:42.912 user 1m13.235s 00:07:42.912 sys 0m2.178s 00:07:42.912 16:49:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:42.912 16:49:54 -- common/autotest_common.sh@10 -- # set +x 00:07:42.912 ************************************ 00:07:42.912 END TEST nvmf_filesystem_in_capsule 00:07:42.912 ************************************ 00:07:42.912 16:49:54 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:42.912 16:49:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:42.912 16:49:54 -- nvmf/common.sh@116 -- # sync 00:07:42.912 16:49:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:42.912 16:49:54 -- nvmf/common.sh@119 -- # set +e 00:07:42.912 16:49:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:42.912 16:49:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:42.912 rmmod nvme_tcp 00:07:42.912 rmmod nvme_fabrics 00:07:42.912 rmmod nvme_keyring 00:07:42.912 16:49:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:43.171 16:49:54 -- nvmf/common.sh@123 -- # set -e 00:07:43.171 16:49:54 -- nvmf/common.sh@124 -- # return 0 00:07:43.171 16:49:54 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:43.171 16:49:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:43.171 16:49:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:43.171 16:49:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:43.171 16:49:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:43.171 16:49:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:43.171 16:49:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:43.171 16:49:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:43.171 16:49:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:45.081 16:49:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:45.081 00:07:45.081 real 0m41.629s 00:07:45.081 user 2m23.850s 00:07:45.081 sys 0m6.041s 00:07:45.081 16:49:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:45.081 16:49:56 -- common/autotest_common.sh@10 -- # set +x 00:07:45.081 ************************************ 00:07:45.081 END TEST nvmf_filesystem 00:07:45.081 ************************************ 00:07:45.081 16:49:56 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:45.081 16:49:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:45.081 16:49:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:45.081 16:49:56 -- common/autotest_common.sh@10 -- # set +x 00:07:45.081 ************************************ 00:07:45.081 START TEST nvmf_discovery 00:07:45.081 ************************************ 00:07:45.081 16:49:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:45.081 * Looking for test storage... 00:07:45.081 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:45.081 16:49:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:45.081 16:49:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:45.081 16:49:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:45.341 16:49:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:45.341 16:49:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:45.341 16:49:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:45.341 16:49:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:45.341 16:49:56 -- scripts/common.sh@335 -- # IFS=.-: 00:07:45.341 16:49:56 -- scripts/common.sh@335 -- # read -ra ver1 00:07:45.341 16:49:56 -- scripts/common.sh@336 -- # IFS=.-: 00:07:45.341 16:49:56 -- scripts/common.sh@336 -- # read -ra ver2 00:07:45.341 16:49:56 -- scripts/common.sh@337 -- # local 'op=<' 00:07:45.341 16:49:56 -- scripts/common.sh@339 -- # ver1_l=2 00:07:45.341 16:49:56 -- scripts/common.sh@340 -- # ver2_l=1 00:07:45.341 16:49:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:45.341 16:49:56 -- scripts/common.sh@343 -- # case "$op" in 00:07:45.341 16:49:56 -- scripts/common.sh@344 -- # : 1 00:07:45.341 16:49:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:45.341 16:49:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:45.341 16:49:56 -- scripts/common.sh@364 -- # decimal 1 00:07:45.341 16:49:56 -- scripts/common.sh@352 -- # local d=1 00:07:45.341 16:49:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:45.341 16:49:56 -- scripts/common.sh@354 -- # echo 1 00:07:45.341 16:49:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:45.341 16:49:56 -- scripts/common.sh@365 -- # decimal 2 00:07:45.341 16:49:56 -- scripts/common.sh@352 -- # local d=2 00:07:45.341 16:49:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:45.341 16:49:56 -- scripts/common.sh@354 -- # echo 2 00:07:45.341 16:49:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:45.341 16:49:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:45.341 16:49:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:45.342 16:49:56 -- scripts/common.sh@367 -- # return 0 00:07:45.342 16:49:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:45.342 16:49:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:45.342 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.342 --rc genhtml_branch_coverage=1 00:07:45.342 --rc genhtml_function_coverage=1 00:07:45.342 --rc genhtml_legend=1 00:07:45.342 --rc geninfo_all_blocks=1 00:07:45.342 --rc geninfo_unexecuted_blocks=1 00:07:45.342 00:07:45.342 ' 00:07:45.342 16:49:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:45.342 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.342 --rc genhtml_branch_coverage=1 00:07:45.342 --rc genhtml_function_coverage=1 00:07:45.342 --rc genhtml_legend=1 00:07:45.342 --rc geninfo_all_blocks=1 00:07:45.342 --rc geninfo_unexecuted_blocks=1 00:07:45.342 00:07:45.342 ' 00:07:45.342 16:49:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:45.342 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.342 --rc genhtml_branch_coverage=1 00:07:45.342 --rc genhtml_function_coverage=1 00:07:45.342 --rc genhtml_legend=1 00:07:45.342 --rc geninfo_all_blocks=1 00:07:45.342 --rc geninfo_unexecuted_blocks=1 00:07:45.342 00:07:45.342 ' 00:07:45.342 16:49:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:45.342 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.342 --rc genhtml_branch_coverage=1 00:07:45.342 --rc genhtml_function_coverage=1 00:07:45.342 --rc genhtml_legend=1 00:07:45.342 --rc geninfo_all_blocks=1 00:07:45.342 --rc geninfo_unexecuted_blocks=1 00:07:45.342 00:07:45.342 ' 00:07:45.342 16:49:56 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:45.342 16:49:56 -- nvmf/common.sh@7 -- # uname -s 00:07:45.342 16:49:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:45.342 16:49:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:45.342 16:49:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:45.342 16:49:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:45.342 16:49:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:45.342 16:49:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:45.342 16:49:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:45.342 16:49:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:45.342 16:49:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:45.342 16:49:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:45.342 16:49:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:45.342 16:49:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:45.342 16:49:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:45.342 16:49:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:45.342 16:49:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:45.342 16:49:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:45.342 16:49:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:45.342 16:49:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:45.342 16:49:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:45.342 16:49:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.342 16:49:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.342 16:49:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.342 16:49:56 -- paths/export.sh@5 -- # export PATH 00:07:45.342 16:49:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.342 16:49:56 -- nvmf/common.sh@46 -- # : 0 00:07:45.342 16:49:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:45.342 16:49:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:45.342 16:49:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:45.342 16:49:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:45.342 16:49:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:45.342 16:49:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:45.342 16:49:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:45.342 16:49:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:45.342 16:49:56 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:45.342 16:49:56 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:45.342 16:49:56 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:45.342 16:49:56 -- target/discovery.sh@15 -- # hash nvme 00:07:45.342 16:49:56 -- target/discovery.sh@20 -- # nvmftestinit 00:07:45.342 16:49:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:45.342 16:49:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:45.342 16:49:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:45.342 16:49:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:45.342 16:49:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:45.342 16:49:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:45.342 16:49:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:45.342 16:49:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:45.342 16:49:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:45.342 16:49:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:45.342 16:49:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:45.342 16:49:56 -- common/autotest_common.sh@10 -- # set +x 00:07:47.879 16:49:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:47.879 16:49:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:47.879 16:49:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:47.879 16:49:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:47.879 16:49:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:47.879 16:49:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:47.879 16:49:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:47.879 16:49:58 -- nvmf/common.sh@294 -- # net_devs=() 00:07:47.879 16:49:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:47.879 16:49:58 -- nvmf/common.sh@295 -- # e810=() 00:07:47.879 16:49:58 -- nvmf/common.sh@295 -- # local -ga e810 00:07:47.879 16:49:58 -- nvmf/common.sh@296 -- # x722=() 00:07:47.879 16:49:58 -- nvmf/common.sh@296 -- # local -ga x722 00:07:47.879 16:49:58 -- nvmf/common.sh@297 -- # mlx=() 00:07:47.879 16:49:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:47.879 16:49:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:47.879 16:49:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:47.879 16:49:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:47.879 16:49:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:47.879 16:49:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:47.879 16:49:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:47.879 16:49:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:47.879 16:49:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:47.879 16:49:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:47.879 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:47.879 16:49:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:47.879 16:49:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:47.879 16:49:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:47.879 16:49:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:47.879 16:49:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:47.880 16:49:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:47.880 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:47.880 16:49:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:47.880 16:49:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:47.880 16:49:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:47.880 16:49:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:47.880 16:49:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:47.880 16:49:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:47.880 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:47.880 16:49:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:47.880 16:49:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:47.880 16:49:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:47.880 16:49:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:47.880 16:49:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:47.880 16:49:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:47.880 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:47.880 16:49:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:47.880 16:49:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:47.880 16:49:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:47.880 16:49:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:47.880 16:49:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:47.880 16:49:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:47.880 16:49:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:47.880 16:49:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:47.880 16:49:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:47.880 16:49:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:47.880 16:49:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:47.880 16:49:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:47.880 16:49:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:47.880 16:49:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:47.880 16:49:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:47.880 16:49:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:47.880 16:49:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:47.880 16:49:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:47.880 16:49:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:47.880 16:49:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:47.880 16:49:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:47.880 16:49:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:47.880 16:49:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:47.880 16:49:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:47.880 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:47.880 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.338 ms 00:07:47.880 00:07:47.880 --- 10.0.0.2 ping statistics --- 00:07:47.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.880 rtt min/avg/max/mdev = 0.338/0.338/0.338/0.000 ms 00:07:47.880 16:49:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:47.880 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:47.880 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:07:47.880 00:07:47.880 --- 10.0.0.1 ping statistics --- 00:07:47.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.880 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:07:47.880 16:49:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:47.880 16:49:58 -- nvmf/common.sh@410 -- # return 0 00:07:47.880 16:49:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:47.880 16:49:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:47.880 16:49:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:47.880 16:49:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:47.880 16:49:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:47.880 16:49:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:47.880 16:49:58 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:47.880 16:49:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:47.880 16:49:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:47.880 16:49:58 -- common/autotest_common.sh@10 -- # set +x 00:07:47.880 16:49:58 -- nvmf/common.sh@469 -- # nvmfpid=112336 00:07:47.880 16:49:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:47.880 16:49:58 -- nvmf/common.sh@470 -- # waitforlisten 112336 00:07:47.880 16:49:58 -- common/autotest_common.sh@829 -- # '[' -z 112336 ']' 00:07:47.880 16:49:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:47.880 16:49:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:47.880 16:49:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:47.880 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:47.880 16:49:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:47.880 16:49:58 -- common/autotest_common.sh@10 -- # set +x 00:07:47.880 [2024-11-29 16:49:59.036565] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:47.880 [2024-11-29 16:49:59.036654] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:47.880 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.880 [2024-11-29 16:49:59.108722] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:47.880 [2024-11-29 16:49:59.218782] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:47.880 [2024-11-29 16:49:59.218938] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:47.880 [2024-11-29 16:49:59.218979] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:47.880 [2024-11-29 16:49:59.218993] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:47.880 [2024-11-29 16:49:59.219056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.880 [2024-11-29 16:49:59.219142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:47.880 [2024-11-29 16:49:59.219145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.880 [2024-11-29 16:49:59.219080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:48.815 16:50:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:48.815 16:50:00 -- common/autotest_common.sh@862 -- # return 0 00:07:48.815 16:50:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:48.815 16:50:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:48.815 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.815 16:50:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:48.815 16:50:00 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:48.815 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.815 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.815 [2024-11-29 16:50:00.102765] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:48.815 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.815 16:50:00 -- target/discovery.sh@26 -- # seq 1 4 00:07:48.815 16:50:00 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:48.815 16:50:00 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:48.815 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.815 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.815 Null1 00:07:48.815 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.815 16:50:00 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:48.815 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.815 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.815 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.815 16:50:00 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:48.815 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.815 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.815 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.815 16:50:00 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:48.815 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.815 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.815 [2024-11-29 16:50:00.151187] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:48.815 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.815 16:50:00 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:48.815 16:50:00 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:48.815 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.815 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.815 Null2 00:07:48.815 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.815 16:50:00 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:48.815 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:48.816 16:50:00 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 Null3 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:48.816 16:50:00 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 Null4 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:48.816 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.816 16:50:00 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:48.816 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.816 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.074 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.074 16:50:00 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:49.074 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.074 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.074 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.074 16:50:00 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:49.074 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.074 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.074 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.074 16:50:00 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:49.074 00:07:49.074 Discovery Log Number of Records 6, Generation counter 6 00:07:49.074 =====Discovery Log Entry 0====== 00:07:49.074 trtype: tcp 00:07:49.074 adrfam: ipv4 00:07:49.074 subtype: current discovery subsystem 00:07:49.074 treq: not required 00:07:49.074 portid: 0 00:07:49.074 trsvcid: 4420 00:07:49.074 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:49.074 traddr: 10.0.0.2 00:07:49.074 eflags: explicit discovery connections, duplicate discovery information 00:07:49.074 sectype: none 00:07:49.074 =====Discovery Log Entry 1====== 00:07:49.074 trtype: tcp 00:07:49.075 adrfam: ipv4 00:07:49.075 subtype: nvme subsystem 00:07:49.075 treq: not required 00:07:49.075 portid: 0 00:07:49.075 trsvcid: 4420 00:07:49.075 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:49.075 traddr: 10.0.0.2 00:07:49.075 eflags: none 00:07:49.075 sectype: none 00:07:49.075 =====Discovery Log Entry 2====== 00:07:49.075 trtype: tcp 00:07:49.075 adrfam: ipv4 00:07:49.075 subtype: nvme subsystem 00:07:49.075 treq: not required 00:07:49.075 portid: 0 00:07:49.075 trsvcid: 4420 00:07:49.075 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:49.075 traddr: 10.0.0.2 00:07:49.075 eflags: none 00:07:49.075 sectype: none 00:07:49.075 =====Discovery Log Entry 3====== 00:07:49.075 trtype: tcp 00:07:49.075 adrfam: ipv4 00:07:49.075 subtype: nvme subsystem 00:07:49.075 treq: not required 00:07:49.075 portid: 0 00:07:49.075 trsvcid: 4420 00:07:49.075 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:49.075 traddr: 10.0.0.2 00:07:49.075 eflags: none 00:07:49.075 sectype: none 00:07:49.075 =====Discovery Log Entry 4====== 00:07:49.075 trtype: tcp 00:07:49.075 adrfam: ipv4 00:07:49.075 subtype: nvme subsystem 00:07:49.075 treq: not required 00:07:49.075 portid: 0 00:07:49.075 trsvcid: 4420 00:07:49.075 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:49.075 traddr: 10.0.0.2 00:07:49.075 eflags: none 00:07:49.075 sectype: none 00:07:49.075 =====Discovery Log Entry 5====== 00:07:49.075 trtype: tcp 00:07:49.075 adrfam: ipv4 00:07:49.075 subtype: discovery subsystem referral 00:07:49.075 treq: not required 00:07:49.075 portid: 0 00:07:49.075 trsvcid: 4430 00:07:49.075 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:49.075 traddr: 10.0.0.2 00:07:49.075 eflags: none 00:07:49.075 sectype: none 00:07:49.075 16:50:00 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:49.075 Perform nvmf subsystem discovery via RPC 00:07:49.075 16:50:00 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:49.075 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.075 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.075 [2024-11-29 16:50:00.456005] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:49.075 [ 00:07:49.075 { 00:07:49.075 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:49.075 "subtype": "Discovery", 00:07:49.075 "listen_addresses": [ 00:07:49.075 { 00:07:49.075 "transport": "TCP", 00:07:49.075 "trtype": "TCP", 00:07:49.075 "adrfam": "IPv4", 00:07:49.075 "traddr": "10.0.0.2", 00:07:49.075 "trsvcid": "4420" 00:07:49.075 } 00:07:49.075 ], 00:07:49.075 "allow_any_host": true, 00:07:49.075 "hosts": [] 00:07:49.075 }, 00:07:49.075 { 00:07:49.075 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:49.075 "subtype": "NVMe", 00:07:49.075 "listen_addresses": [ 00:07:49.075 { 00:07:49.075 "transport": "TCP", 00:07:49.075 "trtype": "TCP", 00:07:49.075 "adrfam": "IPv4", 00:07:49.075 "traddr": "10.0.0.2", 00:07:49.075 "trsvcid": "4420" 00:07:49.075 } 00:07:49.075 ], 00:07:49.075 "allow_any_host": true, 00:07:49.075 "hosts": [], 00:07:49.075 "serial_number": "SPDK00000000000001", 00:07:49.075 "model_number": "SPDK bdev Controller", 00:07:49.075 "max_namespaces": 32, 00:07:49.075 "min_cntlid": 1, 00:07:49.075 "max_cntlid": 65519, 00:07:49.075 "namespaces": [ 00:07:49.075 { 00:07:49.075 "nsid": 1, 00:07:49.075 "bdev_name": "Null1", 00:07:49.075 "name": "Null1", 00:07:49.075 "nguid": "1CE10884EC4B41268718A55E9A4F52AA", 00:07:49.075 "uuid": "1ce10884-ec4b-4126-8718-a55e9a4f52aa" 00:07:49.075 } 00:07:49.075 ] 00:07:49.075 }, 00:07:49.075 { 00:07:49.075 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:49.075 "subtype": "NVMe", 00:07:49.075 "listen_addresses": [ 00:07:49.075 { 00:07:49.075 "transport": "TCP", 00:07:49.075 "trtype": "TCP", 00:07:49.075 "adrfam": "IPv4", 00:07:49.075 "traddr": "10.0.0.2", 00:07:49.075 "trsvcid": "4420" 00:07:49.075 } 00:07:49.075 ], 00:07:49.075 "allow_any_host": true, 00:07:49.075 "hosts": [], 00:07:49.075 "serial_number": "SPDK00000000000002", 00:07:49.075 "model_number": "SPDK bdev Controller", 00:07:49.075 "max_namespaces": 32, 00:07:49.075 "min_cntlid": 1, 00:07:49.075 "max_cntlid": 65519, 00:07:49.075 "namespaces": [ 00:07:49.075 { 00:07:49.075 "nsid": 1, 00:07:49.075 "bdev_name": "Null2", 00:07:49.075 "name": "Null2", 00:07:49.075 "nguid": "EBE59BD2C9F847E8B2C6F6DBEBF68081", 00:07:49.075 "uuid": "ebe59bd2-c9f8-47e8-b2c6-f6dbebf68081" 00:07:49.075 } 00:07:49.075 ] 00:07:49.075 }, 00:07:49.075 { 00:07:49.075 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:49.075 "subtype": "NVMe", 00:07:49.075 "listen_addresses": [ 00:07:49.075 { 00:07:49.075 "transport": "TCP", 00:07:49.075 "trtype": "TCP", 00:07:49.075 "adrfam": "IPv4", 00:07:49.075 "traddr": "10.0.0.2", 00:07:49.075 "trsvcid": "4420" 00:07:49.075 } 00:07:49.075 ], 00:07:49.075 "allow_any_host": true, 00:07:49.075 "hosts": [], 00:07:49.075 "serial_number": "SPDK00000000000003", 00:07:49.075 "model_number": "SPDK bdev Controller", 00:07:49.075 "max_namespaces": 32, 00:07:49.075 "min_cntlid": 1, 00:07:49.075 "max_cntlid": 65519, 00:07:49.075 "namespaces": [ 00:07:49.075 { 00:07:49.075 "nsid": 1, 00:07:49.075 "bdev_name": "Null3", 00:07:49.075 "name": "Null3", 00:07:49.075 "nguid": "ACF34F7D432B43AE9D1921BF7B81B0F8", 00:07:49.075 "uuid": "acf34f7d-432b-43ae-9d19-21bf7b81b0f8" 00:07:49.075 } 00:07:49.075 ] 00:07:49.075 }, 00:07:49.075 { 00:07:49.075 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:49.075 "subtype": "NVMe", 00:07:49.075 "listen_addresses": [ 00:07:49.075 { 00:07:49.075 "transport": "TCP", 00:07:49.075 "trtype": "TCP", 00:07:49.075 "adrfam": "IPv4", 00:07:49.075 "traddr": "10.0.0.2", 00:07:49.075 "trsvcid": "4420" 00:07:49.075 } 00:07:49.075 ], 00:07:49.075 "allow_any_host": true, 00:07:49.075 "hosts": [], 00:07:49.075 "serial_number": "SPDK00000000000004", 00:07:49.075 "model_number": "SPDK bdev Controller", 00:07:49.075 "max_namespaces": 32, 00:07:49.075 "min_cntlid": 1, 00:07:49.075 "max_cntlid": 65519, 00:07:49.075 "namespaces": [ 00:07:49.075 { 00:07:49.076 "nsid": 1, 00:07:49.076 "bdev_name": "Null4", 00:07:49.076 "name": "Null4", 00:07:49.076 "nguid": "83A4DD7B8FDA45E597043A440D3632A4", 00:07:49.076 "uuid": "83a4dd7b-8fda-45e5-9704-3a440d3632a4" 00:07:49.076 } 00:07:49.076 ] 00:07:49.076 } 00:07:49.076 ] 00:07:49.076 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.076 16:50:00 -- target/discovery.sh@42 -- # seq 1 4 00:07:49.076 16:50:00 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:49.076 16:50:00 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:49.076 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.076 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.076 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.076 16:50:00 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:49.076 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.076 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.076 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.076 16:50:00 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:49.076 16:50:00 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:49.076 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.076 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.076 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.076 16:50:00 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:49.076 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.076 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.076 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.076 16:50:00 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:49.076 16:50:00 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:49.076 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.076 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.334 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.334 16:50:00 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:49.334 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.334 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.334 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.334 16:50:00 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:49.334 16:50:00 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:49.334 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.334 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.334 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.334 16:50:00 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:49.334 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.334 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.334 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.334 16:50:00 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:49.334 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.334 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.334 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.334 16:50:00 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:49.334 16:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.334 16:50:00 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:49.334 16:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:49.334 16:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.334 16:50:00 -- target/discovery.sh@49 -- # check_bdevs= 00:07:49.334 16:50:00 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:49.334 16:50:00 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:49.334 16:50:00 -- target/discovery.sh@57 -- # nvmftestfini 00:07:49.334 16:50:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:49.334 16:50:00 -- nvmf/common.sh@116 -- # sync 00:07:49.334 16:50:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:49.334 16:50:00 -- nvmf/common.sh@119 -- # set +e 00:07:49.334 16:50:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:49.334 16:50:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:49.334 rmmod nvme_tcp 00:07:49.334 rmmod nvme_fabrics 00:07:49.334 rmmod nvme_keyring 00:07:49.334 16:50:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:49.334 16:50:00 -- nvmf/common.sh@123 -- # set -e 00:07:49.334 16:50:00 -- nvmf/common.sh@124 -- # return 0 00:07:49.334 16:50:00 -- nvmf/common.sh@477 -- # '[' -n 112336 ']' 00:07:49.334 16:50:00 -- nvmf/common.sh@478 -- # killprocess 112336 00:07:49.334 16:50:00 -- common/autotest_common.sh@936 -- # '[' -z 112336 ']' 00:07:49.334 16:50:00 -- common/autotest_common.sh@940 -- # kill -0 112336 00:07:49.334 16:50:00 -- common/autotest_common.sh@941 -- # uname 00:07:49.334 16:50:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:49.334 16:50:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 112336 00:07:49.334 16:50:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:49.334 16:50:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:49.334 16:50:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 112336' 00:07:49.334 killing process with pid 112336 00:07:49.334 16:50:00 -- common/autotest_common.sh@955 -- # kill 112336 00:07:49.334 [2024-11-29 16:50:00.666809] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:49.334 16:50:00 -- common/autotest_common.sh@960 -- # wait 112336 00:07:49.595 16:50:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:49.595 16:50:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:49.595 16:50:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:49.595 16:50:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:49.595 16:50:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:49.595 16:50:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:49.595 16:50:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:49.595 16:50:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:52.137 16:50:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:52.137 00:07:52.137 real 0m6.559s 00:07:52.137 user 0m7.898s 00:07:52.137 sys 0m1.992s 00:07:52.137 16:50:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:52.137 16:50:02 -- common/autotest_common.sh@10 -- # set +x 00:07:52.137 ************************************ 00:07:52.137 END TEST nvmf_discovery 00:07:52.137 ************************************ 00:07:52.137 16:50:02 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:52.137 16:50:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:52.137 16:50:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:52.137 16:50:02 -- common/autotest_common.sh@10 -- # set +x 00:07:52.137 ************************************ 00:07:52.137 START TEST nvmf_referrals 00:07:52.137 ************************************ 00:07:52.137 16:50:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:52.137 * Looking for test storage... 00:07:52.137 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:52.137 16:50:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:52.137 16:50:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:52.137 16:50:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:52.137 16:50:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:52.137 16:50:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:52.137 16:50:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:52.137 16:50:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:52.137 16:50:03 -- scripts/common.sh@335 -- # IFS=.-: 00:07:52.137 16:50:03 -- scripts/common.sh@335 -- # read -ra ver1 00:07:52.137 16:50:03 -- scripts/common.sh@336 -- # IFS=.-: 00:07:52.137 16:50:03 -- scripts/common.sh@336 -- # read -ra ver2 00:07:52.137 16:50:03 -- scripts/common.sh@337 -- # local 'op=<' 00:07:52.137 16:50:03 -- scripts/common.sh@339 -- # ver1_l=2 00:07:52.137 16:50:03 -- scripts/common.sh@340 -- # ver2_l=1 00:07:52.137 16:50:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:52.137 16:50:03 -- scripts/common.sh@343 -- # case "$op" in 00:07:52.137 16:50:03 -- scripts/common.sh@344 -- # : 1 00:07:52.137 16:50:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:52.137 16:50:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:52.137 16:50:03 -- scripts/common.sh@364 -- # decimal 1 00:07:52.137 16:50:03 -- scripts/common.sh@352 -- # local d=1 00:07:52.137 16:50:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:52.137 16:50:03 -- scripts/common.sh@354 -- # echo 1 00:07:52.137 16:50:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:52.137 16:50:03 -- scripts/common.sh@365 -- # decimal 2 00:07:52.137 16:50:03 -- scripts/common.sh@352 -- # local d=2 00:07:52.137 16:50:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:52.137 16:50:03 -- scripts/common.sh@354 -- # echo 2 00:07:52.137 16:50:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:52.137 16:50:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:52.137 16:50:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:52.137 16:50:03 -- scripts/common.sh@367 -- # return 0 00:07:52.137 16:50:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:52.138 16:50:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:52.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.138 --rc genhtml_branch_coverage=1 00:07:52.138 --rc genhtml_function_coverage=1 00:07:52.138 --rc genhtml_legend=1 00:07:52.138 --rc geninfo_all_blocks=1 00:07:52.138 --rc geninfo_unexecuted_blocks=1 00:07:52.138 00:07:52.138 ' 00:07:52.138 16:50:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:52.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.138 --rc genhtml_branch_coverage=1 00:07:52.138 --rc genhtml_function_coverage=1 00:07:52.138 --rc genhtml_legend=1 00:07:52.138 --rc geninfo_all_blocks=1 00:07:52.138 --rc geninfo_unexecuted_blocks=1 00:07:52.138 00:07:52.138 ' 00:07:52.138 16:50:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:52.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.138 --rc genhtml_branch_coverage=1 00:07:52.138 --rc genhtml_function_coverage=1 00:07:52.138 --rc genhtml_legend=1 00:07:52.138 --rc geninfo_all_blocks=1 00:07:52.138 --rc geninfo_unexecuted_blocks=1 00:07:52.138 00:07:52.138 ' 00:07:52.138 16:50:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:52.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.138 --rc genhtml_branch_coverage=1 00:07:52.138 --rc genhtml_function_coverage=1 00:07:52.138 --rc genhtml_legend=1 00:07:52.138 --rc geninfo_all_blocks=1 00:07:52.138 --rc geninfo_unexecuted_blocks=1 00:07:52.138 00:07:52.138 ' 00:07:52.138 16:50:03 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:52.138 16:50:03 -- nvmf/common.sh@7 -- # uname -s 00:07:52.138 16:50:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:52.138 16:50:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:52.138 16:50:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:52.138 16:50:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:52.138 16:50:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:52.138 16:50:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:52.138 16:50:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:52.138 16:50:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:52.138 16:50:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:52.138 16:50:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:52.138 16:50:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:52.138 16:50:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:52.138 16:50:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:52.138 16:50:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:52.138 16:50:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:52.138 16:50:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:52.138 16:50:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:52.138 16:50:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:52.138 16:50:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:52.138 16:50:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.138 16:50:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.138 16:50:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.138 16:50:03 -- paths/export.sh@5 -- # export PATH 00:07:52.138 16:50:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.138 16:50:03 -- nvmf/common.sh@46 -- # : 0 00:07:52.138 16:50:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:52.138 16:50:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:52.138 16:50:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:52.138 16:50:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:52.138 16:50:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:52.138 16:50:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:52.138 16:50:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:52.138 16:50:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:52.138 16:50:03 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:52.138 16:50:03 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:52.138 16:50:03 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:52.138 16:50:03 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:52.138 16:50:03 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:52.138 16:50:03 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:52.138 16:50:03 -- target/referrals.sh@37 -- # nvmftestinit 00:07:52.138 16:50:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:52.138 16:50:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:52.138 16:50:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:52.138 16:50:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:52.138 16:50:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:52.138 16:50:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.138 16:50:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.138 16:50:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:52.138 16:50:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:52.138 16:50:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:52.138 16:50:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:52.138 16:50:03 -- common/autotest_common.sh@10 -- # set +x 00:07:54.044 16:50:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:54.044 16:50:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:54.044 16:50:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:54.044 16:50:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:54.044 16:50:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:54.044 16:50:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:54.044 16:50:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:54.044 16:50:05 -- nvmf/common.sh@294 -- # net_devs=() 00:07:54.044 16:50:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:54.044 16:50:05 -- nvmf/common.sh@295 -- # e810=() 00:07:54.044 16:50:05 -- nvmf/common.sh@295 -- # local -ga e810 00:07:54.044 16:50:05 -- nvmf/common.sh@296 -- # x722=() 00:07:54.044 16:50:05 -- nvmf/common.sh@296 -- # local -ga x722 00:07:54.044 16:50:05 -- nvmf/common.sh@297 -- # mlx=() 00:07:54.044 16:50:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:54.044 16:50:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:54.044 16:50:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:54.044 16:50:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:54.044 16:50:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:54.044 16:50:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.044 16:50:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:54.044 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:54.044 16:50:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.044 16:50:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:54.044 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:54.044 16:50:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:54.044 16:50:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:54.044 16:50:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.044 16:50:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.044 16:50:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.044 16:50:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.044 16:50:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:54.045 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:54.045 16:50:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.045 16:50:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.045 16:50:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.045 16:50:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.045 16:50:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.045 16:50:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:54.045 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:54.045 16:50:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.045 16:50:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:54.045 16:50:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:54.045 16:50:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:54.045 16:50:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:54.045 16:50:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:54.045 16:50:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:54.045 16:50:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:54.045 16:50:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:54.045 16:50:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:54.045 16:50:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:54.045 16:50:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:54.045 16:50:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:54.045 16:50:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:54.045 16:50:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:54.045 16:50:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:54.045 16:50:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:54.045 16:50:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:54.045 16:50:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:54.045 16:50:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:54.045 16:50:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:54.045 16:50:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:54.045 16:50:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:54.045 16:50:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:54.045 16:50:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:54.045 16:50:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:54.045 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:54.045 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:07:54.045 00:07:54.045 --- 10.0.0.2 ping statistics --- 00:07:54.045 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.045 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:07:54.045 16:50:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:54.045 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:54.045 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:07:54.045 00:07:54.045 --- 10.0.0.1 ping statistics --- 00:07:54.045 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.045 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:07:54.045 16:50:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:54.045 16:50:05 -- nvmf/common.sh@410 -- # return 0 00:07:54.045 16:50:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:54.045 16:50:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:54.045 16:50:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:54.045 16:50:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:54.045 16:50:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:54.045 16:50:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:54.045 16:50:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:54.045 16:50:05 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:54.045 16:50:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:54.045 16:50:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:54.045 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:07:54.045 16:50:05 -- nvmf/common.sh@469 -- # nvmfpid=114465 00:07:54.045 16:50:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:54.045 16:50:05 -- nvmf/common.sh@470 -- # waitforlisten 114465 00:07:54.045 16:50:05 -- common/autotest_common.sh@829 -- # '[' -z 114465 ']' 00:07:54.045 16:50:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:54.045 16:50:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:54.045 16:50:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:54.045 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:54.045 16:50:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:54.045 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:07:54.303 [2024-11-29 16:50:05.481476] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:54.303 [2024-11-29 16:50:05.481544] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:54.303 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.303 [2024-11-29 16:50:05.544316] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:54.303 [2024-11-29 16:50:05.652180] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:54.303 [2024-11-29 16:50:05.652347] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:54.303 [2024-11-29 16:50:05.652365] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:54.303 [2024-11-29 16:50:05.652378] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:54.303 [2024-11-29 16:50:05.652431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:54.303 [2024-11-29 16:50:05.652479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:54.303 [2024-11-29 16:50:05.652526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:54.303 [2024-11-29 16:50:05.652528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:55.235 16:50:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:55.236 16:50:06 -- common/autotest_common.sh@862 -- # return 0 00:07:55.236 16:50:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:55.236 16:50:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:55.236 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.236 16:50:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:55.236 16:50:06 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:55.236 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.236 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.236 [2024-11-29 16:50:06.534795] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:55.236 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.236 16:50:06 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:55.236 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.236 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.236 [2024-11-29 16:50:06.547058] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:55.236 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.236 16:50:06 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:55.236 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.236 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.236 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.236 16:50:06 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:55.236 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.236 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.236 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.236 16:50:06 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:55.236 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.236 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.236 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.236 16:50:06 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:55.236 16:50:06 -- target/referrals.sh@48 -- # jq length 00:07:55.236 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.236 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.236 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.236 16:50:06 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:55.236 16:50:06 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:55.236 16:50:06 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:55.236 16:50:06 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:55.236 16:50:06 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:55.236 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.236 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.236 16:50:06 -- target/referrals.sh@21 -- # sort 00:07:55.236 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.236 16:50:06 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:55.236 16:50:06 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:55.236 16:50:06 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:55.236 16:50:06 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:55.236 16:50:06 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:55.236 16:50:06 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:55.236 16:50:06 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:55.236 16:50:06 -- target/referrals.sh@26 -- # sort 00:07:55.492 16:50:06 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:55.492 16:50:06 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:55.492 16:50:06 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:55.492 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.492 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.492 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.492 16:50:06 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:55.492 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.492 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.492 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.492 16:50:06 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:55.492 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.492 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.492 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.492 16:50:06 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:55.492 16:50:06 -- target/referrals.sh@56 -- # jq length 00:07:55.492 16:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.492 16:50:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.492 16:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.492 16:50:06 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:55.750 16:50:06 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:55.750 16:50:06 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:55.750 16:50:06 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:55.750 16:50:06 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:55.750 16:50:06 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:55.750 16:50:06 -- target/referrals.sh@26 -- # sort 00:07:55.750 16:50:07 -- target/referrals.sh@26 -- # echo 00:07:55.750 16:50:07 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:55.750 16:50:07 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:55.750 16:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.750 16:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:55.750 16:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.750 16:50:07 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:55.750 16:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.750 16:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:55.750 16:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.750 16:50:07 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:55.750 16:50:07 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:55.750 16:50:07 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:55.750 16:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.750 16:50:07 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:55.750 16:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:55.750 16:50:07 -- target/referrals.sh@21 -- # sort 00:07:55.750 16:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.008 16:50:07 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:56.008 16:50:07 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:56.008 16:50:07 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:56.008 16:50:07 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:56.008 16:50:07 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:56.008 16:50:07 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:56.008 16:50:07 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:56.008 16:50:07 -- target/referrals.sh@26 -- # sort 00:07:56.008 16:50:07 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:56.008 16:50:07 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:56.008 16:50:07 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:56.008 16:50:07 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:56.008 16:50:07 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:56.008 16:50:07 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:56.008 16:50:07 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:56.267 16:50:07 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:56.267 16:50:07 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:56.267 16:50:07 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:56.267 16:50:07 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:56.267 16:50:07 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:56.267 16:50:07 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:56.525 16:50:07 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:56.525 16:50:07 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:56.525 16:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.525 16:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:56.525 16:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.525 16:50:07 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:56.525 16:50:07 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:56.525 16:50:07 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:56.525 16:50:07 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:56.525 16:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.525 16:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:56.525 16:50:07 -- target/referrals.sh@21 -- # sort 00:07:56.525 16:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.525 16:50:07 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:56.525 16:50:07 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:56.525 16:50:07 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:56.525 16:50:07 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:56.525 16:50:07 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:56.525 16:50:07 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:56.525 16:50:07 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:56.525 16:50:07 -- target/referrals.sh@26 -- # sort 00:07:56.783 16:50:07 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:56.783 16:50:07 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:56.783 16:50:07 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:56.783 16:50:07 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:56.783 16:50:07 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:56.783 16:50:07 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:56.783 16:50:07 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:56.783 16:50:08 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:56.783 16:50:08 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:56.783 16:50:08 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:56.783 16:50:08 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:56.783 16:50:08 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:56.783 16:50:08 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:57.041 16:50:08 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:57.041 16:50:08 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:57.041 16:50:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.041 16:50:08 -- common/autotest_common.sh@10 -- # set +x 00:07:57.041 16:50:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.041 16:50:08 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:57.041 16:50:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.041 16:50:08 -- target/referrals.sh@82 -- # jq length 00:07:57.041 16:50:08 -- common/autotest_common.sh@10 -- # set +x 00:07:57.041 16:50:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.041 16:50:08 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:57.041 16:50:08 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:57.041 16:50:08 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:57.041 16:50:08 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:57.041 16:50:08 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:57.041 16:50:08 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:57.041 16:50:08 -- target/referrals.sh@26 -- # sort 00:07:57.299 16:50:08 -- target/referrals.sh@26 -- # echo 00:07:57.299 16:50:08 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:57.299 16:50:08 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:57.299 16:50:08 -- target/referrals.sh@86 -- # nvmftestfini 00:07:57.299 16:50:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:57.299 16:50:08 -- nvmf/common.sh@116 -- # sync 00:07:57.299 16:50:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:57.299 16:50:08 -- nvmf/common.sh@119 -- # set +e 00:07:57.299 16:50:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:57.299 16:50:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:57.299 rmmod nvme_tcp 00:07:57.299 rmmod nvme_fabrics 00:07:57.299 rmmod nvme_keyring 00:07:57.299 16:50:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:57.299 16:50:08 -- nvmf/common.sh@123 -- # set -e 00:07:57.299 16:50:08 -- nvmf/common.sh@124 -- # return 0 00:07:57.299 16:50:08 -- nvmf/common.sh@477 -- # '[' -n 114465 ']' 00:07:57.299 16:50:08 -- nvmf/common.sh@478 -- # killprocess 114465 00:07:57.299 16:50:08 -- common/autotest_common.sh@936 -- # '[' -z 114465 ']' 00:07:57.299 16:50:08 -- common/autotest_common.sh@940 -- # kill -0 114465 00:07:57.299 16:50:08 -- common/autotest_common.sh@941 -- # uname 00:07:57.299 16:50:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:57.299 16:50:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 114465 00:07:57.299 16:50:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:57.299 16:50:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:57.299 16:50:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 114465' 00:07:57.299 killing process with pid 114465 00:07:57.299 16:50:08 -- common/autotest_common.sh@955 -- # kill 114465 00:07:57.299 16:50:08 -- common/autotest_common.sh@960 -- # wait 114465 00:07:57.559 16:50:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:57.559 16:50:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:57.559 16:50:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:57.559 16:50:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:57.559 16:50:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:57.559 16:50:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:57.559 16:50:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:57.559 16:50:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:00.102 16:50:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:00.102 00:08:00.102 real 0m8.030s 00:08:00.102 user 0m14.910s 00:08:00.102 sys 0m2.322s 00:08:00.102 16:50:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:00.102 16:50:11 -- common/autotest_common.sh@10 -- # set +x 00:08:00.102 ************************************ 00:08:00.102 END TEST nvmf_referrals 00:08:00.102 ************************************ 00:08:00.102 16:50:11 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:00.102 16:50:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:00.102 16:50:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:00.102 16:50:11 -- common/autotest_common.sh@10 -- # set +x 00:08:00.102 ************************************ 00:08:00.102 START TEST nvmf_connect_disconnect 00:08:00.102 ************************************ 00:08:00.102 16:50:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:00.102 * Looking for test storage... 00:08:00.102 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:00.102 16:50:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:00.102 16:50:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:00.102 16:50:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:00.102 16:50:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:00.102 16:50:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:00.102 16:50:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:00.102 16:50:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:00.102 16:50:11 -- scripts/common.sh@335 -- # IFS=.-: 00:08:00.102 16:50:11 -- scripts/common.sh@335 -- # read -ra ver1 00:08:00.102 16:50:11 -- scripts/common.sh@336 -- # IFS=.-: 00:08:00.102 16:50:11 -- scripts/common.sh@336 -- # read -ra ver2 00:08:00.102 16:50:11 -- scripts/common.sh@337 -- # local 'op=<' 00:08:00.102 16:50:11 -- scripts/common.sh@339 -- # ver1_l=2 00:08:00.102 16:50:11 -- scripts/common.sh@340 -- # ver2_l=1 00:08:00.102 16:50:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:00.102 16:50:11 -- scripts/common.sh@343 -- # case "$op" in 00:08:00.102 16:50:11 -- scripts/common.sh@344 -- # : 1 00:08:00.102 16:50:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:00.102 16:50:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:00.102 16:50:11 -- scripts/common.sh@364 -- # decimal 1 00:08:00.102 16:50:11 -- scripts/common.sh@352 -- # local d=1 00:08:00.102 16:50:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:00.102 16:50:11 -- scripts/common.sh@354 -- # echo 1 00:08:00.102 16:50:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:00.102 16:50:11 -- scripts/common.sh@365 -- # decimal 2 00:08:00.102 16:50:11 -- scripts/common.sh@352 -- # local d=2 00:08:00.102 16:50:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:00.102 16:50:11 -- scripts/common.sh@354 -- # echo 2 00:08:00.102 16:50:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:00.102 16:50:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:00.102 16:50:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:00.102 16:50:11 -- scripts/common.sh@367 -- # return 0 00:08:00.102 16:50:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:00.102 16:50:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:00.102 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.102 --rc genhtml_branch_coverage=1 00:08:00.102 --rc genhtml_function_coverage=1 00:08:00.102 --rc genhtml_legend=1 00:08:00.102 --rc geninfo_all_blocks=1 00:08:00.102 --rc geninfo_unexecuted_blocks=1 00:08:00.102 00:08:00.102 ' 00:08:00.102 16:50:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:00.102 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.102 --rc genhtml_branch_coverage=1 00:08:00.102 --rc genhtml_function_coverage=1 00:08:00.102 --rc genhtml_legend=1 00:08:00.102 --rc geninfo_all_blocks=1 00:08:00.102 --rc geninfo_unexecuted_blocks=1 00:08:00.102 00:08:00.102 ' 00:08:00.102 16:50:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:00.102 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.102 --rc genhtml_branch_coverage=1 00:08:00.102 --rc genhtml_function_coverage=1 00:08:00.102 --rc genhtml_legend=1 00:08:00.103 --rc geninfo_all_blocks=1 00:08:00.103 --rc geninfo_unexecuted_blocks=1 00:08:00.103 00:08:00.103 ' 00:08:00.103 16:50:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:00.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.103 --rc genhtml_branch_coverage=1 00:08:00.103 --rc genhtml_function_coverage=1 00:08:00.103 --rc genhtml_legend=1 00:08:00.103 --rc geninfo_all_blocks=1 00:08:00.103 --rc geninfo_unexecuted_blocks=1 00:08:00.103 00:08:00.103 ' 00:08:00.103 16:50:11 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:00.103 16:50:11 -- nvmf/common.sh@7 -- # uname -s 00:08:00.103 16:50:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:00.103 16:50:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:00.103 16:50:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:00.103 16:50:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:00.103 16:50:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:00.103 16:50:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:00.103 16:50:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:00.103 16:50:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:00.103 16:50:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:00.103 16:50:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:00.103 16:50:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:00.103 16:50:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:00.103 16:50:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:00.103 16:50:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:00.103 16:50:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:00.103 16:50:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:00.103 16:50:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:00.103 16:50:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:00.103 16:50:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:00.103 16:50:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.103 16:50:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.103 16:50:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.103 16:50:11 -- paths/export.sh@5 -- # export PATH 00:08:00.103 16:50:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.103 16:50:11 -- nvmf/common.sh@46 -- # : 0 00:08:00.103 16:50:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:00.103 16:50:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:00.103 16:50:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:00.103 16:50:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:00.103 16:50:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:00.103 16:50:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:00.103 16:50:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:00.103 16:50:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:00.103 16:50:11 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:00.103 16:50:11 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:00.103 16:50:11 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:00.103 16:50:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:00.103 16:50:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:00.103 16:50:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:00.103 16:50:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:00.103 16:50:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:00.103 16:50:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:00.103 16:50:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:00.103 16:50:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:00.103 16:50:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:00.103 16:50:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:00.103 16:50:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:00.103 16:50:11 -- common/autotest_common.sh@10 -- # set +x 00:08:02.008 16:50:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:02.008 16:50:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:02.008 16:50:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:02.008 16:50:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:02.008 16:50:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:02.008 16:50:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:02.008 16:50:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:02.008 16:50:13 -- nvmf/common.sh@294 -- # net_devs=() 00:08:02.008 16:50:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:02.008 16:50:13 -- nvmf/common.sh@295 -- # e810=() 00:08:02.008 16:50:13 -- nvmf/common.sh@295 -- # local -ga e810 00:08:02.008 16:50:13 -- nvmf/common.sh@296 -- # x722=() 00:08:02.008 16:50:13 -- nvmf/common.sh@296 -- # local -ga x722 00:08:02.008 16:50:13 -- nvmf/common.sh@297 -- # mlx=() 00:08:02.008 16:50:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:02.008 16:50:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:02.008 16:50:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:02.008 16:50:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:02.008 16:50:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:02.008 16:50:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:02.008 16:50:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:02.008 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:02.008 16:50:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:02.008 16:50:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:02.008 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:02.008 16:50:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:02.008 16:50:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:02.008 16:50:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:02.008 16:50:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:02.008 16:50:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:02.008 16:50:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:02.008 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:02.008 16:50:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:02.008 16:50:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:02.008 16:50:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:02.008 16:50:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:02.008 16:50:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:02.008 16:50:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:02.008 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:02.008 16:50:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:02.008 16:50:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:02.008 16:50:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:02.008 16:50:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:02.008 16:50:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:02.008 16:50:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:02.008 16:50:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:02.008 16:50:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:02.008 16:50:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:02.008 16:50:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:02.008 16:50:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:02.008 16:50:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:02.008 16:50:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:02.008 16:50:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:02.008 16:50:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:02.008 16:50:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:02.008 16:50:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:02.008 16:50:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:02.008 16:50:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:02.008 16:50:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:02.008 16:50:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:02.008 16:50:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:02.008 16:50:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:02.008 16:50:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:02.008 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:02.008 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:08:02.008 00:08:02.008 --- 10.0.0.2 ping statistics --- 00:08:02.008 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:02.008 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:08:02.008 16:50:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:02.008 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:02.008 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:08:02.008 00:08:02.008 --- 10.0.0.1 ping statistics --- 00:08:02.008 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:02.008 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:08:02.008 16:50:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:02.008 16:50:13 -- nvmf/common.sh@410 -- # return 0 00:08:02.008 16:50:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:02.008 16:50:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:02.008 16:50:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:02.008 16:50:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:02.008 16:50:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:02.008 16:50:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:02.008 16:50:13 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:02.008 16:50:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:02.008 16:50:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:02.008 16:50:13 -- common/autotest_common.sh@10 -- # set +x 00:08:02.008 16:50:13 -- nvmf/common.sh@469 -- # nvmfpid=116921 00:08:02.009 16:50:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:02.009 16:50:13 -- nvmf/common.sh@470 -- # waitforlisten 116921 00:08:02.009 16:50:13 -- common/autotest_common.sh@829 -- # '[' -z 116921 ']' 00:08:02.009 16:50:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:02.009 16:50:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:02.009 16:50:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:02.009 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:02.009 16:50:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:02.009 16:50:13 -- common/autotest_common.sh@10 -- # set +x 00:08:02.267 [2024-11-29 16:50:13.473925] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:02.267 [2024-11-29 16:50:13.474025] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:02.267 EAL: No free 2048 kB hugepages reported on node 1 00:08:02.267 [2024-11-29 16:50:13.545816] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:02.267 [2024-11-29 16:50:13.667788] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:02.267 [2024-11-29 16:50:13.667972] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:02.267 [2024-11-29 16:50:13.668005] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:02.267 [2024-11-29 16:50:13.668019] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:02.267 [2024-11-29 16:50:13.668087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:02.267 [2024-11-29 16:50:13.668142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:02.267 [2024-11-29 16:50:13.668166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:02.267 [2024-11-29 16:50:13.668171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:03.202 16:50:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:03.202 16:50:14 -- common/autotest_common.sh@862 -- # return 0 00:08:03.202 16:50:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:03.202 16:50:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:03.202 16:50:14 -- common/autotest_common.sh@10 -- # set +x 00:08:03.202 16:50:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:03.202 16:50:14 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:03.202 16:50:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.202 16:50:14 -- common/autotest_common.sh@10 -- # set +x 00:08:03.202 [2024-11-29 16:50:14.573768] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:03.202 16:50:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:03.202 16:50:14 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:03.202 16:50:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.202 16:50:14 -- common/autotest_common.sh@10 -- # set +x 00:08:03.202 16:50:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:03.202 16:50:14 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:03.202 16:50:14 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:03.202 16:50:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.202 16:50:14 -- common/autotest_common.sh@10 -- # set +x 00:08:03.202 16:50:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:03.202 16:50:14 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:03.202 16:50:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.202 16:50:14 -- common/autotest_common.sh@10 -- # set +x 00:08:03.202 16:50:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:03.202 16:50:14 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:03.202 16:50:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.202 16:50:14 -- common/autotest_common.sh@10 -- # set +x 00:08:03.202 [2024-11-29 16:50:14.629648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:03.460 16:50:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:03.460 16:50:14 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:03.460 16:50:14 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:03.460 16:50:14 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:03.460 16:50:14 -- target/connect_disconnect.sh@34 -- # set +x 00:08:05.987 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.418 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.947 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.473 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.374 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.905 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.435 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:24.969 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.869 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:29.397 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.304 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:36.361 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.261 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.794 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:43.323 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.220 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:47.748 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.277 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.705 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.238 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.139 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.195 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.094 [2024-11-29 16:51:17.466751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bbf3e0 is same with the state(5) to be set 00:09:06.094 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.621 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.152 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.055 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.585 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.012 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.539 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.062 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.075 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.072 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.820 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.894 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.560 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.098 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.995 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.520 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.418 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.959 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.486 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.382 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.905 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.803 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.327 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.224 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.752 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.278 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.189 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.712 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.239 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.136 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.663 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.188 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.081 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.607 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.131 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.027 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.447 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.497 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.396 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.457 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.986 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.885 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.312 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.840 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.367 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.891 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.787 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.315 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.738 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.268 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.795 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.694 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.222 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.747 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.641 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.179 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.707 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.605 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.133 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.031 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.556 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.084 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.613 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.038 [2024-11-29 16:54:06.015713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bbff40 is same with the state(5) to be set 00:11:55.038 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.038 16:54:06 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:55.038 16:54:06 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:55.038 16:54:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:55.038 16:54:06 -- nvmf/common.sh@116 -- # sync 00:11:55.038 16:54:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:55.038 16:54:06 -- nvmf/common.sh@119 -- # set +e 00:11:55.038 16:54:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:55.038 16:54:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:55.038 rmmod nvme_tcp 00:11:55.038 rmmod nvme_fabrics 00:11:55.038 rmmod nvme_keyring 00:11:55.038 16:54:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:55.038 16:54:06 -- nvmf/common.sh@123 -- # set -e 00:11:55.038 16:54:06 -- nvmf/common.sh@124 -- # return 0 00:11:55.038 16:54:06 -- nvmf/common.sh@477 -- # '[' -n 116921 ']' 00:11:55.038 16:54:06 -- nvmf/common.sh@478 -- # killprocess 116921 00:11:55.038 16:54:06 -- common/autotest_common.sh@936 -- # '[' -z 116921 ']' 00:11:55.038 16:54:06 -- common/autotest_common.sh@940 -- # kill -0 116921 00:11:55.038 16:54:06 -- common/autotest_common.sh@941 -- # uname 00:11:55.038 16:54:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:55.038 16:54:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 116921 00:11:55.038 16:54:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:55.038 16:54:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:55.038 16:54:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 116921' 00:11:55.038 killing process with pid 116921 00:11:55.038 16:54:06 -- common/autotest_common.sh@955 -- # kill 116921 00:11:55.038 16:54:06 -- common/autotest_common.sh@960 -- # wait 116921 00:11:55.038 16:54:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:55.038 16:54:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:55.038 16:54:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:55.038 16:54:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:55.038 16:54:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:55.038 16:54:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:55.038 16:54:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:55.038 16:54:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:57.574 16:54:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:57.574 00:11:57.574 real 3m57.411s 00:11:57.574 user 15m6.250s 00:11:57.574 sys 0m33.839s 00:11:57.574 16:54:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:57.574 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:11:57.574 ************************************ 00:11:57.574 END TEST nvmf_connect_disconnect 00:11:57.574 ************************************ 00:11:57.574 16:54:08 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:57.574 16:54:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:57.574 16:54:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:57.574 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:11:57.574 ************************************ 00:11:57.574 START TEST nvmf_multitarget 00:11:57.574 ************************************ 00:11:57.574 16:54:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:57.574 * Looking for test storage... 00:11:57.574 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:57.574 16:54:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:57.574 16:54:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:57.574 16:54:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:57.574 16:54:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:57.574 16:54:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:57.574 16:54:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:57.574 16:54:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:57.574 16:54:08 -- scripts/common.sh@335 -- # IFS=.-: 00:11:57.574 16:54:08 -- scripts/common.sh@335 -- # read -ra ver1 00:11:57.574 16:54:08 -- scripts/common.sh@336 -- # IFS=.-: 00:11:57.574 16:54:08 -- scripts/common.sh@336 -- # read -ra ver2 00:11:57.574 16:54:08 -- scripts/common.sh@337 -- # local 'op=<' 00:11:57.574 16:54:08 -- scripts/common.sh@339 -- # ver1_l=2 00:11:57.574 16:54:08 -- scripts/common.sh@340 -- # ver2_l=1 00:11:57.574 16:54:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:57.574 16:54:08 -- scripts/common.sh@343 -- # case "$op" in 00:11:57.574 16:54:08 -- scripts/common.sh@344 -- # : 1 00:11:57.574 16:54:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:57.574 16:54:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:57.574 16:54:08 -- scripts/common.sh@364 -- # decimal 1 00:11:57.574 16:54:08 -- scripts/common.sh@352 -- # local d=1 00:11:57.574 16:54:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:57.574 16:54:08 -- scripts/common.sh@354 -- # echo 1 00:11:57.574 16:54:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:57.574 16:54:08 -- scripts/common.sh@365 -- # decimal 2 00:11:57.574 16:54:08 -- scripts/common.sh@352 -- # local d=2 00:11:57.574 16:54:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:57.574 16:54:08 -- scripts/common.sh@354 -- # echo 2 00:11:57.574 16:54:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:57.574 16:54:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:57.574 16:54:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:57.574 16:54:08 -- scripts/common.sh@367 -- # return 0 00:11:57.574 16:54:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:57.574 16:54:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:57.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:57.574 --rc genhtml_branch_coverage=1 00:11:57.574 --rc genhtml_function_coverage=1 00:11:57.574 --rc genhtml_legend=1 00:11:57.574 --rc geninfo_all_blocks=1 00:11:57.574 --rc geninfo_unexecuted_blocks=1 00:11:57.574 00:11:57.574 ' 00:11:57.574 16:54:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:57.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:57.574 --rc genhtml_branch_coverage=1 00:11:57.574 --rc genhtml_function_coverage=1 00:11:57.574 --rc genhtml_legend=1 00:11:57.574 --rc geninfo_all_blocks=1 00:11:57.574 --rc geninfo_unexecuted_blocks=1 00:11:57.574 00:11:57.574 ' 00:11:57.574 16:54:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:57.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:57.574 --rc genhtml_branch_coverage=1 00:11:57.574 --rc genhtml_function_coverage=1 00:11:57.574 --rc genhtml_legend=1 00:11:57.574 --rc geninfo_all_blocks=1 00:11:57.574 --rc geninfo_unexecuted_blocks=1 00:11:57.574 00:11:57.574 ' 00:11:57.574 16:54:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:57.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:57.574 --rc genhtml_branch_coverage=1 00:11:57.575 --rc genhtml_function_coverage=1 00:11:57.575 --rc genhtml_legend=1 00:11:57.575 --rc geninfo_all_blocks=1 00:11:57.575 --rc geninfo_unexecuted_blocks=1 00:11:57.575 00:11:57.575 ' 00:11:57.575 16:54:08 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:57.575 16:54:08 -- nvmf/common.sh@7 -- # uname -s 00:11:57.575 16:54:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:57.575 16:54:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:57.575 16:54:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:57.575 16:54:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:57.575 16:54:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:57.575 16:54:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:57.575 16:54:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:57.575 16:54:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:57.575 16:54:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:57.575 16:54:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:57.575 16:54:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:57.575 16:54:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:57.575 16:54:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:57.575 16:54:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:57.575 16:54:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:57.575 16:54:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:57.575 16:54:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:57.575 16:54:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:57.575 16:54:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:57.575 16:54:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.575 16:54:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.575 16:54:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.575 16:54:08 -- paths/export.sh@5 -- # export PATH 00:11:57.575 16:54:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.575 16:54:08 -- nvmf/common.sh@46 -- # : 0 00:11:57.575 16:54:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:57.575 16:54:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:57.575 16:54:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:57.575 16:54:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:57.575 16:54:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:57.575 16:54:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:57.575 16:54:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:57.575 16:54:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:57.575 16:54:08 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:57.575 16:54:08 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:57.575 16:54:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:57.575 16:54:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:57.575 16:54:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:57.575 16:54:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:57.575 16:54:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:57.575 16:54:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:57.575 16:54:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:57.575 16:54:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:57.575 16:54:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:57.575 16:54:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:57.575 16:54:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:57.575 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:11:59.477 16:54:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:59.477 16:54:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:59.477 16:54:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:59.477 16:54:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:59.477 16:54:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:59.477 16:54:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:59.477 16:54:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:59.477 16:54:10 -- nvmf/common.sh@294 -- # net_devs=() 00:11:59.477 16:54:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:59.477 16:54:10 -- nvmf/common.sh@295 -- # e810=() 00:11:59.477 16:54:10 -- nvmf/common.sh@295 -- # local -ga e810 00:11:59.477 16:54:10 -- nvmf/common.sh@296 -- # x722=() 00:11:59.477 16:54:10 -- nvmf/common.sh@296 -- # local -ga x722 00:11:59.477 16:54:10 -- nvmf/common.sh@297 -- # mlx=() 00:11:59.477 16:54:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:59.477 16:54:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:59.477 16:54:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:59.477 16:54:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:59.477 16:54:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:59.477 16:54:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:59.477 16:54:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:59.477 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:59.477 16:54:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:59.477 16:54:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:59.477 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:59.477 16:54:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:59.477 16:54:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:59.477 16:54:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:59.477 16:54:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:59.477 16:54:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:59.477 16:54:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:59.477 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:59.477 16:54:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:59.477 16:54:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:59.477 16:54:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:59.477 16:54:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:59.477 16:54:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:59.477 16:54:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:59.477 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:59.477 16:54:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:59.477 16:54:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:59.477 16:54:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:59.477 16:54:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:59.477 16:54:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:59.477 16:54:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:59.477 16:54:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:59.477 16:54:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:59.477 16:54:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:59.477 16:54:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:59.477 16:54:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:59.477 16:54:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:59.477 16:54:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:59.477 16:54:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:59.478 16:54:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:59.478 16:54:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:59.478 16:54:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:59.478 16:54:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:59.478 16:54:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:59.478 16:54:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:59.478 16:54:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:59.478 16:54:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:59.478 16:54:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:59.478 16:54:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:59.478 16:54:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:59.478 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:59.478 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.253 ms 00:11:59.478 00:11:59.478 --- 10.0.0.2 ping statistics --- 00:11:59.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:59.478 rtt min/avg/max/mdev = 0.253/0.253/0.253/0.000 ms 00:11:59.478 16:54:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:59.478 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:59.478 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:11:59.478 00:11:59.478 --- 10.0.0.1 ping statistics --- 00:11:59.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:59.478 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:11:59.478 16:54:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:59.478 16:54:10 -- nvmf/common.sh@410 -- # return 0 00:11:59.478 16:54:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:59.478 16:54:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:59.478 16:54:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:59.478 16:54:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:59.478 16:54:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:59.478 16:54:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:59.478 16:54:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:59.478 16:54:10 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:59.478 16:54:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:59.478 16:54:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:59.478 16:54:10 -- common/autotest_common.sh@10 -- # set +x 00:11:59.478 16:54:10 -- nvmf/common.sh@469 -- # nvmfpid=149726 00:11:59.478 16:54:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:59.478 16:54:10 -- nvmf/common.sh@470 -- # waitforlisten 149726 00:11:59.478 16:54:10 -- common/autotest_common.sh@829 -- # '[' -z 149726 ']' 00:11:59.478 16:54:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:59.478 16:54:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:59.478 16:54:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:59.478 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:59.478 16:54:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:59.478 16:54:10 -- common/autotest_common.sh@10 -- # set +x 00:11:59.478 [2024-11-29 16:54:10.875769] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:59.478 [2024-11-29 16:54:10.875848] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:59.478 EAL: No free 2048 kB hugepages reported on node 1 00:11:59.736 [2024-11-29 16:54:10.943854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:59.736 [2024-11-29 16:54:11.060072] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:59.736 [2024-11-29 16:54:11.060236] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:59.736 [2024-11-29 16:54:11.060261] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:59.736 [2024-11-29 16:54:11.060275] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:59.736 [2024-11-29 16:54:11.060334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:59.736 [2024-11-29 16:54:11.060418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:59.736 [2024-11-29 16:54:11.060503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:59.736 [2024-11-29 16:54:11.060506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:00.669 16:54:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:00.669 16:54:11 -- common/autotest_common.sh@862 -- # return 0 00:12:00.669 16:54:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:00.669 16:54:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:00.669 16:54:11 -- common/autotest_common.sh@10 -- # set +x 00:12:00.669 16:54:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:00.669 16:54:11 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:00.669 16:54:11 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:00.669 16:54:11 -- target/multitarget.sh@21 -- # jq length 00:12:00.669 16:54:11 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:00.669 16:54:11 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:00.669 "nvmf_tgt_1" 00:12:00.926 16:54:12 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:00.926 "nvmf_tgt_2" 00:12:00.926 16:54:12 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:00.926 16:54:12 -- target/multitarget.sh@28 -- # jq length 00:12:00.926 16:54:12 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:00.926 16:54:12 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:01.184 true 00:12:01.184 16:54:12 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:01.184 true 00:12:01.184 16:54:12 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:01.184 16:54:12 -- target/multitarget.sh@35 -- # jq length 00:12:01.442 16:54:12 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:01.442 16:54:12 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:01.442 16:54:12 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:01.442 16:54:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:01.442 16:54:12 -- nvmf/common.sh@116 -- # sync 00:12:01.442 16:54:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:01.442 16:54:12 -- nvmf/common.sh@119 -- # set +e 00:12:01.442 16:54:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:01.442 16:54:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:01.442 rmmod nvme_tcp 00:12:01.442 rmmod nvme_fabrics 00:12:01.442 rmmod nvme_keyring 00:12:01.442 16:54:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:01.442 16:54:12 -- nvmf/common.sh@123 -- # set -e 00:12:01.442 16:54:12 -- nvmf/common.sh@124 -- # return 0 00:12:01.442 16:54:12 -- nvmf/common.sh@477 -- # '[' -n 149726 ']' 00:12:01.442 16:54:12 -- nvmf/common.sh@478 -- # killprocess 149726 00:12:01.442 16:54:12 -- common/autotest_common.sh@936 -- # '[' -z 149726 ']' 00:12:01.442 16:54:12 -- common/autotest_common.sh@940 -- # kill -0 149726 00:12:01.442 16:54:12 -- common/autotest_common.sh@941 -- # uname 00:12:01.442 16:54:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:01.442 16:54:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 149726 00:12:01.442 16:54:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:01.442 16:54:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:01.442 16:54:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 149726' 00:12:01.442 killing process with pid 149726 00:12:01.442 16:54:12 -- common/autotest_common.sh@955 -- # kill 149726 00:12:01.442 16:54:12 -- common/autotest_common.sh@960 -- # wait 149726 00:12:01.701 16:54:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:01.701 16:54:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:01.701 16:54:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:01.701 16:54:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:01.701 16:54:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:01.701 16:54:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:01.701 16:54:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:01.701 16:54:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:04.238 16:54:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:04.238 00:12:04.238 real 0m6.614s 00:12:04.238 user 0m9.673s 00:12:04.238 sys 0m1.909s 00:12:04.238 16:54:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:04.238 16:54:15 -- common/autotest_common.sh@10 -- # set +x 00:12:04.238 ************************************ 00:12:04.238 END TEST nvmf_multitarget 00:12:04.238 ************************************ 00:12:04.238 16:54:15 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:04.238 16:54:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:04.238 16:54:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:04.238 16:54:15 -- common/autotest_common.sh@10 -- # set +x 00:12:04.239 ************************************ 00:12:04.239 START TEST nvmf_rpc 00:12:04.239 ************************************ 00:12:04.239 16:54:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:04.239 * Looking for test storage... 00:12:04.239 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:04.239 16:54:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:04.239 16:54:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:04.239 16:54:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:04.239 16:54:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:04.239 16:54:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:04.239 16:54:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:04.239 16:54:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:04.239 16:54:15 -- scripts/common.sh@335 -- # IFS=.-: 00:12:04.239 16:54:15 -- scripts/common.sh@335 -- # read -ra ver1 00:12:04.239 16:54:15 -- scripts/common.sh@336 -- # IFS=.-: 00:12:04.239 16:54:15 -- scripts/common.sh@336 -- # read -ra ver2 00:12:04.239 16:54:15 -- scripts/common.sh@337 -- # local 'op=<' 00:12:04.239 16:54:15 -- scripts/common.sh@339 -- # ver1_l=2 00:12:04.239 16:54:15 -- scripts/common.sh@340 -- # ver2_l=1 00:12:04.239 16:54:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:04.239 16:54:15 -- scripts/common.sh@343 -- # case "$op" in 00:12:04.239 16:54:15 -- scripts/common.sh@344 -- # : 1 00:12:04.239 16:54:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:04.239 16:54:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:04.239 16:54:15 -- scripts/common.sh@364 -- # decimal 1 00:12:04.239 16:54:15 -- scripts/common.sh@352 -- # local d=1 00:12:04.239 16:54:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:04.239 16:54:15 -- scripts/common.sh@354 -- # echo 1 00:12:04.239 16:54:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:04.239 16:54:15 -- scripts/common.sh@365 -- # decimal 2 00:12:04.239 16:54:15 -- scripts/common.sh@352 -- # local d=2 00:12:04.239 16:54:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:04.239 16:54:15 -- scripts/common.sh@354 -- # echo 2 00:12:04.239 16:54:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:04.239 16:54:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:04.239 16:54:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:04.239 16:54:15 -- scripts/common.sh@367 -- # return 0 00:12:04.239 16:54:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:04.239 16:54:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:04.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:04.239 --rc genhtml_branch_coverage=1 00:12:04.239 --rc genhtml_function_coverage=1 00:12:04.239 --rc genhtml_legend=1 00:12:04.239 --rc geninfo_all_blocks=1 00:12:04.239 --rc geninfo_unexecuted_blocks=1 00:12:04.239 00:12:04.239 ' 00:12:04.239 16:54:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:04.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:04.239 --rc genhtml_branch_coverage=1 00:12:04.239 --rc genhtml_function_coverage=1 00:12:04.239 --rc genhtml_legend=1 00:12:04.239 --rc geninfo_all_blocks=1 00:12:04.239 --rc geninfo_unexecuted_blocks=1 00:12:04.239 00:12:04.239 ' 00:12:04.239 16:54:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:04.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:04.239 --rc genhtml_branch_coverage=1 00:12:04.239 --rc genhtml_function_coverage=1 00:12:04.239 --rc genhtml_legend=1 00:12:04.239 --rc geninfo_all_blocks=1 00:12:04.239 --rc geninfo_unexecuted_blocks=1 00:12:04.239 00:12:04.239 ' 00:12:04.239 16:54:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:04.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:04.239 --rc genhtml_branch_coverage=1 00:12:04.239 --rc genhtml_function_coverage=1 00:12:04.239 --rc genhtml_legend=1 00:12:04.239 --rc geninfo_all_blocks=1 00:12:04.239 --rc geninfo_unexecuted_blocks=1 00:12:04.239 00:12:04.239 ' 00:12:04.239 16:54:15 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:04.239 16:54:15 -- nvmf/common.sh@7 -- # uname -s 00:12:04.239 16:54:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:04.239 16:54:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:04.239 16:54:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:04.239 16:54:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:04.239 16:54:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:04.239 16:54:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:04.239 16:54:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:04.239 16:54:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:04.239 16:54:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:04.239 16:54:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:04.239 16:54:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:04.239 16:54:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:04.239 16:54:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:04.239 16:54:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:04.239 16:54:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:04.239 16:54:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:04.239 16:54:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:04.239 16:54:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:04.239 16:54:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:04.239 16:54:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.239 16:54:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.239 16:54:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.239 16:54:15 -- paths/export.sh@5 -- # export PATH 00:12:04.239 16:54:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.239 16:54:15 -- nvmf/common.sh@46 -- # : 0 00:12:04.239 16:54:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:04.239 16:54:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:04.239 16:54:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:04.239 16:54:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:04.239 16:54:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:04.239 16:54:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:04.239 16:54:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:04.239 16:54:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:04.239 16:54:15 -- target/rpc.sh@11 -- # loops=5 00:12:04.239 16:54:15 -- target/rpc.sh@23 -- # nvmftestinit 00:12:04.239 16:54:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:04.239 16:54:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:04.239 16:54:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:04.239 16:54:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:04.239 16:54:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:04.239 16:54:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:04.239 16:54:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:04.239 16:54:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:04.239 16:54:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:04.239 16:54:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:04.239 16:54:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:04.239 16:54:15 -- common/autotest_common.sh@10 -- # set +x 00:12:06.148 16:54:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:06.148 16:54:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:06.148 16:54:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:06.148 16:54:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:06.148 16:54:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:06.148 16:54:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:06.148 16:54:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:06.148 16:54:17 -- nvmf/common.sh@294 -- # net_devs=() 00:12:06.148 16:54:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:06.148 16:54:17 -- nvmf/common.sh@295 -- # e810=() 00:12:06.148 16:54:17 -- nvmf/common.sh@295 -- # local -ga e810 00:12:06.148 16:54:17 -- nvmf/common.sh@296 -- # x722=() 00:12:06.148 16:54:17 -- nvmf/common.sh@296 -- # local -ga x722 00:12:06.148 16:54:17 -- nvmf/common.sh@297 -- # mlx=() 00:12:06.148 16:54:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:06.148 16:54:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:06.148 16:54:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:06.148 16:54:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:06.148 16:54:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:06.148 16:54:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:06.148 16:54:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:06.148 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:06.148 16:54:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:06.148 16:54:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:06.148 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:06.148 16:54:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:06.148 16:54:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:06.148 16:54:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:06.148 16:54:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:06.148 16:54:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:06.148 16:54:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:06.148 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:06.148 16:54:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:06.148 16:54:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:06.148 16:54:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:06.148 16:54:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:06.148 16:54:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:06.148 16:54:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:06.148 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:06.148 16:54:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:06.148 16:54:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:06.148 16:54:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:06.148 16:54:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:06.148 16:54:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:06.148 16:54:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:06.148 16:54:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:06.148 16:54:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:06.148 16:54:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:06.148 16:54:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:06.148 16:54:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:06.148 16:54:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:06.148 16:54:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:06.148 16:54:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:06.148 16:54:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:06.148 16:54:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:06.148 16:54:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:06.148 16:54:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:06.148 16:54:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:06.148 16:54:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:06.148 16:54:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:06.148 16:54:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:06.148 16:54:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:06.148 16:54:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:06.148 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:06.148 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:12:06.148 00:12:06.148 --- 10.0.0.2 ping statistics --- 00:12:06.148 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:06.148 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:12:06.148 16:54:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:06.148 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:06.148 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:12:06.148 00:12:06.148 --- 10.0.0.1 ping statistics --- 00:12:06.148 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:06.148 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:12:06.148 16:54:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:06.148 16:54:17 -- nvmf/common.sh@410 -- # return 0 00:12:06.148 16:54:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:06.148 16:54:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:06.148 16:54:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:06.148 16:54:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:06.148 16:54:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:06.148 16:54:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:06.148 16:54:17 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:06.148 16:54:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:06.148 16:54:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:06.148 16:54:17 -- common/autotest_common.sh@10 -- # set +x 00:12:06.148 16:54:17 -- nvmf/common.sh@469 -- # nvmfpid=151988 00:12:06.148 16:54:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:06.148 16:54:17 -- nvmf/common.sh@470 -- # waitforlisten 151988 00:12:06.148 16:54:17 -- common/autotest_common.sh@829 -- # '[' -z 151988 ']' 00:12:06.148 16:54:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:06.148 16:54:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:06.148 16:54:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:06.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:06.148 16:54:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:06.148 16:54:17 -- common/autotest_common.sh@10 -- # set +x 00:12:06.148 [2024-11-29 16:54:17.547269] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:06.148 [2024-11-29 16:54:17.547349] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:06.406 EAL: No free 2048 kB hugepages reported on node 1 00:12:06.406 [2024-11-29 16:54:17.616254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:06.406 [2024-11-29 16:54:17.734907] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:06.406 [2024-11-29 16:54:17.735077] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:06.406 [2024-11-29 16:54:17.735098] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:06.406 [2024-11-29 16:54:17.735112] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:06.406 [2024-11-29 16:54:17.735196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:06.406 [2024-11-29 16:54:17.735257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:06.406 [2024-11-29 16:54:17.735311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:06.406 [2024-11-29 16:54:17.735315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:07.340 16:54:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:07.340 16:54:18 -- common/autotest_common.sh@862 -- # return 0 00:12:07.340 16:54:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:07.340 16:54:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:07.340 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.340 16:54:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:07.340 16:54:18 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:07.340 16:54:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.340 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.340 16:54:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.340 16:54:18 -- target/rpc.sh@26 -- # stats='{ 00:12:07.340 "tick_rate": 2700000000, 00:12:07.340 "poll_groups": [ 00:12:07.340 { 00:12:07.340 "name": "nvmf_tgt_poll_group_0", 00:12:07.340 "admin_qpairs": 0, 00:12:07.340 "io_qpairs": 0, 00:12:07.340 "current_admin_qpairs": 0, 00:12:07.340 "current_io_qpairs": 0, 00:12:07.340 "pending_bdev_io": 0, 00:12:07.340 "completed_nvme_io": 0, 00:12:07.340 "transports": [] 00:12:07.340 }, 00:12:07.340 { 00:12:07.340 "name": "nvmf_tgt_poll_group_1", 00:12:07.340 "admin_qpairs": 0, 00:12:07.340 "io_qpairs": 0, 00:12:07.340 "current_admin_qpairs": 0, 00:12:07.340 "current_io_qpairs": 0, 00:12:07.340 "pending_bdev_io": 0, 00:12:07.340 "completed_nvme_io": 0, 00:12:07.340 "transports": [] 00:12:07.340 }, 00:12:07.340 { 00:12:07.340 "name": "nvmf_tgt_poll_group_2", 00:12:07.340 "admin_qpairs": 0, 00:12:07.340 "io_qpairs": 0, 00:12:07.340 "current_admin_qpairs": 0, 00:12:07.340 "current_io_qpairs": 0, 00:12:07.340 "pending_bdev_io": 0, 00:12:07.340 "completed_nvme_io": 0, 00:12:07.340 "transports": [] 00:12:07.340 }, 00:12:07.340 { 00:12:07.340 "name": "nvmf_tgt_poll_group_3", 00:12:07.340 "admin_qpairs": 0, 00:12:07.340 "io_qpairs": 0, 00:12:07.340 "current_admin_qpairs": 0, 00:12:07.340 "current_io_qpairs": 0, 00:12:07.340 "pending_bdev_io": 0, 00:12:07.340 "completed_nvme_io": 0, 00:12:07.341 "transports": [] 00:12:07.341 } 00:12:07.341 ] 00:12:07.341 }' 00:12:07.341 16:54:18 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:07.341 16:54:18 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:07.341 16:54:18 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:07.341 16:54:18 -- target/rpc.sh@15 -- # wc -l 00:12:07.341 16:54:18 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:07.341 16:54:18 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:07.341 16:54:18 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:07.341 16:54:18 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:07.341 16:54:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.341 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.341 [2024-11-29 16:54:18.629834] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:07.341 16:54:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.341 16:54:18 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:07.341 16:54:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.341 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.341 16:54:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.341 16:54:18 -- target/rpc.sh@33 -- # stats='{ 00:12:07.341 "tick_rate": 2700000000, 00:12:07.341 "poll_groups": [ 00:12:07.341 { 00:12:07.341 "name": "nvmf_tgt_poll_group_0", 00:12:07.341 "admin_qpairs": 0, 00:12:07.341 "io_qpairs": 0, 00:12:07.341 "current_admin_qpairs": 0, 00:12:07.341 "current_io_qpairs": 0, 00:12:07.341 "pending_bdev_io": 0, 00:12:07.341 "completed_nvme_io": 0, 00:12:07.341 "transports": [ 00:12:07.341 { 00:12:07.341 "trtype": "TCP" 00:12:07.341 } 00:12:07.341 ] 00:12:07.341 }, 00:12:07.341 { 00:12:07.341 "name": "nvmf_tgt_poll_group_1", 00:12:07.341 "admin_qpairs": 0, 00:12:07.341 "io_qpairs": 0, 00:12:07.341 "current_admin_qpairs": 0, 00:12:07.341 "current_io_qpairs": 0, 00:12:07.341 "pending_bdev_io": 0, 00:12:07.341 "completed_nvme_io": 0, 00:12:07.341 "transports": [ 00:12:07.341 { 00:12:07.341 "trtype": "TCP" 00:12:07.341 } 00:12:07.341 ] 00:12:07.341 }, 00:12:07.341 { 00:12:07.341 "name": "nvmf_tgt_poll_group_2", 00:12:07.341 "admin_qpairs": 0, 00:12:07.341 "io_qpairs": 0, 00:12:07.341 "current_admin_qpairs": 0, 00:12:07.341 "current_io_qpairs": 0, 00:12:07.341 "pending_bdev_io": 0, 00:12:07.341 "completed_nvme_io": 0, 00:12:07.341 "transports": [ 00:12:07.341 { 00:12:07.341 "trtype": "TCP" 00:12:07.341 } 00:12:07.341 ] 00:12:07.341 }, 00:12:07.341 { 00:12:07.341 "name": "nvmf_tgt_poll_group_3", 00:12:07.341 "admin_qpairs": 0, 00:12:07.341 "io_qpairs": 0, 00:12:07.341 "current_admin_qpairs": 0, 00:12:07.341 "current_io_qpairs": 0, 00:12:07.341 "pending_bdev_io": 0, 00:12:07.341 "completed_nvme_io": 0, 00:12:07.341 "transports": [ 00:12:07.341 { 00:12:07.341 "trtype": "TCP" 00:12:07.341 } 00:12:07.341 ] 00:12:07.341 } 00:12:07.341 ] 00:12:07.341 }' 00:12:07.341 16:54:18 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:07.341 16:54:18 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:07.341 16:54:18 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:07.341 16:54:18 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:07.341 16:54:18 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:07.341 16:54:18 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:07.341 16:54:18 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:07.341 16:54:18 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:07.341 16:54:18 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:07.341 16:54:18 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:07.341 16:54:18 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:07.341 16:54:18 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:07.341 16:54:18 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:07.341 16:54:18 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:07.341 16:54:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.341 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.341 Malloc1 00:12:07.341 16:54:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.341 16:54:18 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:07.341 16:54:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.341 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.341 16:54:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.341 16:54:18 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:07.341 16:54:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.341 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.600 16:54:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.600 16:54:18 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:07.600 16:54:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.600 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.600 16:54:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.600 16:54:18 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:07.600 16:54:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.600 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.600 [2024-11-29 16:54:18.787627] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:07.600 16:54:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.600 16:54:18 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:07.600 16:54:18 -- common/autotest_common.sh@650 -- # local es=0 00:12:07.600 16:54:18 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:07.600 16:54:18 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:07.600 16:54:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:07.600 16:54:18 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:07.600 16:54:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:07.600 16:54:18 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:07.600 16:54:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:07.600 16:54:18 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:07.600 16:54:18 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:07.600 16:54:18 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:07.600 [2024-11-29 16:54:18.810155] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:07.600 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:07.600 could not add new controller: failed to write to nvme-fabrics device 00:12:07.600 16:54:18 -- common/autotest_common.sh@653 -- # es=1 00:12:07.600 16:54:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:07.600 16:54:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:07.600 16:54:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:07.600 16:54:18 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:07.600 16:54:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.600 16:54:18 -- common/autotest_common.sh@10 -- # set +x 00:12:07.600 16:54:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.600 16:54:18 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:08.168 16:54:19 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:08.168 16:54:19 -- common/autotest_common.sh@1187 -- # local i=0 00:12:08.168 16:54:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:08.168 16:54:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:08.168 16:54:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:10.698 16:54:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:10.698 16:54:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:10.698 16:54:21 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:10.698 16:54:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:10.698 16:54:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:10.698 16:54:21 -- common/autotest_common.sh@1197 -- # return 0 00:12:10.698 16:54:21 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:10.698 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.698 16:54:21 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:10.698 16:54:21 -- common/autotest_common.sh@1208 -- # local i=0 00:12:10.698 16:54:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:10.698 16:54:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.698 16:54:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:10.698 16:54:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.698 16:54:21 -- common/autotest_common.sh@1220 -- # return 0 00:12:10.698 16:54:21 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:10.698 16:54:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.698 16:54:21 -- common/autotest_common.sh@10 -- # set +x 00:12:10.698 16:54:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.698 16:54:21 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:10.698 16:54:21 -- common/autotest_common.sh@650 -- # local es=0 00:12:10.698 16:54:21 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:10.698 16:54:21 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:10.698 16:54:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:10.698 16:54:21 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:10.698 16:54:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:10.698 16:54:21 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:10.698 16:54:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:10.698 16:54:21 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:10.698 16:54:21 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:10.698 16:54:21 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:10.698 [2024-11-29 16:54:21.652754] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:10.698 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:10.698 could not add new controller: failed to write to nvme-fabrics device 00:12:10.698 16:54:21 -- common/autotest_common.sh@653 -- # es=1 00:12:10.698 16:54:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:10.698 16:54:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:10.698 16:54:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:10.698 16:54:21 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:10.698 16:54:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.698 16:54:21 -- common/autotest_common.sh@10 -- # set +x 00:12:10.698 16:54:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.698 16:54:21 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:10.957 16:54:22 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:10.957 16:54:22 -- common/autotest_common.sh@1187 -- # local i=0 00:12:10.957 16:54:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:10.957 16:54:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:10.957 16:54:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:13.489 16:54:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:13.489 16:54:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:13.489 16:54:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:13.489 16:54:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:13.489 16:54:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:13.489 16:54:24 -- common/autotest_common.sh@1197 -- # return 0 00:12:13.489 16:54:24 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:13.489 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.489 16:54:24 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:13.489 16:54:24 -- common/autotest_common.sh@1208 -- # local i=0 00:12:13.489 16:54:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:13.489 16:54:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:13.489 16:54:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:13.489 16:54:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:13.489 16:54:24 -- common/autotest_common.sh@1220 -- # return 0 00:12:13.489 16:54:24 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:13.489 16:54:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.489 16:54:24 -- common/autotest_common.sh@10 -- # set +x 00:12:13.489 16:54:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.489 16:54:24 -- target/rpc.sh@81 -- # seq 1 5 00:12:13.489 16:54:24 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:13.489 16:54:24 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:13.489 16:54:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.489 16:54:24 -- common/autotest_common.sh@10 -- # set +x 00:12:13.489 16:54:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.489 16:54:24 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:13.489 16:54:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.489 16:54:24 -- common/autotest_common.sh@10 -- # set +x 00:12:13.489 [2024-11-29 16:54:24.486505] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:13.489 16:54:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.489 16:54:24 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:13.489 16:54:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.489 16:54:24 -- common/autotest_common.sh@10 -- # set +x 00:12:13.489 16:54:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.489 16:54:24 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:13.489 16:54:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.489 16:54:24 -- common/autotest_common.sh@10 -- # set +x 00:12:13.489 16:54:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.489 16:54:24 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:13.747 16:54:25 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:13.747 16:54:25 -- common/autotest_common.sh@1187 -- # local i=0 00:12:13.747 16:54:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:13.747 16:54:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:13.747 16:54:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:16.271 16:54:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:16.271 16:54:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:16.271 16:54:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:16.271 16:54:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:16.271 16:54:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:16.271 16:54:27 -- common/autotest_common.sh@1197 -- # return 0 00:12:16.271 16:54:27 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:16.271 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.271 16:54:27 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:16.271 16:54:27 -- common/autotest_common.sh@1208 -- # local i=0 00:12:16.271 16:54:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:16.271 16:54:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.271 16:54:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:16.271 16:54:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.271 16:54:27 -- common/autotest_common.sh@1220 -- # return 0 00:12:16.271 16:54:27 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:16.271 16:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.271 16:54:27 -- common/autotest_common.sh@10 -- # set +x 00:12:16.271 16:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.271 16:54:27 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:16.271 16:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.271 16:54:27 -- common/autotest_common.sh@10 -- # set +x 00:12:16.271 16:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.271 16:54:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:16.271 16:54:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:16.271 16:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.271 16:54:27 -- common/autotest_common.sh@10 -- # set +x 00:12:16.271 16:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.271 16:54:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:16.271 16:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.271 16:54:27 -- common/autotest_common.sh@10 -- # set +x 00:12:16.271 [2024-11-29 16:54:27.241918] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:16.271 16:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.271 16:54:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:16.271 16:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.271 16:54:27 -- common/autotest_common.sh@10 -- # set +x 00:12:16.271 16:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.271 16:54:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:16.271 16:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.271 16:54:27 -- common/autotest_common.sh@10 -- # set +x 00:12:16.271 16:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.271 16:54:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:16.529 16:54:27 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:16.529 16:54:27 -- common/autotest_common.sh@1187 -- # local i=0 00:12:16.529 16:54:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:16.529 16:54:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:16.529 16:54:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:19.058 16:54:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:19.058 16:54:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:19.058 16:54:29 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:19.058 16:54:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:19.058 16:54:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:19.058 16:54:29 -- common/autotest_common.sh@1197 -- # return 0 00:12:19.058 16:54:29 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:19.058 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.058 16:54:29 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:19.058 16:54:29 -- common/autotest_common.sh@1208 -- # local i=0 00:12:19.058 16:54:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:19.058 16:54:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.058 16:54:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:19.058 16:54:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.058 16:54:29 -- common/autotest_common.sh@1220 -- # return 0 00:12:19.058 16:54:29 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:19.058 16:54:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.058 16:54:29 -- common/autotest_common.sh@10 -- # set +x 00:12:19.058 16:54:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.058 16:54:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.058 16:54:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.058 16:54:30 -- common/autotest_common.sh@10 -- # set +x 00:12:19.058 16:54:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.058 16:54:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:19.058 16:54:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.058 16:54:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.058 16:54:30 -- common/autotest_common.sh@10 -- # set +x 00:12:19.058 16:54:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.058 16:54:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.058 16:54:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.058 16:54:30 -- common/autotest_common.sh@10 -- # set +x 00:12:19.058 [2024-11-29 16:54:30.021911] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.058 16:54:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.058 16:54:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:19.058 16:54:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.058 16:54:30 -- common/autotest_common.sh@10 -- # set +x 00:12:19.058 16:54:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.058 16:54:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.058 16:54:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.058 16:54:30 -- common/autotest_common.sh@10 -- # set +x 00:12:19.058 16:54:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.058 16:54:30 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:19.316 16:54:30 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:19.316 16:54:30 -- common/autotest_common.sh@1187 -- # local i=0 00:12:19.316 16:54:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:19.316 16:54:30 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:19.316 16:54:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:21.846 16:54:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:21.846 16:54:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:21.846 16:54:32 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:21.846 16:54:32 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:21.847 16:54:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:21.847 16:54:32 -- common/autotest_common.sh@1197 -- # return 0 00:12:21.847 16:54:32 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:21.847 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.847 16:54:32 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:21.847 16:54:32 -- common/autotest_common.sh@1208 -- # local i=0 00:12:21.847 16:54:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:21.847 16:54:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:21.847 16:54:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:21.847 16:54:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:21.847 16:54:32 -- common/autotest_common.sh@1220 -- # return 0 00:12:21.847 16:54:32 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:21.847 16:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.847 16:54:32 -- common/autotest_common.sh@10 -- # set +x 00:12:21.847 16:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.847 16:54:32 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.847 16:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.847 16:54:32 -- common/autotest_common.sh@10 -- # set +x 00:12:21.847 16:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.847 16:54:32 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:21.847 16:54:32 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.847 16:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.847 16:54:32 -- common/autotest_common.sh@10 -- # set +x 00:12:21.847 16:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.847 16:54:32 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.847 16:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.847 16:54:32 -- common/autotest_common.sh@10 -- # set +x 00:12:21.847 [2024-11-29 16:54:32.888034] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.847 16:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.847 16:54:32 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:21.847 16:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.847 16:54:32 -- common/autotest_common.sh@10 -- # set +x 00:12:21.847 16:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.847 16:54:32 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.847 16:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.847 16:54:32 -- common/autotest_common.sh@10 -- # set +x 00:12:21.847 16:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.847 16:54:32 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:22.413 16:54:33 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:22.413 16:54:33 -- common/autotest_common.sh@1187 -- # local i=0 00:12:22.413 16:54:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:22.413 16:54:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:22.413 16:54:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:24.324 16:54:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:24.324 16:54:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:24.324 16:54:35 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:24.324 16:54:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:24.324 16:54:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:24.324 16:54:35 -- common/autotest_common.sh@1197 -- # return 0 00:12:24.324 16:54:35 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:24.324 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:24.324 16:54:35 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:24.324 16:54:35 -- common/autotest_common.sh@1208 -- # local i=0 00:12:24.324 16:54:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:24.324 16:54:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:24.324 16:54:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:24.324 16:54:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:24.324 16:54:35 -- common/autotest_common.sh@1220 -- # return 0 00:12:24.324 16:54:35 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:24.324 16:54:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.324 16:54:35 -- common/autotest_common.sh@10 -- # set +x 00:12:24.324 16:54:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.324 16:54:35 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:24.324 16:54:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.324 16:54:35 -- common/autotest_common.sh@10 -- # set +x 00:12:24.324 16:54:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.324 16:54:35 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:24.324 16:54:35 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:24.324 16:54:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.324 16:54:35 -- common/autotest_common.sh@10 -- # set +x 00:12:24.324 16:54:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.324 16:54:35 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:24.324 16:54:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.324 16:54:35 -- common/autotest_common.sh@10 -- # set +x 00:12:24.324 [2024-11-29 16:54:35.734634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:24.324 16:54:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.324 16:54:35 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:24.324 16:54:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.324 16:54:35 -- common/autotest_common.sh@10 -- # set +x 00:12:24.324 16:54:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.324 16:54:35 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:24.324 16:54:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.324 16:54:35 -- common/autotest_common.sh@10 -- # set +x 00:12:24.324 16:54:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.582 16:54:35 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:25.147 16:54:36 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:25.147 16:54:36 -- common/autotest_common.sh@1187 -- # local i=0 00:12:25.147 16:54:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:25.147 16:54:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:25.147 16:54:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:27.046 16:54:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:27.046 16:54:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:27.046 16:54:38 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:27.046 16:54:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:27.046 16:54:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:27.046 16:54:38 -- common/autotest_common.sh@1197 -- # return 0 00:12:27.046 16:54:38 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:27.305 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.305 16:54:38 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:27.305 16:54:38 -- common/autotest_common.sh@1208 -- # local i=0 00:12:27.305 16:54:38 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:27.305 16:54:38 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:27.305 16:54:38 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:27.305 16:54:38 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:27.305 16:54:38 -- common/autotest_common.sh@1220 -- # return 0 00:12:27.305 16:54:38 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@99 -- # seq 1 5 00:12:27.305 16:54:38 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:27.305 16:54:38 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 [2024-11-29 16:54:38.608123] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:27.305 16:54:38 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 [2024-11-29 16:54:38.656158] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:27.305 16:54:38 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 [2024-11-29 16:54:38.704330] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.305 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.305 16:54:38 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:27.305 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.305 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.563 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.563 16:54:38 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:27.563 16:54:38 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:27.563 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.563 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.563 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.563 16:54:38 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:27.563 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.563 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 [2024-11-29 16:54:38.752469] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:27.564 16:54:38 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 [2024-11-29 16:54:38.800628] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:27.564 16:54:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.564 16:54:38 -- common/autotest_common.sh@10 -- # set +x 00:12:27.564 16:54:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.564 16:54:38 -- target/rpc.sh@110 -- # stats='{ 00:12:27.564 "tick_rate": 2700000000, 00:12:27.564 "poll_groups": [ 00:12:27.564 { 00:12:27.564 "name": "nvmf_tgt_poll_group_0", 00:12:27.564 "admin_qpairs": 2, 00:12:27.564 "io_qpairs": 84, 00:12:27.564 "current_admin_qpairs": 0, 00:12:27.564 "current_io_qpairs": 0, 00:12:27.564 "pending_bdev_io": 0, 00:12:27.564 "completed_nvme_io": 143, 00:12:27.564 "transports": [ 00:12:27.564 { 00:12:27.564 "trtype": "TCP" 00:12:27.564 } 00:12:27.564 ] 00:12:27.564 }, 00:12:27.564 { 00:12:27.564 "name": "nvmf_tgt_poll_group_1", 00:12:27.564 "admin_qpairs": 2, 00:12:27.564 "io_qpairs": 84, 00:12:27.564 "current_admin_qpairs": 0, 00:12:27.564 "current_io_qpairs": 0, 00:12:27.564 "pending_bdev_io": 0, 00:12:27.564 "completed_nvme_io": 173, 00:12:27.564 "transports": [ 00:12:27.564 { 00:12:27.564 "trtype": "TCP" 00:12:27.564 } 00:12:27.564 ] 00:12:27.564 }, 00:12:27.564 { 00:12:27.564 "name": "nvmf_tgt_poll_group_2", 00:12:27.564 "admin_qpairs": 1, 00:12:27.564 "io_qpairs": 84, 00:12:27.564 "current_admin_qpairs": 0, 00:12:27.564 "current_io_qpairs": 0, 00:12:27.564 "pending_bdev_io": 0, 00:12:27.564 "completed_nvme_io": 236, 00:12:27.564 "transports": [ 00:12:27.564 { 00:12:27.564 "trtype": "TCP" 00:12:27.564 } 00:12:27.564 ] 00:12:27.564 }, 00:12:27.564 { 00:12:27.564 "name": "nvmf_tgt_poll_group_3", 00:12:27.564 "admin_qpairs": 2, 00:12:27.564 "io_qpairs": 84, 00:12:27.564 "current_admin_qpairs": 0, 00:12:27.564 "current_io_qpairs": 0, 00:12:27.564 "pending_bdev_io": 0, 00:12:27.564 "completed_nvme_io": 134, 00:12:27.564 "transports": [ 00:12:27.564 { 00:12:27.564 "trtype": "TCP" 00:12:27.564 } 00:12:27.564 ] 00:12:27.564 } 00:12:27.564 ] 00:12:27.564 }' 00:12:27.564 16:54:38 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:27.564 16:54:38 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:27.564 16:54:38 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:27.564 16:54:38 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:27.564 16:54:38 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:27.564 16:54:38 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:27.564 16:54:38 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:27.564 16:54:38 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:27.564 16:54:38 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:27.564 16:54:38 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:27.564 16:54:38 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:27.564 16:54:38 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:27.564 16:54:38 -- target/rpc.sh@123 -- # nvmftestfini 00:12:27.564 16:54:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:27.564 16:54:38 -- nvmf/common.sh@116 -- # sync 00:12:27.564 16:54:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:27.564 16:54:38 -- nvmf/common.sh@119 -- # set +e 00:12:27.564 16:54:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:27.564 16:54:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:27.564 rmmod nvme_tcp 00:12:27.564 rmmod nvme_fabrics 00:12:27.564 rmmod nvme_keyring 00:12:27.564 16:54:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:27.564 16:54:38 -- nvmf/common.sh@123 -- # set -e 00:12:27.564 16:54:38 -- nvmf/common.sh@124 -- # return 0 00:12:27.564 16:54:38 -- nvmf/common.sh@477 -- # '[' -n 151988 ']' 00:12:27.564 16:54:38 -- nvmf/common.sh@478 -- # killprocess 151988 00:12:27.564 16:54:38 -- common/autotest_common.sh@936 -- # '[' -z 151988 ']' 00:12:27.564 16:54:38 -- common/autotest_common.sh@940 -- # kill -0 151988 00:12:27.564 16:54:38 -- common/autotest_common.sh@941 -- # uname 00:12:27.564 16:54:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:27.564 16:54:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 151988 00:12:27.823 16:54:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:27.823 16:54:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:27.823 16:54:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 151988' 00:12:27.823 killing process with pid 151988 00:12:27.823 16:54:39 -- common/autotest_common.sh@955 -- # kill 151988 00:12:27.823 16:54:39 -- common/autotest_common.sh@960 -- # wait 151988 00:12:28.083 16:54:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:28.083 16:54:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:28.083 16:54:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:28.083 16:54:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:28.083 16:54:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:28.083 16:54:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:28.083 16:54:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:28.083 16:54:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:29.989 16:54:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:29.989 00:12:29.989 real 0m26.238s 00:12:29.989 user 1m25.528s 00:12:29.989 sys 0m4.397s 00:12:29.989 16:54:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:29.989 16:54:41 -- common/autotest_common.sh@10 -- # set +x 00:12:29.989 ************************************ 00:12:29.989 END TEST nvmf_rpc 00:12:29.989 ************************************ 00:12:29.989 16:54:41 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:29.989 16:54:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:29.989 16:54:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:29.989 16:54:41 -- common/autotest_common.sh@10 -- # set +x 00:12:29.989 ************************************ 00:12:29.989 START TEST nvmf_invalid 00:12:29.989 ************************************ 00:12:29.989 16:54:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:30.248 * Looking for test storage... 00:12:30.248 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:30.248 16:54:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:30.248 16:54:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:30.248 16:54:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:30.248 16:54:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:30.248 16:54:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:30.248 16:54:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:30.248 16:54:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:30.248 16:54:41 -- scripts/common.sh@335 -- # IFS=.-: 00:12:30.248 16:54:41 -- scripts/common.sh@335 -- # read -ra ver1 00:12:30.248 16:54:41 -- scripts/common.sh@336 -- # IFS=.-: 00:12:30.248 16:54:41 -- scripts/common.sh@336 -- # read -ra ver2 00:12:30.248 16:54:41 -- scripts/common.sh@337 -- # local 'op=<' 00:12:30.248 16:54:41 -- scripts/common.sh@339 -- # ver1_l=2 00:12:30.248 16:54:41 -- scripts/common.sh@340 -- # ver2_l=1 00:12:30.248 16:54:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:30.248 16:54:41 -- scripts/common.sh@343 -- # case "$op" in 00:12:30.248 16:54:41 -- scripts/common.sh@344 -- # : 1 00:12:30.248 16:54:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:30.248 16:54:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:30.248 16:54:41 -- scripts/common.sh@364 -- # decimal 1 00:12:30.248 16:54:41 -- scripts/common.sh@352 -- # local d=1 00:12:30.248 16:54:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:30.248 16:54:41 -- scripts/common.sh@354 -- # echo 1 00:12:30.248 16:54:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:30.248 16:54:41 -- scripts/common.sh@365 -- # decimal 2 00:12:30.248 16:54:41 -- scripts/common.sh@352 -- # local d=2 00:12:30.248 16:54:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:30.248 16:54:41 -- scripts/common.sh@354 -- # echo 2 00:12:30.248 16:54:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:30.248 16:54:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:30.248 16:54:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:30.249 16:54:41 -- scripts/common.sh@367 -- # return 0 00:12:30.249 16:54:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:30.249 16:54:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:30.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.249 --rc genhtml_branch_coverage=1 00:12:30.249 --rc genhtml_function_coverage=1 00:12:30.249 --rc genhtml_legend=1 00:12:30.249 --rc geninfo_all_blocks=1 00:12:30.249 --rc geninfo_unexecuted_blocks=1 00:12:30.249 00:12:30.249 ' 00:12:30.249 16:54:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:30.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.249 --rc genhtml_branch_coverage=1 00:12:30.249 --rc genhtml_function_coverage=1 00:12:30.249 --rc genhtml_legend=1 00:12:30.249 --rc geninfo_all_blocks=1 00:12:30.249 --rc geninfo_unexecuted_blocks=1 00:12:30.249 00:12:30.249 ' 00:12:30.249 16:54:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:30.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.249 --rc genhtml_branch_coverage=1 00:12:30.249 --rc genhtml_function_coverage=1 00:12:30.249 --rc genhtml_legend=1 00:12:30.249 --rc geninfo_all_blocks=1 00:12:30.249 --rc geninfo_unexecuted_blocks=1 00:12:30.249 00:12:30.249 ' 00:12:30.249 16:54:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:30.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.249 --rc genhtml_branch_coverage=1 00:12:30.249 --rc genhtml_function_coverage=1 00:12:30.249 --rc genhtml_legend=1 00:12:30.249 --rc geninfo_all_blocks=1 00:12:30.249 --rc geninfo_unexecuted_blocks=1 00:12:30.249 00:12:30.249 ' 00:12:30.249 16:54:41 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:30.249 16:54:41 -- nvmf/common.sh@7 -- # uname -s 00:12:30.249 16:54:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:30.249 16:54:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:30.249 16:54:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:30.249 16:54:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:30.249 16:54:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:30.249 16:54:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:30.249 16:54:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:30.249 16:54:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:30.249 16:54:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:30.249 16:54:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:30.249 16:54:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:30.249 16:54:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:30.249 16:54:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:30.249 16:54:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:30.249 16:54:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:30.249 16:54:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:30.249 16:54:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:30.249 16:54:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:30.249 16:54:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:30.249 16:54:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.249 16:54:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.249 16:54:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.249 16:54:41 -- paths/export.sh@5 -- # export PATH 00:12:30.249 16:54:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.249 16:54:41 -- nvmf/common.sh@46 -- # : 0 00:12:30.249 16:54:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:30.249 16:54:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:30.249 16:54:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:30.249 16:54:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:30.249 16:54:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:30.249 16:54:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:30.249 16:54:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:30.249 16:54:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:30.249 16:54:41 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:30.249 16:54:41 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:30.249 16:54:41 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:30.249 16:54:41 -- target/invalid.sh@14 -- # target=foobar 00:12:30.249 16:54:41 -- target/invalid.sh@16 -- # RANDOM=0 00:12:30.249 16:54:41 -- target/invalid.sh@34 -- # nvmftestinit 00:12:30.249 16:54:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:30.249 16:54:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:30.249 16:54:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:30.249 16:54:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:30.249 16:54:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:30.249 16:54:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:30.249 16:54:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:30.249 16:54:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:30.249 16:54:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:30.249 16:54:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:30.249 16:54:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:30.249 16:54:41 -- common/autotest_common.sh@10 -- # set +x 00:12:32.780 16:54:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:32.780 16:54:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:32.780 16:54:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:32.780 16:54:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:32.780 16:54:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:32.780 16:54:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:32.780 16:54:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:32.780 16:54:43 -- nvmf/common.sh@294 -- # net_devs=() 00:12:32.780 16:54:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:32.780 16:54:43 -- nvmf/common.sh@295 -- # e810=() 00:12:32.780 16:54:43 -- nvmf/common.sh@295 -- # local -ga e810 00:12:32.780 16:54:43 -- nvmf/common.sh@296 -- # x722=() 00:12:32.780 16:54:43 -- nvmf/common.sh@296 -- # local -ga x722 00:12:32.780 16:54:43 -- nvmf/common.sh@297 -- # mlx=() 00:12:32.780 16:54:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:32.780 16:54:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:32.780 16:54:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:32.780 16:54:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:32.780 16:54:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:32.780 16:54:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:32.780 16:54:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:32.780 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:32.780 16:54:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:32.780 16:54:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:32.780 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:32.780 16:54:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:32.780 16:54:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:32.781 16:54:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:32.781 16:54:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:32.781 16:54:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:32.781 16:54:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:32.781 16:54:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:32.781 16:54:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:32.781 16:54:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.781 16:54:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:32.781 16:54:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.781 16:54:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:32.781 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:32.781 16:54:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.781 16:54:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:32.781 16:54:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.781 16:54:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:32.781 16:54:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.781 16:54:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:32.781 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:32.781 16:54:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.781 16:54:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:32.781 16:54:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:32.781 16:54:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:32.781 16:54:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:32.781 16:54:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:32.781 16:54:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:32.781 16:54:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:32.781 16:54:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:32.781 16:54:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:32.781 16:54:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:32.781 16:54:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:32.781 16:54:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:32.781 16:54:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:32.781 16:54:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:32.781 16:54:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:32.781 16:54:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:32.781 16:54:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:32.781 16:54:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:32.781 16:54:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:32.781 16:54:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:32.781 16:54:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:32.781 16:54:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:32.781 16:54:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:32.781 16:54:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:32.781 16:54:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:32.781 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:32.781 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.287 ms 00:12:32.781 00:12:32.781 --- 10.0.0.2 ping statistics --- 00:12:32.781 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:32.781 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:12:32.781 16:54:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:32.781 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:32.781 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:12:32.781 00:12:32.781 --- 10.0.0.1 ping statistics --- 00:12:32.781 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:32.781 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:12:32.781 16:54:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:32.781 16:54:43 -- nvmf/common.sh@410 -- # return 0 00:12:32.781 16:54:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:32.781 16:54:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:32.781 16:54:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:32.781 16:54:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:32.781 16:54:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:32.781 16:54:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:32.781 16:54:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:32.781 16:54:43 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:32.781 16:54:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:32.781 16:54:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:32.781 16:54:43 -- common/autotest_common.sh@10 -- # set +x 00:12:32.781 16:54:43 -- nvmf/common.sh@469 -- # nvmfpid=156705 00:12:32.781 16:54:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:32.781 16:54:43 -- nvmf/common.sh@470 -- # waitforlisten 156705 00:12:32.781 16:54:43 -- common/autotest_common.sh@829 -- # '[' -z 156705 ']' 00:12:32.781 16:54:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:32.781 16:54:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:32.781 16:54:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:32.781 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:32.781 16:54:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:32.781 16:54:43 -- common/autotest_common.sh@10 -- # set +x 00:12:32.781 [2024-11-29 16:54:43.934359] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:32.781 [2024-11-29 16:54:43.934451] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:32.781 EAL: No free 2048 kB hugepages reported on node 1 00:12:32.781 [2024-11-29 16:54:44.015056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:32.781 [2024-11-29 16:54:44.138039] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:32.781 [2024-11-29 16:54:44.138197] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:32.781 [2024-11-29 16:54:44.138226] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:32.781 [2024-11-29 16:54:44.138251] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:32.781 [2024-11-29 16:54:44.138319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:32.781 [2024-11-29 16:54:44.138354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:32.781 [2024-11-29 16:54:44.138410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:32.781 [2024-11-29 16:54:44.138413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:33.739 16:54:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:33.739 16:54:44 -- common/autotest_common.sh@862 -- # return 0 00:12:33.739 16:54:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:33.739 16:54:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:33.739 16:54:44 -- common/autotest_common.sh@10 -- # set +x 00:12:33.739 16:54:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:33.739 16:54:44 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:33.739 16:54:44 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode9692 00:12:33.998 [2024-11-29 16:54:45.258587] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:33.998 16:54:45 -- target/invalid.sh@40 -- # out='request: 00:12:33.998 { 00:12:33.998 "nqn": "nqn.2016-06.io.spdk:cnode9692", 00:12:33.998 "tgt_name": "foobar", 00:12:33.998 "method": "nvmf_create_subsystem", 00:12:33.998 "req_id": 1 00:12:33.998 } 00:12:33.998 Got JSON-RPC error response 00:12:33.998 response: 00:12:33.998 { 00:12:33.998 "code": -32603, 00:12:33.998 "message": "Unable to find target foobar" 00:12:33.998 }' 00:12:33.998 16:54:45 -- target/invalid.sh@41 -- # [[ request: 00:12:33.998 { 00:12:33.998 "nqn": "nqn.2016-06.io.spdk:cnode9692", 00:12:33.998 "tgt_name": "foobar", 00:12:33.998 "method": "nvmf_create_subsystem", 00:12:33.998 "req_id": 1 00:12:33.998 } 00:12:33.998 Got JSON-RPC error response 00:12:33.998 response: 00:12:33.998 { 00:12:33.998 "code": -32603, 00:12:33.998 "message": "Unable to find target foobar" 00:12:33.998 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:33.998 16:54:45 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:33.998 16:54:45 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode20479 00:12:34.255 [2024-11-29 16:54:45.547534] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20479: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:34.255 16:54:45 -- target/invalid.sh@45 -- # out='request: 00:12:34.255 { 00:12:34.255 "nqn": "nqn.2016-06.io.spdk:cnode20479", 00:12:34.255 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:34.255 "method": "nvmf_create_subsystem", 00:12:34.255 "req_id": 1 00:12:34.255 } 00:12:34.255 Got JSON-RPC error response 00:12:34.255 response: 00:12:34.255 { 00:12:34.255 "code": -32602, 00:12:34.255 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:34.255 }' 00:12:34.255 16:54:45 -- target/invalid.sh@46 -- # [[ request: 00:12:34.255 { 00:12:34.255 "nqn": "nqn.2016-06.io.spdk:cnode20479", 00:12:34.255 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:34.255 "method": "nvmf_create_subsystem", 00:12:34.255 "req_id": 1 00:12:34.255 } 00:12:34.255 Got JSON-RPC error response 00:12:34.255 response: 00:12:34.255 { 00:12:34.255 "code": -32602, 00:12:34.255 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:34.255 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:34.255 16:54:45 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:34.255 16:54:45 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode28832 00:12:34.512 [2024-11-29 16:54:45.804365] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28832: invalid model number 'SPDK_Controller' 00:12:34.512 16:54:45 -- target/invalid.sh@50 -- # out='request: 00:12:34.512 { 00:12:34.512 "nqn": "nqn.2016-06.io.spdk:cnode28832", 00:12:34.512 "model_number": "SPDK_Controller\u001f", 00:12:34.512 "method": "nvmf_create_subsystem", 00:12:34.512 "req_id": 1 00:12:34.512 } 00:12:34.512 Got JSON-RPC error response 00:12:34.512 response: 00:12:34.512 { 00:12:34.512 "code": -32602, 00:12:34.512 "message": "Invalid MN SPDK_Controller\u001f" 00:12:34.512 }' 00:12:34.512 16:54:45 -- target/invalid.sh@51 -- # [[ request: 00:12:34.512 { 00:12:34.512 "nqn": "nqn.2016-06.io.spdk:cnode28832", 00:12:34.512 "model_number": "SPDK_Controller\u001f", 00:12:34.512 "method": "nvmf_create_subsystem", 00:12:34.512 "req_id": 1 00:12:34.512 } 00:12:34.512 Got JSON-RPC error response 00:12:34.512 response: 00:12:34.512 { 00:12:34.512 "code": -32602, 00:12:34.512 "message": "Invalid MN SPDK_Controller\u001f" 00:12:34.512 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:34.512 16:54:45 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:34.512 16:54:45 -- target/invalid.sh@19 -- # local length=21 ll 00:12:34.513 16:54:45 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:34.513 16:54:45 -- target/invalid.sh@21 -- # local chars 00:12:34.513 16:54:45 -- target/invalid.sh@22 -- # local string 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 102 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=f 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 60 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+='<' 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 123 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+='{' 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 44 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=, 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 119 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=w 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 109 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=m 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 66 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=B 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 111 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=o 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 57 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=9 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 79 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=O 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 69 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=E 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 35 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+='#' 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 115 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x73' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=s 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 69 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=E 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 117 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=u 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 105 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=i 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 57 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=9 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 96 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+='`' 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 39 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=\' 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 109 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+=m 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # printf %x 61 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:34.513 16:54:45 -- target/invalid.sh@25 -- # string+== 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.513 16:54:45 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.513 16:54:45 -- target/invalid.sh@28 -- # [[ f == \- ]] 00:12:34.513 16:54:45 -- target/invalid.sh@31 -- # echo 'f<{,wmBo9OE#sEui9`'\''m=' 00:12:34.513 16:54:45 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'f<{,wmBo9OE#sEui9`'\''m=' nqn.2016-06.io.spdk:cnode21639 00:12:34.769 [2024-11-29 16:54:46.121388] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21639: invalid serial number 'f<{,wmBo9OE#sEui9`'m=' 00:12:34.769 16:54:46 -- target/invalid.sh@54 -- # out='request: 00:12:34.769 { 00:12:34.769 "nqn": "nqn.2016-06.io.spdk:cnode21639", 00:12:34.769 "serial_number": "f<{,wmBo9OE#sEui9`'\''m=", 00:12:34.769 "method": "nvmf_create_subsystem", 00:12:34.769 "req_id": 1 00:12:34.769 } 00:12:34.769 Got JSON-RPC error response 00:12:34.769 response: 00:12:34.769 { 00:12:34.769 "code": -32602, 00:12:34.769 "message": "Invalid SN f<{,wmBo9OE#sEui9`'\''m=" 00:12:34.769 }' 00:12:34.770 16:54:46 -- target/invalid.sh@55 -- # [[ request: 00:12:34.770 { 00:12:34.770 "nqn": "nqn.2016-06.io.spdk:cnode21639", 00:12:34.770 "serial_number": "f<{,wmBo9OE#sEui9`'m=", 00:12:34.770 "method": "nvmf_create_subsystem", 00:12:34.770 "req_id": 1 00:12:34.770 } 00:12:34.770 Got JSON-RPC error response 00:12:34.770 response: 00:12:34.770 { 00:12:34.770 "code": -32602, 00:12:34.770 "message": "Invalid SN f<{,wmBo9OE#sEui9`'m=" 00:12:34.770 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:34.770 16:54:46 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:34.770 16:54:46 -- target/invalid.sh@19 -- # local length=41 ll 00:12:34.770 16:54:46 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:34.770 16:54:46 -- target/invalid.sh@21 -- # local chars 00:12:34.770 16:54:46 -- target/invalid.sh@22 -- # local string 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 32 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=' ' 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 32 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=' ' 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 81 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=Q 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 111 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=o 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 36 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x24' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+='$' 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 119 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=w 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 97 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=a 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 107 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=k 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 88 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=X 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 84 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=T 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 76 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=L 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 64 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x40' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=@ 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 49 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+=1 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # printf %x 91 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:34.770 16:54:46 -- target/invalid.sh@25 -- # string+='[' 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:34.770 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 47 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=/ 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 112 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=p 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 83 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=S 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 47 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=/ 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 52 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x34' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=4 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 101 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x65' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=e 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 125 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+='}' 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 61 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+== 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 83 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=S 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 59 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=';' 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 119 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=w 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 80 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=P 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 38 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+='&' 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 70 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=F 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 92 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+='\' 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 100 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=d 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 81 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # string+=Q 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.028 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.028 16:54:46 -- target/invalid.sh@25 -- # printf %x 52 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x34' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+=4 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # printf %x 100 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+=d 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # printf %x 126 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+='~' 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # printf %x 91 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+='[' 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # printf %x 95 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+=_ 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # printf %x 126 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+='~' 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # printf %x 73 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+=I 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # printf %x 121 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x79' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+=y 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # printf %x 65 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+=A 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # printf %x 100 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:35.029 16:54:46 -- target/invalid.sh@25 -- # string+=d 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:35.029 16:54:46 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:35.029 16:54:46 -- target/invalid.sh@28 -- # [[ == \- ]] 00:12:35.029 16:54:46 -- target/invalid.sh@31 -- # echo ' Qo$wakXTL@1[/pS/4e}=S;wP&F\dQ4d~[_~IyAd' 00:12:35.029 16:54:46 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d ' Qo$wakXTL@1[/pS/4e}=S;wP&F\dQ4d~[_~IyAd' nqn.2016-06.io.spdk:cnode29264 00:12:35.286 [2024-11-29 16:54:46.542768] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29264: invalid model number ' Qo$wakXTL@1[/pS/4e}=S;wP&F\dQ4d~[_~IyAd' 00:12:35.286 16:54:46 -- target/invalid.sh@58 -- # out='request: 00:12:35.286 { 00:12:35.286 "nqn": "nqn.2016-06.io.spdk:cnode29264", 00:12:35.286 "model_number": " Qo$wakXTL@1[/pS/4e}=S;wP&F\\dQ4d~[_~IyAd", 00:12:35.287 "method": "nvmf_create_subsystem", 00:12:35.287 "req_id": 1 00:12:35.287 } 00:12:35.287 Got JSON-RPC error response 00:12:35.287 response: 00:12:35.287 { 00:12:35.287 "code": -32602, 00:12:35.287 "message": "Invalid MN Qo$wakXTL@1[/pS/4e}=S;wP&F\\dQ4d~[_~IyAd" 00:12:35.287 }' 00:12:35.287 16:54:46 -- target/invalid.sh@59 -- # [[ request: 00:12:35.287 { 00:12:35.287 "nqn": "nqn.2016-06.io.spdk:cnode29264", 00:12:35.287 "model_number": " Qo$wakXTL@1[/pS/4e}=S;wP&F\\dQ4d~[_~IyAd", 00:12:35.287 "method": "nvmf_create_subsystem", 00:12:35.287 "req_id": 1 00:12:35.287 } 00:12:35.287 Got JSON-RPC error response 00:12:35.287 response: 00:12:35.287 { 00:12:35.287 "code": -32602, 00:12:35.287 "message": "Invalid MN Qo$wakXTL@1[/pS/4e}=S;wP&F\\dQ4d~[_~IyAd" 00:12:35.287 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:35.287 16:54:46 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:35.544 [2024-11-29 16:54:46.791659] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:35.544 16:54:46 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:35.802 16:54:47 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:35.802 16:54:47 -- target/invalid.sh@67 -- # echo '' 00:12:35.802 16:54:47 -- target/invalid.sh@67 -- # head -n 1 00:12:35.802 16:54:47 -- target/invalid.sh@67 -- # IP= 00:12:35.802 16:54:47 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:36.060 [2024-11-29 16:54:47.297405] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:36.060 16:54:47 -- target/invalid.sh@69 -- # out='request: 00:12:36.060 { 00:12:36.060 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:36.060 "listen_address": { 00:12:36.060 "trtype": "tcp", 00:12:36.060 "traddr": "", 00:12:36.060 "trsvcid": "4421" 00:12:36.060 }, 00:12:36.060 "method": "nvmf_subsystem_remove_listener", 00:12:36.060 "req_id": 1 00:12:36.060 } 00:12:36.060 Got JSON-RPC error response 00:12:36.060 response: 00:12:36.060 { 00:12:36.060 "code": -32602, 00:12:36.060 "message": "Invalid parameters" 00:12:36.060 }' 00:12:36.060 16:54:47 -- target/invalid.sh@70 -- # [[ request: 00:12:36.060 { 00:12:36.060 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:36.060 "listen_address": { 00:12:36.060 "trtype": "tcp", 00:12:36.060 "traddr": "", 00:12:36.061 "trsvcid": "4421" 00:12:36.061 }, 00:12:36.061 "method": "nvmf_subsystem_remove_listener", 00:12:36.061 "req_id": 1 00:12:36.061 } 00:12:36.061 Got JSON-RPC error response 00:12:36.061 response: 00:12:36.061 { 00:12:36.061 "code": -32602, 00:12:36.061 "message": "Invalid parameters" 00:12:36.061 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:36.061 16:54:47 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2369 -i 0 00:12:36.319 [2024-11-29 16:54:47.570217] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2369: invalid cntlid range [0-65519] 00:12:36.319 16:54:47 -- target/invalid.sh@73 -- # out='request: 00:12:36.319 { 00:12:36.319 "nqn": "nqn.2016-06.io.spdk:cnode2369", 00:12:36.319 "min_cntlid": 0, 00:12:36.319 "method": "nvmf_create_subsystem", 00:12:36.319 "req_id": 1 00:12:36.319 } 00:12:36.319 Got JSON-RPC error response 00:12:36.319 response: 00:12:36.319 { 00:12:36.319 "code": -32602, 00:12:36.319 "message": "Invalid cntlid range [0-65519]" 00:12:36.319 }' 00:12:36.319 16:54:47 -- target/invalid.sh@74 -- # [[ request: 00:12:36.319 { 00:12:36.319 "nqn": "nqn.2016-06.io.spdk:cnode2369", 00:12:36.319 "min_cntlid": 0, 00:12:36.319 "method": "nvmf_create_subsystem", 00:12:36.319 "req_id": 1 00:12:36.319 } 00:12:36.319 Got JSON-RPC error response 00:12:36.319 response: 00:12:36.319 { 00:12:36.319 "code": -32602, 00:12:36.319 "message": "Invalid cntlid range [0-65519]" 00:12:36.319 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:36.319 16:54:47 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode25564 -i 65520 00:12:36.578 [2024-11-29 16:54:47.823059] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25564: invalid cntlid range [65520-65519] 00:12:36.578 16:54:47 -- target/invalid.sh@75 -- # out='request: 00:12:36.578 { 00:12:36.578 "nqn": "nqn.2016-06.io.spdk:cnode25564", 00:12:36.578 "min_cntlid": 65520, 00:12:36.578 "method": "nvmf_create_subsystem", 00:12:36.578 "req_id": 1 00:12:36.578 } 00:12:36.578 Got JSON-RPC error response 00:12:36.578 response: 00:12:36.578 { 00:12:36.578 "code": -32602, 00:12:36.578 "message": "Invalid cntlid range [65520-65519]" 00:12:36.578 }' 00:12:36.578 16:54:47 -- target/invalid.sh@76 -- # [[ request: 00:12:36.578 { 00:12:36.578 "nqn": "nqn.2016-06.io.spdk:cnode25564", 00:12:36.578 "min_cntlid": 65520, 00:12:36.578 "method": "nvmf_create_subsystem", 00:12:36.578 "req_id": 1 00:12:36.578 } 00:12:36.578 Got JSON-RPC error response 00:12:36.578 response: 00:12:36.578 { 00:12:36.578 "code": -32602, 00:12:36.578 "message": "Invalid cntlid range [65520-65519]" 00:12:36.578 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:36.578 16:54:47 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4522 -I 0 00:12:36.837 [2024-11-29 16:54:48.071917] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4522: invalid cntlid range [1-0] 00:12:36.837 16:54:48 -- target/invalid.sh@77 -- # out='request: 00:12:36.837 { 00:12:36.837 "nqn": "nqn.2016-06.io.spdk:cnode4522", 00:12:36.837 "max_cntlid": 0, 00:12:36.837 "method": "nvmf_create_subsystem", 00:12:36.837 "req_id": 1 00:12:36.837 } 00:12:36.837 Got JSON-RPC error response 00:12:36.837 response: 00:12:36.837 { 00:12:36.837 "code": -32602, 00:12:36.837 "message": "Invalid cntlid range [1-0]" 00:12:36.837 }' 00:12:36.837 16:54:48 -- target/invalid.sh@78 -- # [[ request: 00:12:36.837 { 00:12:36.837 "nqn": "nqn.2016-06.io.spdk:cnode4522", 00:12:36.837 "max_cntlid": 0, 00:12:36.837 "method": "nvmf_create_subsystem", 00:12:36.837 "req_id": 1 00:12:36.837 } 00:12:36.837 Got JSON-RPC error response 00:12:36.837 response: 00:12:36.837 { 00:12:36.837 "code": -32602, 00:12:36.837 "message": "Invalid cntlid range [1-0]" 00:12:36.837 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:36.837 16:54:48 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14693 -I 65520 00:12:37.095 [2024-11-29 16:54:48.328796] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14693: invalid cntlid range [1-65520] 00:12:37.095 16:54:48 -- target/invalid.sh@79 -- # out='request: 00:12:37.095 { 00:12:37.095 "nqn": "nqn.2016-06.io.spdk:cnode14693", 00:12:37.095 "max_cntlid": 65520, 00:12:37.095 "method": "nvmf_create_subsystem", 00:12:37.095 "req_id": 1 00:12:37.095 } 00:12:37.095 Got JSON-RPC error response 00:12:37.095 response: 00:12:37.095 { 00:12:37.095 "code": -32602, 00:12:37.095 "message": "Invalid cntlid range [1-65520]" 00:12:37.095 }' 00:12:37.095 16:54:48 -- target/invalid.sh@80 -- # [[ request: 00:12:37.095 { 00:12:37.095 "nqn": "nqn.2016-06.io.spdk:cnode14693", 00:12:37.095 "max_cntlid": 65520, 00:12:37.095 "method": "nvmf_create_subsystem", 00:12:37.095 "req_id": 1 00:12:37.095 } 00:12:37.095 Got JSON-RPC error response 00:12:37.095 response: 00:12:37.095 { 00:12:37.095 "code": -32602, 00:12:37.095 "message": "Invalid cntlid range [1-65520]" 00:12:37.095 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:37.095 16:54:48 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode16897 -i 6 -I 5 00:12:37.353 [2024-11-29 16:54:48.585667] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16897: invalid cntlid range [6-5] 00:12:37.353 16:54:48 -- target/invalid.sh@83 -- # out='request: 00:12:37.353 { 00:12:37.353 "nqn": "nqn.2016-06.io.spdk:cnode16897", 00:12:37.353 "min_cntlid": 6, 00:12:37.353 "max_cntlid": 5, 00:12:37.353 "method": "nvmf_create_subsystem", 00:12:37.353 "req_id": 1 00:12:37.353 } 00:12:37.353 Got JSON-RPC error response 00:12:37.353 response: 00:12:37.353 { 00:12:37.353 "code": -32602, 00:12:37.353 "message": "Invalid cntlid range [6-5]" 00:12:37.353 }' 00:12:37.353 16:54:48 -- target/invalid.sh@84 -- # [[ request: 00:12:37.353 { 00:12:37.353 "nqn": "nqn.2016-06.io.spdk:cnode16897", 00:12:37.353 "min_cntlid": 6, 00:12:37.353 "max_cntlid": 5, 00:12:37.353 "method": "nvmf_create_subsystem", 00:12:37.353 "req_id": 1 00:12:37.353 } 00:12:37.353 Got JSON-RPC error response 00:12:37.353 response: 00:12:37.353 { 00:12:37.353 "code": -32602, 00:12:37.353 "message": "Invalid cntlid range [6-5]" 00:12:37.353 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:37.353 16:54:48 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:37.353 16:54:48 -- target/invalid.sh@87 -- # out='request: 00:12:37.353 { 00:12:37.353 "name": "foobar", 00:12:37.353 "method": "nvmf_delete_target", 00:12:37.353 "req_id": 1 00:12:37.353 } 00:12:37.353 Got JSON-RPC error response 00:12:37.353 response: 00:12:37.353 { 00:12:37.353 "code": -32602, 00:12:37.354 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:37.354 }' 00:12:37.354 16:54:48 -- target/invalid.sh@88 -- # [[ request: 00:12:37.354 { 00:12:37.354 "name": "foobar", 00:12:37.354 "method": "nvmf_delete_target", 00:12:37.354 "req_id": 1 00:12:37.354 } 00:12:37.354 Got JSON-RPC error response 00:12:37.354 response: 00:12:37.354 { 00:12:37.354 "code": -32602, 00:12:37.354 "message": "The specified target doesn't exist, cannot delete it." 00:12:37.354 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:37.354 16:54:48 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:37.354 16:54:48 -- target/invalid.sh@91 -- # nvmftestfini 00:12:37.354 16:54:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:37.354 16:54:48 -- nvmf/common.sh@116 -- # sync 00:12:37.354 16:54:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:37.354 16:54:48 -- nvmf/common.sh@119 -- # set +e 00:12:37.354 16:54:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:37.354 16:54:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:37.354 rmmod nvme_tcp 00:12:37.354 rmmod nvme_fabrics 00:12:37.354 rmmod nvme_keyring 00:12:37.612 16:54:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:37.612 16:54:48 -- nvmf/common.sh@123 -- # set -e 00:12:37.612 16:54:48 -- nvmf/common.sh@124 -- # return 0 00:12:37.612 16:54:48 -- nvmf/common.sh@477 -- # '[' -n 156705 ']' 00:12:37.612 16:54:48 -- nvmf/common.sh@478 -- # killprocess 156705 00:12:37.612 16:54:48 -- common/autotest_common.sh@936 -- # '[' -z 156705 ']' 00:12:37.612 16:54:48 -- common/autotest_common.sh@940 -- # kill -0 156705 00:12:37.612 16:54:48 -- common/autotest_common.sh@941 -- # uname 00:12:37.612 16:54:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:37.612 16:54:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 156705 00:12:37.612 16:54:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:37.612 16:54:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:37.612 16:54:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 156705' 00:12:37.612 killing process with pid 156705 00:12:37.612 16:54:48 -- common/autotest_common.sh@955 -- # kill 156705 00:12:37.612 16:54:48 -- common/autotest_common.sh@960 -- # wait 156705 00:12:37.871 16:54:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:37.871 16:54:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:37.871 16:54:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:37.871 16:54:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:37.871 16:54:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:37.871 16:54:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.871 16:54:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.871 16:54:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:39.781 16:54:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:39.781 00:12:39.781 real 0m9.764s 00:12:39.781 user 0m23.975s 00:12:39.781 sys 0m2.487s 00:12:39.781 16:54:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:39.781 16:54:51 -- common/autotest_common.sh@10 -- # set +x 00:12:39.781 ************************************ 00:12:39.781 END TEST nvmf_invalid 00:12:39.781 ************************************ 00:12:39.781 16:54:51 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:39.781 16:54:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:39.781 16:54:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:39.781 16:54:51 -- common/autotest_common.sh@10 -- # set +x 00:12:39.781 ************************************ 00:12:39.781 START TEST nvmf_abort 00:12:39.781 ************************************ 00:12:39.781 16:54:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:40.040 * Looking for test storage... 00:12:40.040 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:40.040 16:54:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:40.040 16:54:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:40.040 16:54:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:40.040 16:54:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:40.040 16:54:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:40.040 16:54:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:40.040 16:54:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:40.040 16:54:51 -- scripts/common.sh@335 -- # IFS=.-: 00:12:40.040 16:54:51 -- scripts/common.sh@335 -- # read -ra ver1 00:12:40.040 16:54:51 -- scripts/common.sh@336 -- # IFS=.-: 00:12:40.040 16:54:51 -- scripts/common.sh@336 -- # read -ra ver2 00:12:40.040 16:54:51 -- scripts/common.sh@337 -- # local 'op=<' 00:12:40.040 16:54:51 -- scripts/common.sh@339 -- # ver1_l=2 00:12:40.040 16:54:51 -- scripts/common.sh@340 -- # ver2_l=1 00:12:40.040 16:54:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:40.040 16:54:51 -- scripts/common.sh@343 -- # case "$op" in 00:12:40.040 16:54:51 -- scripts/common.sh@344 -- # : 1 00:12:40.040 16:54:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:40.040 16:54:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:40.040 16:54:51 -- scripts/common.sh@364 -- # decimal 1 00:12:40.040 16:54:51 -- scripts/common.sh@352 -- # local d=1 00:12:40.040 16:54:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:40.040 16:54:51 -- scripts/common.sh@354 -- # echo 1 00:12:40.040 16:54:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:40.040 16:54:51 -- scripts/common.sh@365 -- # decimal 2 00:12:40.040 16:54:51 -- scripts/common.sh@352 -- # local d=2 00:12:40.040 16:54:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:40.040 16:54:51 -- scripts/common.sh@354 -- # echo 2 00:12:40.040 16:54:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:40.040 16:54:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:40.040 16:54:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:40.040 16:54:51 -- scripts/common.sh@367 -- # return 0 00:12:40.040 16:54:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:40.040 16:54:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:40.040 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:40.040 --rc genhtml_branch_coverage=1 00:12:40.040 --rc genhtml_function_coverage=1 00:12:40.040 --rc genhtml_legend=1 00:12:40.040 --rc geninfo_all_blocks=1 00:12:40.040 --rc geninfo_unexecuted_blocks=1 00:12:40.040 00:12:40.040 ' 00:12:40.040 16:54:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:40.040 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:40.040 --rc genhtml_branch_coverage=1 00:12:40.040 --rc genhtml_function_coverage=1 00:12:40.040 --rc genhtml_legend=1 00:12:40.040 --rc geninfo_all_blocks=1 00:12:40.040 --rc geninfo_unexecuted_blocks=1 00:12:40.040 00:12:40.040 ' 00:12:40.040 16:54:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:40.040 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:40.040 --rc genhtml_branch_coverage=1 00:12:40.040 --rc genhtml_function_coverage=1 00:12:40.040 --rc genhtml_legend=1 00:12:40.040 --rc geninfo_all_blocks=1 00:12:40.040 --rc geninfo_unexecuted_blocks=1 00:12:40.040 00:12:40.040 ' 00:12:40.040 16:54:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:40.040 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:40.040 --rc genhtml_branch_coverage=1 00:12:40.040 --rc genhtml_function_coverage=1 00:12:40.040 --rc genhtml_legend=1 00:12:40.040 --rc geninfo_all_blocks=1 00:12:40.040 --rc geninfo_unexecuted_blocks=1 00:12:40.040 00:12:40.040 ' 00:12:40.040 16:54:51 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:40.040 16:54:51 -- nvmf/common.sh@7 -- # uname -s 00:12:40.040 16:54:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:40.040 16:54:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:40.040 16:54:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:40.040 16:54:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:40.040 16:54:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:40.040 16:54:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:40.040 16:54:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:40.040 16:54:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:40.040 16:54:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:40.040 16:54:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:40.040 16:54:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:40.040 16:54:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:40.040 16:54:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:40.040 16:54:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:40.040 16:54:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:40.040 16:54:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:40.040 16:54:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:40.040 16:54:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:40.040 16:54:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:40.040 16:54:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.040 16:54:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.040 16:54:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.040 16:54:51 -- paths/export.sh@5 -- # export PATH 00:12:40.041 16:54:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.041 16:54:51 -- nvmf/common.sh@46 -- # : 0 00:12:40.041 16:54:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:40.041 16:54:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:40.041 16:54:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:40.041 16:54:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:40.041 16:54:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:40.041 16:54:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:40.041 16:54:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:40.041 16:54:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:40.041 16:54:51 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:40.041 16:54:51 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:40.041 16:54:51 -- target/abort.sh@14 -- # nvmftestinit 00:12:40.041 16:54:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:40.041 16:54:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:40.041 16:54:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:40.041 16:54:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:40.041 16:54:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:40.041 16:54:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:40.041 16:54:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:40.041 16:54:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:40.041 16:54:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:40.041 16:54:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:40.041 16:54:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:40.041 16:54:51 -- common/autotest_common.sh@10 -- # set +x 00:12:42.573 16:54:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:42.573 16:54:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:42.573 16:54:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:42.573 16:54:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:42.573 16:54:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:42.573 16:54:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:42.573 16:54:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:42.573 16:54:53 -- nvmf/common.sh@294 -- # net_devs=() 00:12:42.573 16:54:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:42.573 16:54:53 -- nvmf/common.sh@295 -- # e810=() 00:12:42.573 16:54:53 -- nvmf/common.sh@295 -- # local -ga e810 00:12:42.573 16:54:53 -- nvmf/common.sh@296 -- # x722=() 00:12:42.573 16:54:53 -- nvmf/common.sh@296 -- # local -ga x722 00:12:42.573 16:54:53 -- nvmf/common.sh@297 -- # mlx=() 00:12:42.573 16:54:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:42.573 16:54:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:42.573 16:54:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:42.573 16:54:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:42.573 16:54:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:42.573 16:54:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:42.573 16:54:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:42.573 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:42.573 16:54:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:42.573 16:54:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:42.573 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:42.573 16:54:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:42.573 16:54:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:42.573 16:54:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:42.573 16:54:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:42.573 16:54:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:42.573 16:54:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:42.573 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:42.573 16:54:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:42.573 16:54:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:42.573 16:54:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:42.573 16:54:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:42.573 16:54:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:42.573 16:54:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:42.573 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:42.573 16:54:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:42.573 16:54:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:42.573 16:54:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:42.573 16:54:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:42.573 16:54:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:42.573 16:54:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:42.573 16:54:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:42.573 16:54:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:42.573 16:54:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:42.573 16:54:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:42.573 16:54:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:42.573 16:54:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:42.573 16:54:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:42.573 16:54:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:42.573 16:54:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:42.573 16:54:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:42.573 16:54:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:42.573 16:54:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:42.573 16:54:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:42.573 16:54:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:42.573 16:54:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:42.573 16:54:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:42.573 16:54:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:42.573 16:54:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:42.573 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:42.573 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:12:42.573 00:12:42.573 --- 10.0.0.2 ping statistics --- 00:12:42.573 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:42.573 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:12:42.573 16:54:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:42.573 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:42.573 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:12:42.573 00:12:42.573 --- 10.0.0.1 ping statistics --- 00:12:42.573 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:42.573 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:12:42.573 16:54:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:42.573 16:54:53 -- nvmf/common.sh@410 -- # return 0 00:12:42.573 16:54:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:42.573 16:54:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:42.573 16:54:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:42.573 16:54:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:42.573 16:54:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:42.573 16:54:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:42.573 16:54:53 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:42.573 16:54:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:42.573 16:54:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:42.573 16:54:53 -- common/autotest_common.sh@10 -- # set +x 00:12:42.573 16:54:53 -- nvmf/common.sh@469 -- # nvmfpid=159499 00:12:42.573 16:54:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:42.574 16:54:53 -- nvmf/common.sh@470 -- # waitforlisten 159499 00:12:42.574 16:54:53 -- common/autotest_common.sh@829 -- # '[' -z 159499 ']' 00:12:42.574 16:54:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:42.574 16:54:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:42.574 16:54:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:42.574 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:42.574 16:54:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:42.574 16:54:53 -- common/autotest_common.sh@10 -- # set +x 00:12:42.574 [2024-11-29 16:54:53.700999] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:42.574 [2024-11-29 16:54:53.701109] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:42.574 EAL: No free 2048 kB hugepages reported on node 1 00:12:42.574 [2024-11-29 16:54:53.764509] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:42.574 [2024-11-29 16:54:53.873487] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:42.574 [2024-11-29 16:54:53.873657] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:42.574 [2024-11-29 16:54:53.873675] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:42.574 [2024-11-29 16:54:53.873688] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:42.574 [2024-11-29 16:54:53.873775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:42.574 [2024-11-29 16:54:53.873800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:42.574 [2024-11-29 16:54:53.873804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:43.508 16:54:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:43.508 16:54:54 -- common/autotest_common.sh@862 -- # return 0 00:12:43.508 16:54:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:43.508 16:54:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:43.508 16:54:54 -- common/autotest_common.sh@10 -- # set +x 00:12:43.508 16:54:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:43.508 16:54:54 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:43.508 16:54:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.508 16:54:54 -- common/autotest_common.sh@10 -- # set +x 00:12:43.508 [2024-11-29 16:54:54.754881] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:43.508 16:54:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.508 16:54:54 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:43.508 16:54:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.508 16:54:54 -- common/autotest_common.sh@10 -- # set +x 00:12:43.508 Malloc0 00:12:43.508 16:54:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.508 16:54:54 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:43.508 16:54:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.508 16:54:54 -- common/autotest_common.sh@10 -- # set +x 00:12:43.508 Delay0 00:12:43.508 16:54:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.508 16:54:54 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:43.508 16:54:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.508 16:54:54 -- common/autotest_common.sh@10 -- # set +x 00:12:43.508 16:54:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.508 16:54:54 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:43.508 16:54:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.508 16:54:54 -- common/autotest_common.sh@10 -- # set +x 00:12:43.508 16:54:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.508 16:54:54 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:43.508 16:54:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.508 16:54:54 -- common/autotest_common.sh@10 -- # set +x 00:12:43.508 [2024-11-29 16:54:54.826395] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:43.508 16:54:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.509 16:54:54 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:43.509 16:54:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.509 16:54:54 -- common/autotest_common.sh@10 -- # set +x 00:12:43.509 16:54:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.509 16:54:54 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:43.509 EAL: No free 2048 kB hugepages reported on node 1 00:12:43.509 [2024-11-29 16:54:54.930810] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:46.038 Initializing NVMe Controllers 00:12:46.038 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:46.038 controller IO queue size 128 less than required 00:12:46.038 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:46.038 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:46.038 Initialization complete. Launching workers. 00:12:46.038 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34157 00:12:46.038 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34218, failed to submit 62 00:12:46.038 success 34157, unsuccess 61, failed 0 00:12:46.038 16:54:57 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:46.038 16:54:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:46.038 16:54:57 -- common/autotest_common.sh@10 -- # set +x 00:12:46.038 16:54:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:46.038 16:54:57 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:46.038 16:54:57 -- target/abort.sh@38 -- # nvmftestfini 00:12:46.038 16:54:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:46.038 16:54:57 -- nvmf/common.sh@116 -- # sync 00:12:46.038 16:54:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:46.038 16:54:57 -- nvmf/common.sh@119 -- # set +e 00:12:46.038 16:54:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:46.038 16:54:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:46.038 rmmod nvme_tcp 00:12:46.038 rmmod nvme_fabrics 00:12:46.038 rmmod nvme_keyring 00:12:46.038 16:54:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:46.038 16:54:57 -- nvmf/common.sh@123 -- # set -e 00:12:46.038 16:54:57 -- nvmf/common.sh@124 -- # return 0 00:12:46.038 16:54:57 -- nvmf/common.sh@477 -- # '[' -n 159499 ']' 00:12:46.038 16:54:57 -- nvmf/common.sh@478 -- # killprocess 159499 00:12:46.038 16:54:57 -- common/autotest_common.sh@936 -- # '[' -z 159499 ']' 00:12:46.038 16:54:57 -- common/autotest_common.sh@940 -- # kill -0 159499 00:12:46.038 16:54:57 -- common/autotest_common.sh@941 -- # uname 00:12:46.038 16:54:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:46.038 16:54:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 159499 00:12:46.038 16:54:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:46.038 16:54:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:46.038 16:54:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 159499' 00:12:46.038 killing process with pid 159499 00:12:46.038 16:54:57 -- common/autotest_common.sh@955 -- # kill 159499 00:12:46.038 16:54:57 -- common/autotest_common.sh@960 -- # wait 159499 00:12:46.038 16:54:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:46.038 16:54:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:46.038 16:54:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:46.038 16:54:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:46.038 16:54:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:46.038 16:54:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:46.038 16:54:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:46.038 16:54:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:48.576 16:54:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:48.576 00:12:48.576 real 0m8.286s 00:12:48.576 user 0m13.467s 00:12:48.576 sys 0m2.416s 00:12:48.576 16:54:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:48.576 16:54:59 -- common/autotest_common.sh@10 -- # set +x 00:12:48.576 ************************************ 00:12:48.576 END TEST nvmf_abort 00:12:48.576 ************************************ 00:12:48.576 16:54:59 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:48.576 16:54:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:48.576 16:54:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:48.576 16:54:59 -- common/autotest_common.sh@10 -- # set +x 00:12:48.576 ************************************ 00:12:48.576 START TEST nvmf_ns_hotplug_stress 00:12:48.576 ************************************ 00:12:48.576 16:54:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:48.576 * Looking for test storage... 00:12:48.576 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:48.576 16:54:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:48.576 16:54:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:48.576 16:54:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:48.576 16:54:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:48.576 16:54:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:48.576 16:54:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:48.576 16:54:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:48.576 16:54:59 -- scripts/common.sh@335 -- # IFS=.-: 00:12:48.576 16:54:59 -- scripts/common.sh@335 -- # read -ra ver1 00:12:48.576 16:54:59 -- scripts/common.sh@336 -- # IFS=.-: 00:12:48.576 16:54:59 -- scripts/common.sh@336 -- # read -ra ver2 00:12:48.576 16:54:59 -- scripts/common.sh@337 -- # local 'op=<' 00:12:48.576 16:54:59 -- scripts/common.sh@339 -- # ver1_l=2 00:12:48.576 16:54:59 -- scripts/common.sh@340 -- # ver2_l=1 00:12:48.576 16:54:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:48.576 16:54:59 -- scripts/common.sh@343 -- # case "$op" in 00:12:48.576 16:54:59 -- scripts/common.sh@344 -- # : 1 00:12:48.576 16:54:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:48.576 16:54:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:48.576 16:54:59 -- scripts/common.sh@364 -- # decimal 1 00:12:48.576 16:54:59 -- scripts/common.sh@352 -- # local d=1 00:12:48.576 16:54:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:48.576 16:54:59 -- scripts/common.sh@354 -- # echo 1 00:12:48.576 16:54:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:48.576 16:54:59 -- scripts/common.sh@365 -- # decimal 2 00:12:48.576 16:54:59 -- scripts/common.sh@352 -- # local d=2 00:12:48.576 16:54:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:48.576 16:54:59 -- scripts/common.sh@354 -- # echo 2 00:12:48.576 16:54:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:48.576 16:54:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:48.576 16:54:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:48.576 16:54:59 -- scripts/common.sh@367 -- # return 0 00:12:48.576 16:54:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:48.576 16:54:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:48.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:48.576 --rc genhtml_branch_coverage=1 00:12:48.576 --rc genhtml_function_coverage=1 00:12:48.576 --rc genhtml_legend=1 00:12:48.576 --rc geninfo_all_blocks=1 00:12:48.576 --rc geninfo_unexecuted_blocks=1 00:12:48.576 00:12:48.576 ' 00:12:48.576 16:54:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:48.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:48.576 --rc genhtml_branch_coverage=1 00:12:48.576 --rc genhtml_function_coverage=1 00:12:48.576 --rc genhtml_legend=1 00:12:48.576 --rc geninfo_all_blocks=1 00:12:48.576 --rc geninfo_unexecuted_blocks=1 00:12:48.576 00:12:48.576 ' 00:12:48.576 16:54:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:48.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:48.576 --rc genhtml_branch_coverage=1 00:12:48.576 --rc genhtml_function_coverage=1 00:12:48.576 --rc genhtml_legend=1 00:12:48.576 --rc geninfo_all_blocks=1 00:12:48.576 --rc geninfo_unexecuted_blocks=1 00:12:48.576 00:12:48.576 ' 00:12:48.576 16:54:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:48.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:48.576 --rc genhtml_branch_coverage=1 00:12:48.576 --rc genhtml_function_coverage=1 00:12:48.576 --rc genhtml_legend=1 00:12:48.576 --rc geninfo_all_blocks=1 00:12:48.576 --rc geninfo_unexecuted_blocks=1 00:12:48.576 00:12:48.576 ' 00:12:48.576 16:54:59 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:48.576 16:54:59 -- nvmf/common.sh@7 -- # uname -s 00:12:48.576 16:54:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:48.576 16:54:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:48.576 16:54:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:48.576 16:54:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:48.576 16:54:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:48.576 16:54:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:48.576 16:54:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:48.576 16:54:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:48.576 16:54:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:48.576 16:54:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:48.576 16:54:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:48.576 16:54:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:48.576 16:54:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:48.576 16:54:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:48.576 16:54:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:48.576 16:54:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:48.576 16:54:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:48.576 16:54:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:48.576 16:54:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:48.576 16:54:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.576 16:54:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.576 16:54:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.576 16:54:59 -- paths/export.sh@5 -- # export PATH 00:12:48.576 16:54:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.576 16:54:59 -- nvmf/common.sh@46 -- # : 0 00:12:48.576 16:54:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:48.576 16:54:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:48.576 16:54:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:48.576 16:54:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:48.577 16:54:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:48.577 16:54:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:48.577 16:54:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:48.577 16:54:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:48.577 16:54:59 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:48.577 16:54:59 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:48.577 16:54:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:48.577 16:54:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:48.577 16:54:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:48.577 16:54:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:48.577 16:54:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:48.577 16:54:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:48.577 16:54:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:48.577 16:54:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:48.577 16:54:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:48.577 16:54:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:48.577 16:54:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:48.577 16:54:59 -- common/autotest_common.sh@10 -- # set +x 00:12:50.484 16:55:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:50.484 16:55:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:50.484 16:55:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:50.484 16:55:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:50.484 16:55:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:50.484 16:55:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:50.484 16:55:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:50.484 16:55:01 -- nvmf/common.sh@294 -- # net_devs=() 00:12:50.484 16:55:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:50.484 16:55:01 -- nvmf/common.sh@295 -- # e810=() 00:12:50.484 16:55:01 -- nvmf/common.sh@295 -- # local -ga e810 00:12:50.484 16:55:01 -- nvmf/common.sh@296 -- # x722=() 00:12:50.484 16:55:01 -- nvmf/common.sh@296 -- # local -ga x722 00:12:50.484 16:55:01 -- nvmf/common.sh@297 -- # mlx=() 00:12:50.484 16:55:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:50.484 16:55:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:50.484 16:55:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:50.484 16:55:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:50.484 16:55:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:50.484 16:55:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:50.484 16:55:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:50.484 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:50.484 16:55:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:50.484 16:55:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:50.484 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:50.484 16:55:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:50.484 16:55:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:50.484 16:55:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:50.484 16:55:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:50.484 16:55:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:50.484 16:55:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:50.484 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:50.484 16:55:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:50.484 16:55:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:50.484 16:55:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:50.484 16:55:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:50.484 16:55:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:50.484 16:55:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:50.484 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:50.484 16:55:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:50.484 16:55:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:50.484 16:55:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:50.484 16:55:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:50.484 16:55:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:50.484 16:55:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:50.484 16:55:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:50.484 16:55:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:50.484 16:55:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:50.484 16:55:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:50.484 16:55:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:50.484 16:55:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:50.484 16:55:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:50.484 16:55:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:50.484 16:55:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:50.484 16:55:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:50.484 16:55:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:50.484 16:55:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:50.484 16:55:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:50.484 16:55:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:50.484 16:55:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:50.484 16:55:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:50.741 16:55:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:50.741 16:55:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:50.741 16:55:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:50.741 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:50.741 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:12:50.741 00:12:50.741 --- 10.0.0.2 ping statistics --- 00:12:50.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:50.741 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:12:50.741 16:55:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:50.741 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:50.741 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:12:50.741 00:12:50.741 --- 10.0.0.1 ping statistics --- 00:12:50.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:50.741 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:12:50.741 16:55:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:50.741 16:55:01 -- nvmf/common.sh@410 -- # return 0 00:12:50.741 16:55:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:50.741 16:55:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:50.741 16:55:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:50.741 16:55:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:50.741 16:55:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:50.741 16:55:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:50.741 16:55:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:50.741 16:55:01 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:50.741 16:55:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:50.741 16:55:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:50.741 16:55:01 -- common/autotest_common.sh@10 -- # set +x 00:12:50.741 16:55:01 -- nvmf/common.sh@469 -- # nvmfpid=161889 00:12:50.741 16:55:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:50.741 16:55:01 -- nvmf/common.sh@470 -- # waitforlisten 161889 00:12:50.741 16:55:01 -- common/autotest_common.sh@829 -- # '[' -z 161889 ']' 00:12:50.741 16:55:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:50.741 16:55:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:50.741 16:55:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:50.741 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:50.741 16:55:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:50.741 16:55:01 -- common/autotest_common.sh@10 -- # set +x 00:12:50.741 [2024-11-29 16:55:02.021136] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:50.741 [2024-11-29 16:55:02.021238] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:50.741 EAL: No free 2048 kB hugepages reported on node 1 00:12:50.741 [2024-11-29 16:55:02.084911] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:50.999 [2024-11-29 16:55:02.193505] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:50.999 [2024-11-29 16:55:02.193663] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:50.999 [2024-11-29 16:55:02.193680] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:50.999 [2024-11-29 16:55:02.193692] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:50.999 [2024-11-29 16:55:02.193789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:50.999 [2024-11-29 16:55:02.193845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:50.999 [2024-11-29 16:55:02.193848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:51.930 16:55:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:51.930 16:55:03 -- common/autotest_common.sh@862 -- # return 0 00:12:51.930 16:55:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:51.930 16:55:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:51.930 16:55:03 -- common/autotest_common.sh@10 -- # set +x 00:12:51.930 16:55:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:51.930 16:55:03 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:51.930 16:55:03 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:51.930 [2024-11-29 16:55:03.282182] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:51.930 16:55:03 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:52.188 16:55:03 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:52.446 [2024-11-29 16:55:03.793325] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:52.446 16:55:03 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:52.703 16:55:04 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:52.961 Malloc0 00:12:52.961 16:55:04 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:53.218 Delay0 00:12:53.218 16:55:04 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.476 16:55:04 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:53.734 NULL1 00:12:53.734 16:55:05 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:53.992 16:55:05 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=162330 00:12:53.992 16:55:05 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:53.992 16:55:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:12:53.992 16:55:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.992 EAL: No free 2048 kB hugepages reported on node 1 00:12:54.249 16:55:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.507 16:55:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:54.507 16:55:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:54.765 true 00:12:54.765 16:55:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:12:54.765 16:55:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.023 16:55:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.281 16:55:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:55.281 16:55:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:55.539 true 00:12:55.539 16:55:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:12:55.539 16:55:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.474 Read completed with error (sct=0, sc=11) 00:12:56.474 16:55:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.474 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.474 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.732 16:55:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:56.732 16:55:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:56.990 true 00:12:56.990 16:55:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:12:56.990 16:55:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.248 16:55:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.506 16:55:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:57.506 16:55:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:57.763 true 00:12:57.763 16:55:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:12:57.763 16:55:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.697 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:58.697 16:55:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.697 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:58.955 16:55:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:58.955 16:55:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:59.212 true 00:12:59.212 16:55:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:12:59.212 16:55:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.470 16:55:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.729 16:55:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:59.729 16:55:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:59.987 true 00:12:59.987 16:55:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:12:59.987 16:55:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.919 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:00.919 16:55:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.919 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:00.919 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:00.919 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:01.177 16:55:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:13:01.177 16:55:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:01.435 true 00:13:01.435 16:55:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:01.435 16:55:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.693 16:55:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.951 16:55:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:13:01.951 16:55:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:01.951 true 00:13:02.208 16:55:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:02.208 16:55:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.140 16:55:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.397 16:55:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:13:03.397 16:55:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:03.655 true 00:13:03.655 16:55:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:03.655 16:55:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.913 16:55:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.170 16:55:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:13:04.170 16:55:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:04.428 true 00:13:04.428 16:55:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:04.428 16:55:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.390 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:05.390 16:55:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.390 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:05.390 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:05.390 16:55:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:05.390 16:55:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:05.648 true 00:13:05.648 16:55:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:05.648 16:55:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.905 16:55:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.163 16:55:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:06.163 16:55:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:06.421 true 00:13:06.421 16:55:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:06.421 16:55:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.353 16:55:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.612 16:55:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:07.612 16:55:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:07.869 true 00:13:07.869 16:55:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:07.869 16:55:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.126 16:55:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.382 16:55:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:08.382 16:55:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:08.640 true 00:13:08.640 16:55:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:08.640 16:55:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.572 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.572 16:55:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.830 16:55:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:09.830 16:55:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:10.088 true 00:13:10.088 16:55:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:10.088 16:55:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.345 16:55:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.603 16:55:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:10.603 16:55:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:10.860 true 00:13:10.860 16:55:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:10.860 16:55:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.117 16:55:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.374 16:55:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:11.374 16:55:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:11.631 true 00:13:11.631 16:55:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:11.631 16:55:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.565 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.565 16:55:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.565 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.565 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.565 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.823 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.823 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.823 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.823 16:55:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:12.823 16:55:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:13.080 true 00:13:13.080 16:55:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:13.080 16:55:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.012 16:55:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.012 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.012 16:55:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:14.012 16:55:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:14.268 true 00:13:14.268 16:55:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:14.268 16:55:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.525 16:55:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.783 16:55:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:14.783 16:55:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:15.041 true 00:13:15.041 16:55:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:15.041 16:55:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.975 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.975 16:55:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:16.233 16:55:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:16.233 16:55:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:16.491 true 00:13:16.491 16:55:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:16.491 16:55:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.748 16:55:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.006 16:55:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:17.006 16:55:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:17.263 true 00:13:17.263 16:55:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:17.263 16:55:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.196 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.196 16:55:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:18.196 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.196 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.454 16:55:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:18.454 16:55:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:18.712 true 00:13:18.712 16:55:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:18.712 16:55:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.970 16:55:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:19.228 16:55:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:19.228 16:55:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:19.486 true 00:13:19.486 16:55:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:19.486 16:55:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.420 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:20.420 16:55:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:20.678 16:55:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:20.678 16:55:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:20.935 true 00:13:20.935 16:55:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:20.935 16:55:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.194 16:55:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:21.452 16:55:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:21.452 16:55:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:21.710 true 00:13:21.710 16:55:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:21.710 16:55:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.644 16:55:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:22.644 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:22.644 16:55:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:22.644 16:55:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:22.901 true 00:13:22.901 16:55:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:22.901 16:55:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.159 16:55:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:23.417 16:55:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:23.417 16:55:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:23.674 true 00:13:23.674 16:55:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:23.674 16:55:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.930 16:55:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:24.187 16:55:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:24.187 16:55:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:24.444 true 00:13:24.444 16:55:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:24.444 16:55:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.376 16:55:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:25.634 Initializing NVMe Controllers 00:13:25.634 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:25.634 Controller IO queue size 128, less than required. 00:13:25.634 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:25.634 Controller IO queue size 128, less than required. 00:13:25.634 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:25.634 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:25.634 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:25.634 Initialization complete. Launching workers. 00:13:25.634 ======================================================== 00:13:25.634 Latency(us) 00:13:25.634 Device Information : IOPS MiB/s Average min max 00:13:25.634 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 960.15 0.47 70401.52 2243.94 1080801.81 00:13:25.634 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11292.00 5.51 11302.75 1617.54 361527.22 00:13:25.634 ======================================================== 00:13:25.634 Total : 12252.14 5.98 15934.06 1617.54 1080801.81 00:13:25.634 00:13:25.634 16:55:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:13:25.634 16:55:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:13:25.892 true 00:13:25.892 16:55:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162330 00:13:25.892 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (162330) - No such process 00:13:25.892 16:55:37 -- target/ns_hotplug_stress.sh@53 -- # wait 162330 00:13:25.892 16:55:37 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.150 16:55:37 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:26.408 16:55:37 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:26.408 16:55:37 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:26.408 16:55:37 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:26.408 16:55:37 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:26.408 16:55:37 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:26.665 null0 00:13:26.665 16:55:38 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:26.665 16:55:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:26.665 16:55:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:26.923 null1 00:13:26.923 16:55:38 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:26.923 16:55:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:26.923 16:55:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:27.181 null2 00:13:27.181 16:55:38 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:27.181 16:55:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:27.181 16:55:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:27.440 null3 00:13:27.440 16:55:38 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:27.440 16:55:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:27.440 16:55:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:27.699 null4 00:13:27.699 16:55:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:27.699 16:55:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:27.699 16:55:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:27.957 null5 00:13:27.957 16:55:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:27.957 16:55:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:27.957 16:55:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:28.215 null6 00:13:28.215 16:55:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:28.215 16:55:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:28.215 16:55:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:28.474 null7 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@66 -- # wait 166623 166624 166626 166628 166630 166632 166634 166636 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.474 16:55:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:28.732 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:28.732 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:28.732 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:28.733 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:28.733 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:28.733 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:28.733 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:28.733 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.991 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:29.249 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:29.249 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:29.249 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.249 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:29.249 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:29.249 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:29.249 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:29.249 16:55:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:29.508 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:29.767 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:29.767 16:55:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:29.767 16:55:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:29.767 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:30.025 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:30.025 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:30.025 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:30.025 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:30.025 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:30.025 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:30.025 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.284 16:55:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:30.542 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:30.542 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:30.542 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:30.542 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:30.542 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:30.542 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:30.542 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:30.543 16:55:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:30.801 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:31.060 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:31.060 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:31.060 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.060 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:31.060 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:31.060 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:31.060 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:31.060 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.318 16:55:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:31.577 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.577 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:31.577 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:31.577 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:31.577 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:31.577 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:31.577 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:31.577 16:55:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:31.835 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.835 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.835 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:31.835 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.835 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.835 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:31.835 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.835 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.835 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:31.836 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:32.094 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.094 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:32.094 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:32.094 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:32.094 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:32.094 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:32.094 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:32.094 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.352 16:55:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:32.611 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.611 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:32.611 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:32.611 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:32.611 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:32.611 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:32.611 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:32.611 16:55:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:32.869 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:33.128 16:55:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.128 16:55:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:33.128 16:55:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:33.128 16:55:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:33.128 16:55:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:33.128 16:55:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:33.128 16:55:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:33.128 16:55:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:33.386 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:33.386 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:33.387 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:33.645 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:33.645 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:33.645 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:33.645 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:33.645 16:55:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:33.645 16:55:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:33.645 16:55:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.902 16:55:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:33.902 16:55:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:33.902 16:55:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:33.902 16:55:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:33.902 16:55:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:33.902 16:55:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:33.902 16:55:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:34.159 16:55:45 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:34.159 16:55:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:34.159 16:55:45 -- nvmf/common.sh@116 -- # sync 00:13:34.159 16:55:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:34.159 16:55:45 -- nvmf/common.sh@119 -- # set +e 00:13:34.159 16:55:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:34.159 16:55:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:34.159 rmmod nvme_tcp 00:13:34.159 rmmod nvme_fabrics 00:13:34.159 rmmod nvme_keyring 00:13:34.159 16:55:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:34.159 16:55:45 -- nvmf/common.sh@123 -- # set -e 00:13:34.159 16:55:45 -- nvmf/common.sh@124 -- # return 0 00:13:34.159 16:55:45 -- nvmf/common.sh@477 -- # '[' -n 161889 ']' 00:13:34.159 16:55:45 -- nvmf/common.sh@478 -- # killprocess 161889 00:13:34.159 16:55:45 -- common/autotest_common.sh@936 -- # '[' -z 161889 ']' 00:13:34.159 16:55:45 -- common/autotest_common.sh@940 -- # kill -0 161889 00:13:34.159 16:55:45 -- common/autotest_common.sh@941 -- # uname 00:13:34.159 16:55:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:34.159 16:55:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 161889 00:13:34.159 16:55:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:34.159 16:55:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:34.159 16:55:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 161889' 00:13:34.159 killing process with pid 161889 00:13:34.159 16:55:45 -- common/autotest_common.sh@955 -- # kill 161889 00:13:34.159 16:55:45 -- common/autotest_common.sh@960 -- # wait 161889 00:13:34.417 16:55:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:34.417 16:55:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:34.417 16:55:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:34.417 16:55:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:34.417 16:55:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:34.417 16:55:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:34.417 16:55:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:34.417 16:55:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:36.949 16:55:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:36.949 00:13:36.949 real 0m48.289s 00:13:36.949 user 3m40.175s 00:13:36.949 sys 0m15.633s 00:13:36.949 16:55:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:36.949 16:55:47 -- common/autotest_common.sh@10 -- # set +x 00:13:36.949 ************************************ 00:13:36.949 END TEST nvmf_ns_hotplug_stress 00:13:36.949 ************************************ 00:13:36.949 16:55:47 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:36.949 16:55:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:36.949 16:55:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:36.949 16:55:47 -- common/autotest_common.sh@10 -- # set +x 00:13:36.949 ************************************ 00:13:36.949 START TEST nvmf_connect_stress 00:13:36.949 ************************************ 00:13:36.949 16:55:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:36.949 * Looking for test storage... 00:13:36.949 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:36.949 16:55:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:36.949 16:55:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:36.949 16:55:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:36.949 16:55:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:36.949 16:55:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:36.949 16:55:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:36.949 16:55:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:36.949 16:55:47 -- scripts/common.sh@335 -- # IFS=.-: 00:13:36.949 16:55:47 -- scripts/common.sh@335 -- # read -ra ver1 00:13:36.949 16:55:47 -- scripts/common.sh@336 -- # IFS=.-: 00:13:36.949 16:55:47 -- scripts/common.sh@336 -- # read -ra ver2 00:13:36.949 16:55:47 -- scripts/common.sh@337 -- # local 'op=<' 00:13:36.949 16:55:47 -- scripts/common.sh@339 -- # ver1_l=2 00:13:36.949 16:55:47 -- scripts/common.sh@340 -- # ver2_l=1 00:13:36.949 16:55:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:36.949 16:55:47 -- scripts/common.sh@343 -- # case "$op" in 00:13:36.949 16:55:47 -- scripts/common.sh@344 -- # : 1 00:13:36.949 16:55:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:36.949 16:55:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:36.949 16:55:47 -- scripts/common.sh@364 -- # decimal 1 00:13:36.949 16:55:47 -- scripts/common.sh@352 -- # local d=1 00:13:36.949 16:55:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:36.949 16:55:47 -- scripts/common.sh@354 -- # echo 1 00:13:36.949 16:55:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:36.949 16:55:47 -- scripts/common.sh@365 -- # decimal 2 00:13:36.949 16:55:47 -- scripts/common.sh@352 -- # local d=2 00:13:36.949 16:55:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:36.949 16:55:47 -- scripts/common.sh@354 -- # echo 2 00:13:36.949 16:55:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:36.949 16:55:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:36.949 16:55:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:36.949 16:55:47 -- scripts/common.sh@367 -- # return 0 00:13:36.949 16:55:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:36.949 16:55:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:36.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:36.949 --rc genhtml_branch_coverage=1 00:13:36.949 --rc genhtml_function_coverage=1 00:13:36.949 --rc genhtml_legend=1 00:13:36.949 --rc geninfo_all_blocks=1 00:13:36.949 --rc geninfo_unexecuted_blocks=1 00:13:36.949 00:13:36.949 ' 00:13:36.949 16:55:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:36.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:36.949 --rc genhtml_branch_coverage=1 00:13:36.949 --rc genhtml_function_coverage=1 00:13:36.949 --rc genhtml_legend=1 00:13:36.949 --rc geninfo_all_blocks=1 00:13:36.949 --rc geninfo_unexecuted_blocks=1 00:13:36.949 00:13:36.949 ' 00:13:36.949 16:55:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:36.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:36.949 --rc genhtml_branch_coverage=1 00:13:36.949 --rc genhtml_function_coverage=1 00:13:36.949 --rc genhtml_legend=1 00:13:36.949 --rc geninfo_all_blocks=1 00:13:36.949 --rc geninfo_unexecuted_blocks=1 00:13:36.949 00:13:36.949 ' 00:13:36.949 16:55:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:36.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:36.949 --rc genhtml_branch_coverage=1 00:13:36.949 --rc genhtml_function_coverage=1 00:13:36.949 --rc genhtml_legend=1 00:13:36.949 --rc geninfo_all_blocks=1 00:13:36.949 --rc geninfo_unexecuted_blocks=1 00:13:36.949 00:13:36.949 ' 00:13:36.949 16:55:47 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:36.949 16:55:47 -- nvmf/common.sh@7 -- # uname -s 00:13:36.949 16:55:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:36.949 16:55:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:36.949 16:55:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:36.949 16:55:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:36.949 16:55:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:36.949 16:55:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:36.949 16:55:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:36.949 16:55:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:36.949 16:55:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:36.949 16:55:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:36.949 16:55:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:36.949 16:55:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:36.949 16:55:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:36.949 16:55:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:36.949 16:55:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:36.949 16:55:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:36.949 16:55:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:36.949 16:55:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:36.949 16:55:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:36.949 16:55:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.949 16:55:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.949 16:55:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.949 16:55:47 -- paths/export.sh@5 -- # export PATH 00:13:36.949 16:55:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.949 16:55:47 -- nvmf/common.sh@46 -- # : 0 00:13:36.949 16:55:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:36.949 16:55:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:36.949 16:55:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:36.949 16:55:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:36.949 16:55:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:36.949 16:55:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:36.949 16:55:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:36.949 16:55:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:36.949 16:55:47 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:36.949 16:55:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:36.949 16:55:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:36.949 16:55:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:36.949 16:55:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:36.949 16:55:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:36.949 16:55:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:36.949 16:55:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:36.949 16:55:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:36.949 16:55:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:36.949 16:55:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:36.949 16:55:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:36.949 16:55:47 -- common/autotest_common.sh@10 -- # set +x 00:13:38.851 16:55:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:38.851 16:55:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:38.851 16:55:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:38.851 16:55:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:38.851 16:55:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:38.851 16:55:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:38.851 16:55:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:38.851 16:55:50 -- nvmf/common.sh@294 -- # net_devs=() 00:13:38.851 16:55:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:38.851 16:55:50 -- nvmf/common.sh@295 -- # e810=() 00:13:38.851 16:55:50 -- nvmf/common.sh@295 -- # local -ga e810 00:13:38.851 16:55:50 -- nvmf/common.sh@296 -- # x722=() 00:13:38.851 16:55:50 -- nvmf/common.sh@296 -- # local -ga x722 00:13:38.851 16:55:50 -- nvmf/common.sh@297 -- # mlx=() 00:13:38.851 16:55:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:38.851 16:55:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:38.851 16:55:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:38.851 16:55:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:38.851 16:55:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:38.851 16:55:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:38.851 16:55:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:38.851 16:55:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:38.851 16:55:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:38.851 16:55:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:38.851 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:38.851 16:55:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:38.852 16:55:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:38.852 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:38.852 16:55:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:38.852 16:55:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:38.852 16:55:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:38.852 16:55:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:38.852 16:55:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:38.852 16:55:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:38.852 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:38.852 16:55:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:38.852 16:55:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:38.852 16:55:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:38.852 16:55:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:38.852 16:55:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:38.852 16:55:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:38.852 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:38.852 16:55:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:38.852 16:55:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:38.852 16:55:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:38.852 16:55:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:38.852 16:55:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:38.852 16:55:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:38.852 16:55:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:38.852 16:55:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:38.852 16:55:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:38.852 16:55:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:38.852 16:55:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:38.852 16:55:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:38.852 16:55:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:38.852 16:55:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:38.852 16:55:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:38.852 16:55:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:38.852 16:55:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:38.852 16:55:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:38.852 16:55:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:38.852 16:55:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:38.852 16:55:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:38.852 16:55:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:38.852 16:55:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:38.852 16:55:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:38.852 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:38.852 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:13:38.852 00:13:38.852 --- 10.0.0.2 ping statistics --- 00:13:38.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:38.852 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:13:38.852 16:55:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:38.852 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:38.852 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:13:38.852 00:13:38.852 --- 10.0.0.1 ping statistics --- 00:13:38.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:38.852 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:13:38.852 16:55:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:38.852 16:55:50 -- nvmf/common.sh@410 -- # return 0 00:13:38.852 16:55:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:38.852 16:55:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:38.852 16:55:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:38.852 16:55:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:38.852 16:55:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:38.852 16:55:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:38.852 16:55:50 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:38.852 16:55:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:38.852 16:55:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:38.852 16:55:50 -- common/autotest_common.sh@10 -- # set +x 00:13:38.852 16:55:50 -- nvmf/common.sh@469 -- # nvmfpid=169463 00:13:38.852 16:55:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:38.852 16:55:50 -- nvmf/common.sh@470 -- # waitforlisten 169463 00:13:38.852 16:55:50 -- common/autotest_common.sh@829 -- # '[' -z 169463 ']' 00:13:38.852 16:55:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:38.852 16:55:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:38.852 16:55:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:38.852 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:38.852 16:55:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:38.852 16:55:50 -- common/autotest_common.sh@10 -- # set +x 00:13:38.852 [2024-11-29 16:55:50.235838] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:38.852 [2024-11-29 16:55:50.235911] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:38.852 EAL: No free 2048 kB hugepages reported on node 1 00:13:39.111 [2024-11-29 16:55:50.306933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:39.111 [2024-11-29 16:55:50.422467] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:39.111 [2024-11-29 16:55:50.422626] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:39.111 [2024-11-29 16:55:50.422644] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:39.111 [2024-11-29 16:55:50.422657] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:39.111 [2024-11-29 16:55:50.422739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:39.111 [2024-11-29 16:55:50.422762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:39.111 [2024-11-29 16:55:50.422765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:40.044 16:55:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:40.044 16:55:51 -- common/autotest_common.sh@862 -- # return 0 00:13:40.044 16:55:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:40.044 16:55:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:40.044 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:13:40.044 16:55:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:40.044 16:55:51 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:40.044 16:55:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.044 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:13:40.044 [2024-11-29 16:55:51.243708] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:40.044 16:55:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.044 16:55:51 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:40.044 16:55:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.044 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:13:40.044 16:55:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.044 16:55:51 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:40.044 16:55:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.044 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:13:40.044 [2024-11-29 16:55:51.274114] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:40.044 16:55:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.044 16:55:51 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:40.044 16:55:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.044 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:13:40.044 NULL1 00:13:40.044 16:55:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.044 16:55:51 -- target/connect_stress.sh@21 -- # PERF_PID=169600 00:13:40.044 16:55:51 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:40.044 16:55:51 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:40.044 16:55:51 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 EAL: No free 2048 kB hugepages reported on node 1 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:40.044 16:55:51 -- target/connect_stress.sh@28 -- # cat 00:13:40.044 16:55:51 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:40.044 16:55:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.044 16:55:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.044 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:13:40.301 16:55:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.301 16:55:51 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:40.301 16:55:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.301 16:55:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.301 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:13:40.559 16:55:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.559 16:55:51 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:40.559 16:55:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.559 16:55:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.559 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:13:41.124 16:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.124 16:55:52 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:41.124 16:55:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.124 16:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.124 16:55:52 -- common/autotest_common.sh@10 -- # set +x 00:13:41.381 16:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.381 16:55:52 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:41.381 16:55:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.381 16:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.381 16:55:52 -- common/autotest_common.sh@10 -- # set +x 00:13:41.639 16:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.639 16:55:52 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:41.639 16:55:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.639 16:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.639 16:55:52 -- common/autotest_common.sh@10 -- # set +x 00:13:41.897 16:55:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.898 16:55:53 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:41.898 16:55:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.898 16:55:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.898 16:55:53 -- common/autotest_common.sh@10 -- # set +x 00:13:42.155 16:55:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.155 16:55:53 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:42.155 16:55:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.155 16:55:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.155 16:55:53 -- common/autotest_common.sh@10 -- # set +x 00:13:42.721 16:55:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.721 16:55:53 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:42.721 16:55:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.721 16:55:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.721 16:55:53 -- common/autotest_common.sh@10 -- # set +x 00:13:42.978 16:55:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.979 16:55:54 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:42.979 16:55:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.979 16:55:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.979 16:55:54 -- common/autotest_common.sh@10 -- # set +x 00:13:43.236 16:55:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.236 16:55:54 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:43.236 16:55:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.236 16:55:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.236 16:55:54 -- common/autotest_common.sh@10 -- # set +x 00:13:43.494 16:55:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.494 16:55:54 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:43.494 16:55:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.494 16:55:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.494 16:55:54 -- common/autotest_common.sh@10 -- # set +x 00:13:44.058 16:55:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.058 16:55:55 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:44.058 16:55:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:44.058 16:55:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.058 16:55:55 -- common/autotest_common.sh@10 -- # set +x 00:13:44.315 16:55:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.315 16:55:55 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:44.315 16:55:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:44.315 16:55:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.315 16:55:55 -- common/autotest_common.sh@10 -- # set +x 00:13:44.573 16:55:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.573 16:55:55 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:44.573 16:55:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:44.573 16:55:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.573 16:55:55 -- common/autotest_common.sh@10 -- # set +x 00:13:44.831 16:55:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.831 16:55:56 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:44.831 16:55:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:44.831 16:55:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.831 16:55:56 -- common/autotest_common.sh@10 -- # set +x 00:13:45.088 16:55:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.089 16:55:56 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:45.089 16:55:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:45.089 16:55:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.089 16:55:56 -- common/autotest_common.sh@10 -- # set +x 00:13:45.654 16:55:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.654 16:55:56 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:45.654 16:55:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:45.654 16:55:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.654 16:55:56 -- common/autotest_common.sh@10 -- # set +x 00:13:45.912 16:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.912 16:55:57 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:45.912 16:55:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:45.912 16:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.912 16:55:57 -- common/autotest_common.sh@10 -- # set +x 00:13:46.170 16:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.170 16:55:57 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:46.170 16:55:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:46.170 16:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.170 16:55:57 -- common/autotest_common.sh@10 -- # set +x 00:13:46.427 16:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.427 16:55:57 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:46.427 16:55:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:46.427 16:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.427 16:55:57 -- common/autotest_common.sh@10 -- # set +x 00:13:46.686 16:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.686 16:55:58 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:46.686 16:55:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:46.686 16:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.686 16:55:58 -- common/autotest_common.sh@10 -- # set +x 00:13:47.251 16:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.251 16:55:58 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:47.251 16:55:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:47.251 16:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.251 16:55:58 -- common/autotest_common.sh@10 -- # set +x 00:13:47.509 16:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.509 16:55:58 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:47.509 16:55:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:47.509 16:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.509 16:55:58 -- common/autotest_common.sh@10 -- # set +x 00:13:47.766 16:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.767 16:55:59 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:47.767 16:55:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:47.767 16:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.767 16:55:59 -- common/autotest_common.sh@10 -- # set +x 00:13:48.024 16:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.024 16:55:59 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:48.024 16:55:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:48.024 16:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.024 16:55:59 -- common/autotest_common.sh@10 -- # set +x 00:13:48.282 16:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.282 16:55:59 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:48.282 16:55:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:48.282 16:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.282 16:55:59 -- common/autotest_common.sh@10 -- # set +x 00:13:48.849 16:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.849 16:56:00 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:48.849 16:56:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:48.849 16:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.849 16:56:00 -- common/autotest_common.sh@10 -- # set +x 00:13:49.107 16:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.107 16:56:00 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:49.107 16:56:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:49.107 16:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.107 16:56:00 -- common/autotest_common.sh@10 -- # set +x 00:13:49.365 16:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.365 16:56:00 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:49.365 16:56:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:49.365 16:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.365 16:56:00 -- common/autotest_common.sh@10 -- # set +x 00:13:49.623 16:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.623 16:56:00 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:49.623 16:56:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:49.623 16:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.623 16:56:00 -- common/autotest_common.sh@10 -- # set +x 00:13:49.880 16:56:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.880 16:56:01 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:49.880 16:56:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:49.880 16:56:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.880 16:56:01 -- common/autotest_common.sh@10 -- # set +x 00:13:50.139 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:50.397 16:56:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.397 16:56:01 -- target/connect_stress.sh@34 -- # kill -0 169600 00:13:50.397 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (169600) - No such process 00:13:50.397 16:56:01 -- target/connect_stress.sh@38 -- # wait 169600 00:13:50.397 16:56:01 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:50.397 16:56:01 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:50.397 16:56:01 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:50.397 16:56:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:50.397 16:56:01 -- nvmf/common.sh@116 -- # sync 00:13:50.397 16:56:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:50.397 16:56:01 -- nvmf/common.sh@119 -- # set +e 00:13:50.397 16:56:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:50.397 16:56:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:50.397 rmmod nvme_tcp 00:13:50.397 rmmod nvme_fabrics 00:13:50.397 rmmod nvme_keyring 00:13:50.397 16:56:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:50.397 16:56:01 -- nvmf/common.sh@123 -- # set -e 00:13:50.397 16:56:01 -- nvmf/common.sh@124 -- # return 0 00:13:50.397 16:56:01 -- nvmf/common.sh@477 -- # '[' -n 169463 ']' 00:13:50.397 16:56:01 -- nvmf/common.sh@478 -- # killprocess 169463 00:13:50.397 16:56:01 -- common/autotest_common.sh@936 -- # '[' -z 169463 ']' 00:13:50.397 16:56:01 -- common/autotest_common.sh@940 -- # kill -0 169463 00:13:50.397 16:56:01 -- common/autotest_common.sh@941 -- # uname 00:13:50.397 16:56:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:50.397 16:56:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 169463 00:13:50.397 16:56:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:50.397 16:56:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:50.397 16:56:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 169463' 00:13:50.397 killing process with pid 169463 00:13:50.397 16:56:01 -- common/autotest_common.sh@955 -- # kill 169463 00:13:50.397 16:56:01 -- common/autotest_common.sh@960 -- # wait 169463 00:13:50.656 16:56:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:50.656 16:56:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:50.656 16:56:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:50.656 16:56:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:50.656 16:56:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:50.656 16:56:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.656 16:56:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:50.656 16:56:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.192 16:56:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:53.192 00:13:53.192 real 0m16.212s 00:13:53.192 user 0m42.645s 00:13:53.192 sys 0m4.410s 00:13:53.192 16:56:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:53.192 16:56:04 -- common/autotest_common.sh@10 -- # set +x 00:13:53.192 ************************************ 00:13:53.192 END TEST nvmf_connect_stress 00:13:53.192 ************************************ 00:13:53.192 16:56:04 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:53.192 16:56:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:53.192 16:56:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:53.192 16:56:04 -- common/autotest_common.sh@10 -- # set +x 00:13:53.192 ************************************ 00:13:53.192 START TEST nvmf_fused_ordering 00:13:53.192 ************************************ 00:13:53.192 16:56:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:53.192 * Looking for test storage... 00:13:53.192 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:53.192 16:56:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:53.192 16:56:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:53.192 16:56:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:53.192 16:56:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:53.192 16:56:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:53.192 16:56:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:53.192 16:56:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:53.192 16:56:04 -- scripts/common.sh@335 -- # IFS=.-: 00:13:53.192 16:56:04 -- scripts/common.sh@335 -- # read -ra ver1 00:13:53.192 16:56:04 -- scripts/common.sh@336 -- # IFS=.-: 00:13:53.192 16:56:04 -- scripts/common.sh@336 -- # read -ra ver2 00:13:53.192 16:56:04 -- scripts/common.sh@337 -- # local 'op=<' 00:13:53.192 16:56:04 -- scripts/common.sh@339 -- # ver1_l=2 00:13:53.192 16:56:04 -- scripts/common.sh@340 -- # ver2_l=1 00:13:53.192 16:56:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:53.192 16:56:04 -- scripts/common.sh@343 -- # case "$op" in 00:13:53.192 16:56:04 -- scripts/common.sh@344 -- # : 1 00:13:53.192 16:56:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:53.192 16:56:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:53.192 16:56:04 -- scripts/common.sh@364 -- # decimal 1 00:13:53.192 16:56:04 -- scripts/common.sh@352 -- # local d=1 00:13:53.192 16:56:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:53.192 16:56:04 -- scripts/common.sh@354 -- # echo 1 00:13:53.192 16:56:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:53.192 16:56:04 -- scripts/common.sh@365 -- # decimal 2 00:13:53.192 16:56:04 -- scripts/common.sh@352 -- # local d=2 00:13:53.192 16:56:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:53.192 16:56:04 -- scripts/common.sh@354 -- # echo 2 00:13:53.192 16:56:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:53.192 16:56:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:53.192 16:56:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:53.192 16:56:04 -- scripts/common.sh@367 -- # return 0 00:13:53.192 16:56:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:53.192 16:56:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:53.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.192 --rc genhtml_branch_coverage=1 00:13:53.192 --rc genhtml_function_coverage=1 00:13:53.192 --rc genhtml_legend=1 00:13:53.192 --rc geninfo_all_blocks=1 00:13:53.192 --rc geninfo_unexecuted_blocks=1 00:13:53.192 00:13:53.192 ' 00:13:53.192 16:56:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:53.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.192 --rc genhtml_branch_coverage=1 00:13:53.192 --rc genhtml_function_coverage=1 00:13:53.192 --rc genhtml_legend=1 00:13:53.192 --rc geninfo_all_blocks=1 00:13:53.192 --rc geninfo_unexecuted_blocks=1 00:13:53.192 00:13:53.192 ' 00:13:53.192 16:56:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:53.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.192 --rc genhtml_branch_coverage=1 00:13:53.192 --rc genhtml_function_coverage=1 00:13:53.192 --rc genhtml_legend=1 00:13:53.192 --rc geninfo_all_blocks=1 00:13:53.192 --rc geninfo_unexecuted_blocks=1 00:13:53.192 00:13:53.192 ' 00:13:53.192 16:56:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:53.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.192 --rc genhtml_branch_coverage=1 00:13:53.192 --rc genhtml_function_coverage=1 00:13:53.192 --rc genhtml_legend=1 00:13:53.192 --rc geninfo_all_blocks=1 00:13:53.192 --rc geninfo_unexecuted_blocks=1 00:13:53.192 00:13:53.192 ' 00:13:53.192 16:56:04 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:53.192 16:56:04 -- nvmf/common.sh@7 -- # uname -s 00:13:53.192 16:56:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:53.192 16:56:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:53.192 16:56:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:53.192 16:56:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:53.192 16:56:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:53.192 16:56:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:53.192 16:56:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:53.192 16:56:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:53.192 16:56:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:53.192 16:56:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:53.192 16:56:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.192 16:56:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.192 16:56:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:53.192 16:56:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:53.192 16:56:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:53.192 16:56:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:53.192 16:56:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:53.192 16:56:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:53.192 16:56:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:53.192 16:56:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.192 16:56:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.192 16:56:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.192 16:56:04 -- paths/export.sh@5 -- # export PATH 00:13:53.192 16:56:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.192 16:56:04 -- nvmf/common.sh@46 -- # : 0 00:13:53.192 16:56:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:53.192 16:56:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:53.192 16:56:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:53.193 16:56:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:53.193 16:56:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:53.193 16:56:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:53.193 16:56:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:53.193 16:56:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:53.193 16:56:04 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:53.193 16:56:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:53.193 16:56:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:53.193 16:56:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:53.193 16:56:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:53.193 16:56:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:53.193 16:56:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:53.193 16:56:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:53.193 16:56:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.193 16:56:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:53.193 16:56:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:53.193 16:56:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:53.193 16:56:04 -- common/autotest_common.sh@10 -- # set +x 00:13:55.093 16:56:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:55.093 16:56:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:55.093 16:56:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:55.093 16:56:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:55.093 16:56:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:55.093 16:56:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:55.093 16:56:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:55.093 16:56:06 -- nvmf/common.sh@294 -- # net_devs=() 00:13:55.093 16:56:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:55.093 16:56:06 -- nvmf/common.sh@295 -- # e810=() 00:13:55.093 16:56:06 -- nvmf/common.sh@295 -- # local -ga e810 00:13:55.093 16:56:06 -- nvmf/common.sh@296 -- # x722=() 00:13:55.093 16:56:06 -- nvmf/common.sh@296 -- # local -ga x722 00:13:55.093 16:56:06 -- nvmf/common.sh@297 -- # mlx=() 00:13:55.093 16:56:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:55.093 16:56:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:55.093 16:56:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:55.093 16:56:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:55.093 16:56:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:55.093 16:56:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.093 16:56:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:55.093 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:55.093 16:56:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.093 16:56:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:55.093 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:55.093 16:56:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:55.093 16:56:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.093 16:56:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.093 16:56:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.093 16:56:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.093 16:56:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:55.093 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:55.093 16:56:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.093 16:56:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.093 16:56:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.093 16:56:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.093 16:56:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.093 16:56:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:55.093 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:55.093 16:56:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.093 16:56:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:55.093 16:56:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:55.093 16:56:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:55.093 16:56:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:55.093 16:56:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:55.093 16:56:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:55.093 16:56:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:55.093 16:56:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:55.093 16:56:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:55.093 16:56:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:55.093 16:56:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:55.093 16:56:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:55.093 16:56:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:55.093 16:56:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:55.094 16:56:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:55.094 16:56:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:55.094 16:56:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:55.094 16:56:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:55.094 16:56:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:55.094 16:56:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:55.094 16:56:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:55.094 16:56:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:55.094 16:56:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:55.094 16:56:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:55.094 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:55.094 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.293 ms 00:13:55.094 00:13:55.094 --- 10.0.0.2 ping statistics --- 00:13:55.094 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.094 rtt min/avg/max/mdev = 0.293/0.293/0.293/0.000 ms 00:13:55.094 16:56:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:55.094 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:55.094 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:13:55.094 00:13:55.094 --- 10.0.0.1 ping statistics --- 00:13:55.094 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.094 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:13:55.094 16:56:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:55.094 16:56:06 -- nvmf/common.sh@410 -- # return 0 00:13:55.094 16:56:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:55.094 16:56:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:55.094 16:56:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:55.094 16:56:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:55.094 16:56:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:55.094 16:56:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:55.094 16:56:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:55.094 16:56:06 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:55.094 16:56:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:55.094 16:56:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:55.094 16:56:06 -- common/autotest_common.sh@10 -- # set +x 00:13:55.094 16:56:06 -- nvmf/common.sh@469 -- # nvmfpid=172895 00:13:55.094 16:56:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:55.094 16:56:06 -- nvmf/common.sh@470 -- # waitforlisten 172895 00:13:55.094 16:56:06 -- common/autotest_common.sh@829 -- # '[' -z 172895 ']' 00:13:55.094 16:56:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:55.094 16:56:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:55.094 16:56:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:55.094 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:55.094 16:56:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:55.094 16:56:06 -- common/autotest_common.sh@10 -- # set +x 00:13:55.094 [2024-11-29 16:56:06.327564] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:55.094 [2024-11-29 16:56:06.327650] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:55.094 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.094 [2024-11-29 16:56:06.392687] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:55.094 [2024-11-29 16:56:06.496684] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:55.094 [2024-11-29 16:56:06.496839] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:55.094 [2024-11-29 16:56:06.496856] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:55.094 [2024-11-29 16:56:06.496867] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:55.094 [2024-11-29 16:56:06.496893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:56.030 16:56:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:56.030 16:56:07 -- common/autotest_common.sh@862 -- # return 0 00:13:56.030 16:56:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:56.030 16:56:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:56.030 16:56:07 -- common/autotest_common.sh@10 -- # set +x 00:13:56.030 16:56:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:56.030 16:56:07 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:56.030 16:56:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.030 16:56:07 -- common/autotest_common.sh@10 -- # set +x 00:13:56.030 [2024-11-29 16:56:07.313610] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:56.030 16:56:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.030 16:56:07 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:56.030 16:56:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.030 16:56:07 -- common/autotest_common.sh@10 -- # set +x 00:13:56.030 16:56:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.030 16:56:07 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:56.030 16:56:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.030 16:56:07 -- common/autotest_common.sh@10 -- # set +x 00:13:56.030 [2024-11-29 16:56:07.329809] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.030 16:56:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.030 16:56:07 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:56.030 16:56:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.030 16:56:07 -- common/autotest_common.sh@10 -- # set +x 00:13:56.030 NULL1 00:13:56.030 16:56:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.030 16:56:07 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:56.030 16:56:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.030 16:56:07 -- common/autotest_common.sh@10 -- # set +x 00:13:56.030 16:56:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.030 16:56:07 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:56.030 16:56:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.030 16:56:07 -- common/autotest_common.sh@10 -- # set +x 00:13:56.030 16:56:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.030 16:56:07 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:56.030 [2024-11-29 16:56:07.373793] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:56.030 [2024-11-29 16:56:07.373833] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid173053 ] 00:13:56.030 EAL: No free 2048 kB hugepages reported on node 1 00:13:56.597 Attached to nqn.2016-06.io.spdk:cnode1 00:13:56.597 Namespace ID: 1 size: 1GB 00:13:56.597 fused_ordering(0) 00:13:56.597 fused_ordering(1) 00:13:56.597 fused_ordering(2) 00:13:56.597 fused_ordering(3) 00:13:56.597 fused_ordering(4) 00:13:56.597 fused_ordering(5) 00:13:56.597 fused_ordering(6) 00:13:56.597 fused_ordering(7) 00:13:56.597 fused_ordering(8) 00:13:56.597 fused_ordering(9) 00:13:56.597 fused_ordering(10) 00:13:56.597 fused_ordering(11) 00:13:56.597 fused_ordering(12) 00:13:56.597 fused_ordering(13) 00:13:56.597 fused_ordering(14) 00:13:56.597 fused_ordering(15) 00:13:56.597 fused_ordering(16) 00:13:56.597 fused_ordering(17) 00:13:56.597 fused_ordering(18) 00:13:56.597 fused_ordering(19) 00:13:56.597 fused_ordering(20) 00:13:56.597 fused_ordering(21) 00:13:56.597 fused_ordering(22) 00:13:56.597 fused_ordering(23) 00:13:56.597 fused_ordering(24) 00:13:56.597 fused_ordering(25) 00:13:56.597 fused_ordering(26) 00:13:56.597 fused_ordering(27) 00:13:56.597 fused_ordering(28) 00:13:56.597 fused_ordering(29) 00:13:56.597 fused_ordering(30) 00:13:56.597 fused_ordering(31) 00:13:56.597 fused_ordering(32) 00:13:56.597 fused_ordering(33) 00:13:56.597 fused_ordering(34) 00:13:56.597 fused_ordering(35) 00:13:56.597 fused_ordering(36) 00:13:56.597 fused_ordering(37) 00:13:56.597 fused_ordering(38) 00:13:56.597 fused_ordering(39) 00:13:56.597 fused_ordering(40) 00:13:56.597 fused_ordering(41) 00:13:56.597 fused_ordering(42) 00:13:56.597 fused_ordering(43) 00:13:56.597 fused_ordering(44) 00:13:56.597 fused_ordering(45) 00:13:56.597 fused_ordering(46) 00:13:56.597 fused_ordering(47) 00:13:56.597 fused_ordering(48) 00:13:56.597 fused_ordering(49) 00:13:56.597 fused_ordering(50) 00:13:56.597 fused_ordering(51) 00:13:56.597 fused_ordering(52) 00:13:56.597 fused_ordering(53) 00:13:56.597 fused_ordering(54) 00:13:56.597 fused_ordering(55) 00:13:56.597 fused_ordering(56) 00:13:56.597 fused_ordering(57) 00:13:56.597 fused_ordering(58) 00:13:56.597 fused_ordering(59) 00:13:56.597 fused_ordering(60) 00:13:56.597 fused_ordering(61) 00:13:56.597 fused_ordering(62) 00:13:56.597 fused_ordering(63) 00:13:56.597 fused_ordering(64) 00:13:56.597 fused_ordering(65) 00:13:56.597 fused_ordering(66) 00:13:56.597 fused_ordering(67) 00:13:56.597 fused_ordering(68) 00:13:56.597 fused_ordering(69) 00:13:56.597 fused_ordering(70) 00:13:56.597 fused_ordering(71) 00:13:56.597 fused_ordering(72) 00:13:56.597 fused_ordering(73) 00:13:56.597 fused_ordering(74) 00:13:56.597 fused_ordering(75) 00:13:56.597 fused_ordering(76) 00:13:56.597 fused_ordering(77) 00:13:56.597 fused_ordering(78) 00:13:56.597 fused_ordering(79) 00:13:56.597 fused_ordering(80) 00:13:56.597 fused_ordering(81) 00:13:56.597 fused_ordering(82) 00:13:56.597 fused_ordering(83) 00:13:56.597 fused_ordering(84) 00:13:56.597 fused_ordering(85) 00:13:56.597 fused_ordering(86) 00:13:56.597 fused_ordering(87) 00:13:56.597 fused_ordering(88) 00:13:56.597 fused_ordering(89) 00:13:56.597 fused_ordering(90) 00:13:56.597 fused_ordering(91) 00:13:56.597 fused_ordering(92) 00:13:56.597 fused_ordering(93) 00:13:56.597 fused_ordering(94) 00:13:56.597 fused_ordering(95) 00:13:56.597 fused_ordering(96) 00:13:56.597 fused_ordering(97) 00:13:56.597 fused_ordering(98) 00:13:56.597 fused_ordering(99) 00:13:56.597 fused_ordering(100) 00:13:56.597 fused_ordering(101) 00:13:56.597 fused_ordering(102) 00:13:56.597 fused_ordering(103) 00:13:56.597 fused_ordering(104) 00:13:56.597 fused_ordering(105) 00:13:56.597 fused_ordering(106) 00:13:56.597 fused_ordering(107) 00:13:56.597 fused_ordering(108) 00:13:56.597 fused_ordering(109) 00:13:56.597 fused_ordering(110) 00:13:56.597 fused_ordering(111) 00:13:56.597 fused_ordering(112) 00:13:56.597 fused_ordering(113) 00:13:56.597 fused_ordering(114) 00:13:56.597 fused_ordering(115) 00:13:56.597 fused_ordering(116) 00:13:56.597 fused_ordering(117) 00:13:56.597 fused_ordering(118) 00:13:56.597 fused_ordering(119) 00:13:56.597 fused_ordering(120) 00:13:56.597 fused_ordering(121) 00:13:56.597 fused_ordering(122) 00:13:56.597 fused_ordering(123) 00:13:56.598 fused_ordering(124) 00:13:56.598 fused_ordering(125) 00:13:56.598 fused_ordering(126) 00:13:56.598 fused_ordering(127) 00:13:56.598 fused_ordering(128) 00:13:56.598 fused_ordering(129) 00:13:56.598 fused_ordering(130) 00:13:56.598 fused_ordering(131) 00:13:56.598 fused_ordering(132) 00:13:56.598 fused_ordering(133) 00:13:56.598 fused_ordering(134) 00:13:56.598 fused_ordering(135) 00:13:56.598 fused_ordering(136) 00:13:56.598 fused_ordering(137) 00:13:56.598 fused_ordering(138) 00:13:56.598 fused_ordering(139) 00:13:56.598 fused_ordering(140) 00:13:56.598 fused_ordering(141) 00:13:56.598 fused_ordering(142) 00:13:56.598 fused_ordering(143) 00:13:56.598 fused_ordering(144) 00:13:56.598 fused_ordering(145) 00:13:56.598 fused_ordering(146) 00:13:56.598 fused_ordering(147) 00:13:56.598 fused_ordering(148) 00:13:56.598 fused_ordering(149) 00:13:56.598 fused_ordering(150) 00:13:56.598 fused_ordering(151) 00:13:56.598 fused_ordering(152) 00:13:56.598 fused_ordering(153) 00:13:56.598 fused_ordering(154) 00:13:56.598 fused_ordering(155) 00:13:56.598 fused_ordering(156) 00:13:56.598 fused_ordering(157) 00:13:56.598 fused_ordering(158) 00:13:56.598 fused_ordering(159) 00:13:56.598 fused_ordering(160) 00:13:56.598 fused_ordering(161) 00:13:56.598 fused_ordering(162) 00:13:56.598 fused_ordering(163) 00:13:56.598 fused_ordering(164) 00:13:56.598 fused_ordering(165) 00:13:56.598 fused_ordering(166) 00:13:56.598 fused_ordering(167) 00:13:56.598 fused_ordering(168) 00:13:56.598 fused_ordering(169) 00:13:56.598 fused_ordering(170) 00:13:56.598 fused_ordering(171) 00:13:56.598 fused_ordering(172) 00:13:56.598 fused_ordering(173) 00:13:56.598 fused_ordering(174) 00:13:56.598 fused_ordering(175) 00:13:56.598 fused_ordering(176) 00:13:56.598 fused_ordering(177) 00:13:56.598 fused_ordering(178) 00:13:56.598 fused_ordering(179) 00:13:56.598 fused_ordering(180) 00:13:56.598 fused_ordering(181) 00:13:56.598 fused_ordering(182) 00:13:56.598 fused_ordering(183) 00:13:56.598 fused_ordering(184) 00:13:56.598 fused_ordering(185) 00:13:56.598 fused_ordering(186) 00:13:56.598 fused_ordering(187) 00:13:56.598 fused_ordering(188) 00:13:56.598 fused_ordering(189) 00:13:56.598 fused_ordering(190) 00:13:56.598 fused_ordering(191) 00:13:56.598 fused_ordering(192) 00:13:56.598 fused_ordering(193) 00:13:56.598 fused_ordering(194) 00:13:56.598 fused_ordering(195) 00:13:56.598 fused_ordering(196) 00:13:56.598 fused_ordering(197) 00:13:56.598 fused_ordering(198) 00:13:56.598 fused_ordering(199) 00:13:56.598 fused_ordering(200) 00:13:56.598 fused_ordering(201) 00:13:56.598 fused_ordering(202) 00:13:56.598 fused_ordering(203) 00:13:56.598 fused_ordering(204) 00:13:56.598 fused_ordering(205) 00:13:56.856 fused_ordering(206) 00:13:56.856 fused_ordering(207) 00:13:56.856 fused_ordering(208) 00:13:56.856 fused_ordering(209) 00:13:56.856 fused_ordering(210) 00:13:56.856 fused_ordering(211) 00:13:56.856 fused_ordering(212) 00:13:56.856 fused_ordering(213) 00:13:56.856 fused_ordering(214) 00:13:56.856 fused_ordering(215) 00:13:56.857 fused_ordering(216) 00:13:56.857 fused_ordering(217) 00:13:56.857 fused_ordering(218) 00:13:56.857 fused_ordering(219) 00:13:56.857 fused_ordering(220) 00:13:56.857 fused_ordering(221) 00:13:56.857 fused_ordering(222) 00:13:56.857 fused_ordering(223) 00:13:56.857 fused_ordering(224) 00:13:56.857 fused_ordering(225) 00:13:56.857 fused_ordering(226) 00:13:56.857 fused_ordering(227) 00:13:56.857 fused_ordering(228) 00:13:56.857 fused_ordering(229) 00:13:56.857 fused_ordering(230) 00:13:56.857 fused_ordering(231) 00:13:56.857 fused_ordering(232) 00:13:56.857 fused_ordering(233) 00:13:56.857 fused_ordering(234) 00:13:56.857 fused_ordering(235) 00:13:56.857 fused_ordering(236) 00:13:56.857 fused_ordering(237) 00:13:56.857 fused_ordering(238) 00:13:56.857 fused_ordering(239) 00:13:56.857 fused_ordering(240) 00:13:56.857 fused_ordering(241) 00:13:56.857 fused_ordering(242) 00:13:56.857 fused_ordering(243) 00:13:56.857 fused_ordering(244) 00:13:56.857 fused_ordering(245) 00:13:56.857 fused_ordering(246) 00:13:56.857 fused_ordering(247) 00:13:56.857 fused_ordering(248) 00:13:56.857 fused_ordering(249) 00:13:56.857 fused_ordering(250) 00:13:56.857 fused_ordering(251) 00:13:56.857 fused_ordering(252) 00:13:56.857 fused_ordering(253) 00:13:56.857 fused_ordering(254) 00:13:56.857 fused_ordering(255) 00:13:56.857 fused_ordering(256) 00:13:56.857 fused_ordering(257) 00:13:56.857 fused_ordering(258) 00:13:56.857 fused_ordering(259) 00:13:56.857 fused_ordering(260) 00:13:56.857 fused_ordering(261) 00:13:56.857 fused_ordering(262) 00:13:56.857 fused_ordering(263) 00:13:56.857 fused_ordering(264) 00:13:56.857 fused_ordering(265) 00:13:56.857 fused_ordering(266) 00:13:56.857 fused_ordering(267) 00:13:56.857 fused_ordering(268) 00:13:56.857 fused_ordering(269) 00:13:56.857 fused_ordering(270) 00:13:56.857 fused_ordering(271) 00:13:56.857 fused_ordering(272) 00:13:56.857 fused_ordering(273) 00:13:56.857 fused_ordering(274) 00:13:56.857 fused_ordering(275) 00:13:56.857 fused_ordering(276) 00:13:56.857 fused_ordering(277) 00:13:56.857 fused_ordering(278) 00:13:56.857 fused_ordering(279) 00:13:56.857 fused_ordering(280) 00:13:56.857 fused_ordering(281) 00:13:56.857 fused_ordering(282) 00:13:56.857 fused_ordering(283) 00:13:56.857 fused_ordering(284) 00:13:56.857 fused_ordering(285) 00:13:56.857 fused_ordering(286) 00:13:56.857 fused_ordering(287) 00:13:56.857 fused_ordering(288) 00:13:56.857 fused_ordering(289) 00:13:56.857 fused_ordering(290) 00:13:56.857 fused_ordering(291) 00:13:56.857 fused_ordering(292) 00:13:56.857 fused_ordering(293) 00:13:56.857 fused_ordering(294) 00:13:56.857 fused_ordering(295) 00:13:56.857 fused_ordering(296) 00:13:56.857 fused_ordering(297) 00:13:56.857 fused_ordering(298) 00:13:56.857 fused_ordering(299) 00:13:56.857 fused_ordering(300) 00:13:56.857 fused_ordering(301) 00:13:56.857 fused_ordering(302) 00:13:56.857 fused_ordering(303) 00:13:56.857 fused_ordering(304) 00:13:56.857 fused_ordering(305) 00:13:56.857 fused_ordering(306) 00:13:56.857 fused_ordering(307) 00:13:56.857 fused_ordering(308) 00:13:56.857 fused_ordering(309) 00:13:56.857 fused_ordering(310) 00:13:56.857 fused_ordering(311) 00:13:56.857 fused_ordering(312) 00:13:56.857 fused_ordering(313) 00:13:56.857 fused_ordering(314) 00:13:56.857 fused_ordering(315) 00:13:56.857 fused_ordering(316) 00:13:56.857 fused_ordering(317) 00:13:56.857 fused_ordering(318) 00:13:56.857 fused_ordering(319) 00:13:56.857 fused_ordering(320) 00:13:56.857 fused_ordering(321) 00:13:56.857 fused_ordering(322) 00:13:56.857 fused_ordering(323) 00:13:56.857 fused_ordering(324) 00:13:56.857 fused_ordering(325) 00:13:56.857 fused_ordering(326) 00:13:56.857 fused_ordering(327) 00:13:56.857 fused_ordering(328) 00:13:56.857 fused_ordering(329) 00:13:56.857 fused_ordering(330) 00:13:56.857 fused_ordering(331) 00:13:56.857 fused_ordering(332) 00:13:56.857 fused_ordering(333) 00:13:56.857 fused_ordering(334) 00:13:56.857 fused_ordering(335) 00:13:56.857 fused_ordering(336) 00:13:56.857 fused_ordering(337) 00:13:56.857 fused_ordering(338) 00:13:56.857 fused_ordering(339) 00:13:56.857 fused_ordering(340) 00:13:56.857 fused_ordering(341) 00:13:56.857 fused_ordering(342) 00:13:56.857 fused_ordering(343) 00:13:56.857 fused_ordering(344) 00:13:56.857 fused_ordering(345) 00:13:56.857 fused_ordering(346) 00:13:56.857 fused_ordering(347) 00:13:56.857 fused_ordering(348) 00:13:56.857 fused_ordering(349) 00:13:56.857 fused_ordering(350) 00:13:56.857 fused_ordering(351) 00:13:56.857 fused_ordering(352) 00:13:56.857 fused_ordering(353) 00:13:56.857 fused_ordering(354) 00:13:56.857 fused_ordering(355) 00:13:56.857 fused_ordering(356) 00:13:56.857 fused_ordering(357) 00:13:56.857 fused_ordering(358) 00:13:56.857 fused_ordering(359) 00:13:56.857 fused_ordering(360) 00:13:56.857 fused_ordering(361) 00:13:56.857 fused_ordering(362) 00:13:56.857 fused_ordering(363) 00:13:56.857 fused_ordering(364) 00:13:56.857 fused_ordering(365) 00:13:56.857 fused_ordering(366) 00:13:56.857 fused_ordering(367) 00:13:56.857 fused_ordering(368) 00:13:56.857 fused_ordering(369) 00:13:56.857 fused_ordering(370) 00:13:56.857 fused_ordering(371) 00:13:56.857 fused_ordering(372) 00:13:56.857 fused_ordering(373) 00:13:56.857 fused_ordering(374) 00:13:56.857 fused_ordering(375) 00:13:56.857 fused_ordering(376) 00:13:56.857 fused_ordering(377) 00:13:56.857 fused_ordering(378) 00:13:56.857 fused_ordering(379) 00:13:56.857 fused_ordering(380) 00:13:56.857 fused_ordering(381) 00:13:56.857 fused_ordering(382) 00:13:56.857 fused_ordering(383) 00:13:56.857 fused_ordering(384) 00:13:56.857 fused_ordering(385) 00:13:56.857 fused_ordering(386) 00:13:56.857 fused_ordering(387) 00:13:56.857 fused_ordering(388) 00:13:56.857 fused_ordering(389) 00:13:56.857 fused_ordering(390) 00:13:56.857 fused_ordering(391) 00:13:56.857 fused_ordering(392) 00:13:56.857 fused_ordering(393) 00:13:56.857 fused_ordering(394) 00:13:56.857 fused_ordering(395) 00:13:56.857 fused_ordering(396) 00:13:56.857 fused_ordering(397) 00:13:56.857 fused_ordering(398) 00:13:56.857 fused_ordering(399) 00:13:56.857 fused_ordering(400) 00:13:56.857 fused_ordering(401) 00:13:56.857 fused_ordering(402) 00:13:56.857 fused_ordering(403) 00:13:56.857 fused_ordering(404) 00:13:56.857 fused_ordering(405) 00:13:56.857 fused_ordering(406) 00:13:56.857 fused_ordering(407) 00:13:56.857 fused_ordering(408) 00:13:56.857 fused_ordering(409) 00:13:56.857 fused_ordering(410) 00:13:57.115 fused_ordering(411) 00:13:57.115 fused_ordering(412) 00:13:57.115 fused_ordering(413) 00:13:57.115 fused_ordering(414) 00:13:57.115 fused_ordering(415) 00:13:57.115 fused_ordering(416) 00:13:57.115 fused_ordering(417) 00:13:57.115 fused_ordering(418) 00:13:57.115 fused_ordering(419) 00:13:57.115 fused_ordering(420) 00:13:57.115 fused_ordering(421) 00:13:57.115 fused_ordering(422) 00:13:57.115 fused_ordering(423) 00:13:57.115 fused_ordering(424) 00:13:57.115 fused_ordering(425) 00:13:57.116 fused_ordering(426) 00:13:57.116 fused_ordering(427) 00:13:57.116 fused_ordering(428) 00:13:57.116 fused_ordering(429) 00:13:57.116 fused_ordering(430) 00:13:57.116 fused_ordering(431) 00:13:57.116 fused_ordering(432) 00:13:57.116 fused_ordering(433) 00:13:57.116 fused_ordering(434) 00:13:57.116 fused_ordering(435) 00:13:57.116 fused_ordering(436) 00:13:57.116 fused_ordering(437) 00:13:57.116 fused_ordering(438) 00:13:57.116 fused_ordering(439) 00:13:57.116 fused_ordering(440) 00:13:57.116 fused_ordering(441) 00:13:57.116 fused_ordering(442) 00:13:57.116 fused_ordering(443) 00:13:57.116 fused_ordering(444) 00:13:57.116 fused_ordering(445) 00:13:57.116 fused_ordering(446) 00:13:57.116 fused_ordering(447) 00:13:57.116 fused_ordering(448) 00:13:57.116 fused_ordering(449) 00:13:57.116 fused_ordering(450) 00:13:57.116 fused_ordering(451) 00:13:57.116 fused_ordering(452) 00:13:57.116 fused_ordering(453) 00:13:57.116 fused_ordering(454) 00:13:57.116 fused_ordering(455) 00:13:57.116 fused_ordering(456) 00:13:57.116 fused_ordering(457) 00:13:57.116 fused_ordering(458) 00:13:57.116 fused_ordering(459) 00:13:57.116 fused_ordering(460) 00:13:57.116 fused_ordering(461) 00:13:57.116 fused_ordering(462) 00:13:57.116 fused_ordering(463) 00:13:57.116 fused_ordering(464) 00:13:57.116 fused_ordering(465) 00:13:57.116 fused_ordering(466) 00:13:57.116 fused_ordering(467) 00:13:57.116 fused_ordering(468) 00:13:57.116 fused_ordering(469) 00:13:57.116 fused_ordering(470) 00:13:57.116 fused_ordering(471) 00:13:57.116 fused_ordering(472) 00:13:57.116 fused_ordering(473) 00:13:57.116 fused_ordering(474) 00:13:57.116 fused_ordering(475) 00:13:57.116 fused_ordering(476) 00:13:57.116 fused_ordering(477) 00:13:57.116 fused_ordering(478) 00:13:57.116 fused_ordering(479) 00:13:57.116 fused_ordering(480) 00:13:57.116 fused_ordering(481) 00:13:57.116 fused_ordering(482) 00:13:57.116 fused_ordering(483) 00:13:57.116 fused_ordering(484) 00:13:57.116 fused_ordering(485) 00:13:57.116 fused_ordering(486) 00:13:57.116 fused_ordering(487) 00:13:57.116 fused_ordering(488) 00:13:57.116 fused_ordering(489) 00:13:57.116 fused_ordering(490) 00:13:57.116 fused_ordering(491) 00:13:57.116 fused_ordering(492) 00:13:57.116 fused_ordering(493) 00:13:57.116 fused_ordering(494) 00:13:57.116 fused_ordering(495) 00:13:57.116 fused_ordering(496) 00:13:57.116 fused_ordering(497) 00:13:57.116 fused_ordering(498) 00:13:57.116 fused_ordering(499) 00:13:57.116 fused_ordering(500) 00:13:57.116 fused_ordering(501) 00:13:57.116 fused_ordering(502) 00:13:57.116 fused_ordering(503) 00:13:57.116 fused_ordering(504) 00:13:57.116 fused_ordering(505) 00:13:57.116 fused_ordering(506) 00:13:57.116 fused_ordering(507) 00:13:57.116 fused_ordering(508) 00:13:57.116 fused_ordering(509) 00:13:57.116 fused_ordering(510) 00:13:57.116 fused_ordering(511) 00:13:57.116 fused_ordering(512) 00:13:57.116 fused_ordering(513) 00:13:57.116 fused_ordering(514) 00:13:57.116 fused_ordering(515) 00:13:57.116 fused_ordering(516) 00:13:57.116 fused_ordering(517) 00:13:57.116 fused_ordering(518) 00:13:57.116 fused_ordering(519) 00:13:57.116 fused_ordering(520) 00:13:57.116 fused_ordering(521) 00:13:57.116 fused_ordering(522) 00:13:57.116 fused_ordering(523) 00:13:57.116 fused_ordering(524) 00:13:57.116 fused_ordering(525) 00:13:57.116 fused_ordering(526) 00:13:57.116 fused_ordering(527) 00:13:57.116 fused_ordering(528) 00:13:57.116 fused_ordering(529) 00:13:57.116 fused_ordering(530) 00:13:57.116 fused_ordering(531) 00:13:57.116 fused_ordering(532) 00:13:57.116 fused_ordering(533) 00:13:57.116 fused_ordering(534) 00:13:57.116 fused_ordering(535) 00:13:57.116 fused_ordering(536) 00:13:57.116 fused_ordering(537) 00:13:57.116 fused_ordering(538) 00:13:57.116 fused_ordering(539) 00:13:57.116 fused_ordering(540) 00:13:57.116 fused_ordering(541) 00:13:57.116 fused_ordering(542) 00:13:57.116 fused_ordering(543) 00:13:57.116 fused_ordering(544) 00:13:57.116 fused_ordering(545) 00:13:57.116 fused_ordering(546) 00:13:57.116 fused_ordering(547) 00:13:57.116 fused_ordering(548) 00:13:57.116 fused_ordering(549) 00:13:57.116 fused_ordering(550) 00:13:57.116 fused_ordering(551) 00:13:57.116 fused_ordering(552) 00:13:57.116 fused_ordering(553) 00:13:57.116 fused_ordering(554) 00:13:57.116 fused_ordering(555) 00:13:57.116 fused_ordering(556) 00:13:57.116 fused_ordering(557) 00:13:57.116 fused_ordering(558) 00:13:57.116 fused_ordering(559) 00:13:57.116 fused_ordering(560) 00:13:57.116 fused_ordering(561) 00:13:57.116 fused_ordering(562) 00:13:57.116 fused_ordering(563) 00:13:57.116 fused_ordering(564) 00:13:57.116 fused_ordering(565) 00:13:57.116 fused_ordering(566) 00:13:57.116 fused_ordering(567) 00:13:57.116 fused_ordering(568) 00:13:57.116 fused_ordering(569) 00:13:57.116 fused_ordering(570) 00:13:57.116 fused_ordering(571) 00:13:57.116 fused_ordering(572) 00:13:57.116 fused_ordering(573) 00:13:57.116 fused_ordering(574) 00:13:57.116 fused_ordering(575) 00:13:57.116 fused_ordering(576) 00:13:57.116 fused_ordering(577) 00:13:57.116 fused_ordering(578) 00:13:57.116 fused_ordering(579) 00:13:57.116 fused_ordering(580) 00:13:57.116 fused_ordering(581) 00:13:57.116 fused_ordering(582) 00:13:57.116 fused_ordering(583) 00:13:57.116 fused_ordering(584) 00:13:57.116 fused_ordering(585) 00:13:57.116 fused_ordering(586) 00:13:57.116 fused_ordering(587) 00:13:57.116 fused_ordering(588) 00:13:57.116 fused_ordering(589) 00:13:57.116 fused_ordering(590) 00:13:57.116 fused_ordering(591) 00:13:57.116 fused_ordering(592) 00:13:57.116 fused_ordering(593) 00:13:57.116 fused_ordering(594) 00:13:57.116 fused_ordering(595) 00:13:57.116 fused_ordering(596) 00:13:57.116 fused_ordering(597) 00:13:57.116 fused_ordering(598) 00:13:57.116 fused_ordering(599) 00:13:57.116 fused_ordering(600) 00:13:57.116 fused_ordering(601) 00:13:57.116 fused_ordering(602) 00:13:57.116 fused_ordering(603) 00:13:57.116 fused_ordering(604) 00:13:57.116 fused_ordering(605) 00:13:57.116 fused_ordering(606) 00:13:57.116 fused_ordering(607) 00:13:57.116 fused_ordering(608) 00:13:57.116 fused_ordering(609) 00:13:57.116 fused_ordering(610) 00:13:57.116 fused_ordering(611) 00:13:57.116 fused_ordering(612) 00:13:57.116 fused_ordering(613) 00:13:57.116 fused_ordering(614) 00:13:57.116 fused_ordering(615) 00:13:57.683 fused_ordering(616) 00:13:57.683 fused_ordering(617) 00:13:57.683 fused_ordering(618) 00:13:57.683 fused_ordering(619) 00:13:57.683 fused_ordering(620) 00:13:57.683 fused_ordering(621) 00:13:57.683 fused_ordering(622) 00:13:57.683 fused_ordering(623) 00:13:57.684 fused_ordering(624) 00:13:57.684 fused_ordering(625) 00:13:57.684 fused_ordering(626) 00:13:57.684 fused_ordering(627) 00:13:57.684 fused_ordering(628) 00:13:57.684 fused_ordering(629) 00:13:57.684 fused_ordering(630) 00:13:57.684 fused_ordering(631) 00:13:57.684 fused_ordering(632) 00:13:57.684 fused_ordering(633) 00:13:57.684 fused_ordering(634) 00:13:57.684 fused_ordering(635) 00:13:57.684 fused_ordering(636) 00:13:57.684 fused_ordering(637) 00:13:57.684 fused_ordering(638) 00:13:57.684 fused_ordering(639) 00:13:57.684 fused_ordering(640) 00:13:57.684 fused_ordering(641) 00:13:57.684 fused_ordering(642) 00:13:57.684 fused_ordering(643) 00:13:57.684 fused_ordering(644) 00:13:57.684 fused_ordering(645) 00:13:57.684 fused_ordering(646) 00:13:57.684 fused_ordering(647) 00:13:57.684 fused_ordering(648) 00:13:57.684 fused_ordering(649) 00:13:57.684 fused_ordering(650) 00:13:57.684 fused_ordering(651) 00:13:57.684 fused_ordering(652) 00:13:57.684 fused_ordering(653) 00:13:57.684 fused_ordering(654) 00:13:57.684 fused_ordering(655) 00:13:57.684 fused_ordering(656) 00:13:57.684 fused_ordering(657) 00:13:57.684 fused_ordering(658) 00:13:57.684 fused_ordering(659) 00:13:57.684 fused_ordering(660) 00:13:57.684 fused_ordering(661) 00:13:57.684 fused_ordering(662) 00:13:57.684 fused_ordering(663) 00:13:57.684 fused_ordering(664) 00:13:57.684 fused_ordering(665) 00:13:57.684 fused_ordering(666) 00:13:57.684 fused_ordering(667) 00:13:57.684 fused_ordering(668) 00:13:57.684 fused_ordering(669) 00:13:57.684 fused_ordering(670) 00:13:57.684 fused_ordering(671) 00:13:57.684 fused_ordering(672) 00:13:57.684 fused_ordering(673) 00:13:57.684 fused_ordering(674) 00:13:57.684 fused_ordering(675) 00:13:57.684 fused_ordering(676) 00:13:57.684 fused_ordering(677) 00:13:57.684 fused_ordering(678) 00:13:57.684 fused_ordering(679) 00:13:57.684 fused_ordering(680) 00:13:57.684 fused_ordering(681) 00:13:57.684 fused_ordering(682) 00:13:57.684 fused_ordering(683) 00:13:57.684 fused_ordering(684) 00:13:57.684 fused_ordering(685) 00:13:57.684 fused_ordering(686) 00:13:57.684 fused_ordering(687) 00:13:57.684 fused_ordering(688) 00:13:57.684 fused_ordering(689) 00:13:57.684 fused_ordering(690) 00:13:57.684 fused_ordering(691) 00:13:57.684 fused_ordering(692) 00:13:57.684 fused_ordering(693) 00:13:57.684 fused_ordering(694) 00:13:57.684 fused_ordering(695) 00:13:57.684 fused_ordering(696) 00:13:57.684 fused_ordering(697) 00:13:57.684 fused_ordering(698) 00:13:57.684 fused_ordering(699) 00:13:57.684 fused_ordering(700) 00:13:57.684 fused_ordering(701) 00:13:57.684 fused_ordering(702) 00:13:57.684 fused_ordering(703) 00:13:57.684 fused_ordering(704) 00:13:57.684 fused_ordering(705) 00:13:57.684 fused_ordering(706) 00:13:57.684 fused_ordering(707) 00:13:57.684 fused_ordering(708) 00:13:57.684 fused_ordering(709) 00:13:57.684 fused_ordering(710) 00:13:57.684 fused_ordering(711) 00:13:57.684 fused_ordering(712) 00:13:57.684 fused_ordering(713) 00:13:57.684 fused_ordering(714) 00:13:57.684 fused_ordering(715) 00:13:57.684 fused_ordering(716) 00:13:57.684 fused_ordering(717) 00:13:57.684 fused_ordering(718) 00:13:57.684 fused_ordering(719) 00:13:57.684 fused_ordering(720) 00:13:57.684 fused_ordering(721) 00:13:57.684 fused_ordering(722) 00:13:57.684 fused_ordering(723) 00:13:57.684 fused_ordering(724) 00:13:57.684 fused_ordering(725) 00:13:57.684 fused_ordering(726) 00:13:57.684 fused_ordering(727) 00:13:57.684 fused_ordering(728) 00:13:57.684 fused_ordering(729) 00:13:57.684 fused_ordering(730) 00:13:57.684 fused_ordering(731) 00:13:57.684 fused_ordering(732) 00:13:57.684 fused_ordering(733) 00:13:57.684 fused_ordering(734) 00:13:57.684 fused_ordering(735) 00:13:57.684 fused_ordering(736) 00:13:57.684 fused_ordering(737) 00:13:57.684 fused_ordering(738) 00:13:57.684 fused_ordering(739) 00:13:57.684 fused_ordering(740) 00:13:57.684 fused_ordering(741) 00:13:57.684 fused_ordering(742) 00:13:57.684 fused_ordering(743) 00:13:57.684 fused_ordering(744) 00:13:57.684 fused_ordering(745) 00:13:57.684 fused_ordering(746) 00:13:57.684 fused_ordering(747) 00:13:57.684 fused_ordering(748) 00:13:57.684 fused_ordering(749) 00:13:57.684 fused_ordering(750) 00:13:57.684 fused_ordering(751) 00:13:57.684 fused_ordering(752) 00:13:57.684 fused_ordering(753) 00:13:57.684 fused_ordering(754) 00:13:57.684 fused_ordering(755) 00:13:57.684 fused_ordering(756) 00:13:57.684 fused_ordering(757) 00:13:57.684 fused_ordering(758) 00:13:57.684 fused_ordering(759) 00:13:57.684 fused_ordering(760) 00:13:57.684 fused_ordering(761) 00:13:57.684 fused_ordering(762) 00:13:57.684 fused_ordering(763) 00:13:57.684 fused_ordering(764) 00:13:57.684 fused_ordering(765) 00:13:57.684 fused_ordering(766) 00:13:57.684 fused_ordering(767) 00:13:57.684 fused_ordering(768) 00:13:57.684 fused_ordering(769) 00:13:57.684 fused_ordering(770) 00:13:57.684 fused_ordering(771) 00:13:57.684 fused_ordering(772) 00:13:57.684 fused_ordering(773) 00:13:57.684 fused_ordering(774) 00:13:57.684 fused_ordering(775) 00:13:57.684 fused_ordering(776) 00:13:57.684 fused_ordering(777) 00:13:57.684 fused_ordering(778) 00:13:57.684 fused_ordering(779) 00:13:57.684 fused_ordering(780) 00:13:57.684 fused_ordering(781) 00:13:57.684 fused_ordering(782) 00:13:57.684 fused_ordering(783) 00:13:57.684 fused_ordering(784) 00:13:57.684 fused_ordering(785) 00:13:57.684 fused_ordering(786) 00:13:57.684 fused_ordering(787) 00:13:57.684 fused_ordering(788) 00:13:57.684 fused_ordering(789) 00:13:57.684 fused_ordering(790) 00:13:57.684 fused_ordering(791) 00:13:57.684 fused_ordering(792) 00:13:57.684 fused_ordering(793) 00:13:57.684 fused_ordering(794) 00:13:57.684 fused_ordering(795) 00:13:57.684 fused_ordering(796) 00:13:57.684 fused_ordering(797) 00:13:57.684 fused_ordering(798) 00:13:57.684 fused_ordering(799) 00:13:57.684 fused_ordering(800) 00:13:57.684 fused_ordering(801) 00:13:57.684 fused_ordering(802) 00:13:57.684 fused_ordering(803) 00:13:57.684 fused_ordering(804) 00:13:57.684 fused_ordering(805) 00:13:57.684 fused_ordering(806) 00:13:57.684 fused_ordering(807) 00:13:57.684 fused_ordering(808) 00:13:57.684 fused_ordering(809) 00:13:57.684 fused_ordering(810) 00:13:57.684 fused_ordering(811) 00:13:57.684 fused_ordering(812) 00:13:57.684 fused_ordering(813) 00:13:57.684 fused_ordering(814) 00:13:57.684 fused_ordering(815) 00:13:57.684 fused_ordering(816) 00:13:57.684 fused_ordering(817) 00:13:57.684 fused_ordering(818) 00:13:57.684 fused_ordering(819) 00:13:57.684 fused_ordering(820) 00:13:58.251 fused_ordering(821) 00:13:58.251 fused_ordering(822) 00:13:58.251 fused_ordering(823) 00:13:58.251 fused_ordering(824) 00:13:58.251 fused_ordering(825) 00:13:58.251 fused_ordering(826) 00:13:58.251 fused_ordering(827) 00:13:58.251 fused_ordering(828) 00:13:58.251 fused_ordering(829) 00:13:58.251 fused_ordering(830) 00:13:58.251 fused_ordering(831) 00:13:58.251 fused_ordering(832) 00:13:58.251 fused_ordering(833) 00:13:58.251 fused_ordering(834) 00:13:58.251 fused_ordering(835) 00:13:58.251 fused_ordering(836) 00:13:58.251 fused_ordering(837) 00:13:58.251 fused_ordering(838) 00:13:58.251 fused_ordering(839) 00:13:58.251 fused_ordering(840) 00:13:58.251 fused_ordering(841) 00:13:58.251 fused_ordering(842) 00:13:58.251 fused_ordering(843) 00:13:58.251 fused_ordering(844) 00:13:58.251 fused_ordering(845) 00:13:58.251 fused_ordering(846) 00:13:58.251 fused_ordering(847) 00:13:58.251 fused_ordering(848) 00:13:58.251 fused_ordering(849) 00:13:58.251 fused_ordering(850) 00:13:58.251 fused_ordering(851) 00:13:58.251 fused_ordering(852) 00:13:58.251 fused_ordering(853) 00:13:58.251 fused_ordering(854) 00:13:58.251 fused_ordering(855) 00:13:58.251 fused_ordering(856) 00:13:58.251 fused_ordering(857) 00:13:58.251 fused_ordering(858) 00:13:58.251 fused_ordering(859) 00:13:58.251 fused_ordering(860) 00:13:58.251 fused_ordering(861) 00:13:58.251 fused_ordering(862) 00:13:58.251 fused_ordering(863) 00:13:58.251 fused_ordering(864) 00:13:58.251 fused_ordering(865) 00:13:58.251 fused_ordering(866) 00:13:58.251 fused_ordering(867) 00:13:58.251 fused_ordering(868) 00:13:58.251 fused_ordering(869) 00:13:58.251 fused_ordering(870) 00:13:58.251 fused_ordering(871) 00:13:58.251 fused_ordering(872) 00:13:58.251 fused_ordering(873) 00:13:58.251 fused_ordering(874) 00:13:58.251 fused_ordering(875) 00:13:58.251 fused_ordering(876) 00:13:58.251 fused_ordering(877) 00:13:58.251 fused_ordering(878) 00:13:58.251 fused_ordering(879) 00:13:58.251 fused_ordering(880) 00:13:58.251 fused_ordering(881) 00:13:58.251 fused_ordering(882) 00:13:58.251 fused_ordering(883) 00:13:58.251 fused_ordering(884) 00:13:58.251 fused_ordering(885) 00:13:58.251 fused_ordering(886) 00:13:58.251 fused_ordering(887) 00:13:58.251 fused_ordering(888) 00:13:58.251 fused_ordering(889) 00:13:58.251 fused_ordering(890) 00:13:58.251 fused_ordering(891) 00:13:58.251 fused_ordering(892) 00:13:58.251 fused_ordering(893) 00:13:58.251 fused_ordering(894) 00:13:58.251 fused_ordering(895) 00:13:58.251 fused_ordering(896) 00:13:58.251 fused_ordering(897) 00:13:58.251 fused_ordering(898) 00:13:58.251 fused_ordering(899) 00:13:58.251 fused_ordering(900) 00:13:58.251 fused_ordering(901) 00:13:58.251 fused_ordering(902) 00:13:58.251 fused_ordering(903) 00:13:58.251 fused_ordering(904) 00:13:58.251 fused_ordering(905) 00:13:58.251 fused_ordering(906) 00:13:58.251 fused_ordering(907) 00:13:58.251 fused_ordering(908) 00:13:58.251 fused_ordering(909) 00:13:58.251 fused_ordering(910) 00:13:58.251 fused_ordering(911) 00:13:58.251 fused_ordering(912) 00:13:58.251 fused_ordering(913) 00:13:58.251 fused_ordering(914) 00:13:58.251 fused_ordering(915) 00:13:58.251 fused_ordering(916) 00:13:58.251 fused_ordering(917) 00:13:58.251 fused_ordering(918) 00:13:58.251 fused_ordering(919) 00:13:58.251 fused_ordering(920) 00:13:58.251 fused_ordering(921) 00:13:58.251 fused_ordering(922) 00:13:58.251 fused_ordering(923) 00:13:58.251 fused_ordering(924) 00:13:58.251 fused_ordering(925) 00:13:58.251 fused_ordering(926) 00:13:58.251 fused_ordering(927) 00:13:58.251 fused_ordering(928) 00:13:58.251 fused_ordering(929) 00:13:58.251 fused_ordering(930) 00:13:58.251 fused_ordering(931) 00:13:58.251 fused_ordering(932) 00:13:58.251 fused_ordering(933) 00:13:58.251 fused_ordering(934) 00:13:58.251 fused_ordering(935) 00:13:58.251 fused_ordering(936) 00:13:58.251 fused_ordering(937) 00:13:58.251 fused_ordering(938) 00:13:58.251 fused_ordering(939) 00:13:58.251 fused_ordering(940) 00:13:58.251 fused_ordering(941) 00:13:58.251 fused_ordering(942) 00:13:58.251 fused_ordering(943) 00:13:58.251 fused_ordering(944) 00:13:58.251 fused_ordering(945) 00:13:58.251 fused_ordering(946) 00:13:58.251 fused_ordering(947) 00:13:58.251 fused_ordering(948) 00:13:58.251 fused_ordering(949) 00:13:58.251 fused_ordering(950) 00:13:58.251 fused_ordering(951) 00:13:58.251 fused_ordering(952) 00:13:58.251 fused_ordering(953) 00:13:58.251 fused_ordering(954) 00:13:58.251 fused_ordering(955) 00:13:58.251 fused_ordering(956) 00:13:58.251 fused_ordering(957) 00:13:58.251 fused_ordering(958) 00:13:58.251 fused_ordering(959) 00:13:58.251 fused_ordering(960) 00:13:58.251 fused_ordering(961) 00:13:58.251 fused_ordering(962) 00:13:58.251 fused_ordering(963) 00:13:58.251 fused_ordering(964) 00:13:58.251 fused_ordering(965) 00:13:58.251 fused_ordering(966) 00:13:58.251 fused_ordering(967) 00:13:58.251 fused_ordering(968) 00:13:58.252 fused_ordering(969) 00:13:58.252 fused_ordering(970) 00:13:58.252 fused_ordering(971) 00:13:58.252 fused_ordering(972) 00:13:58.252 fused_ordering(973) 00:13:58.252 fused_ordering(974) 00:13:58.252 fused_ordering(975) 00:13:58.252 fused_ordering(976) 00:13:58.252 fused_ordering(977) 00:13:58.252 fused_ordering(978) 00:13:58.252 fused_ordering(979) 00:13:58.252 fused_ordering(980) 00:13:58.252 fused_ordering(981) 00:13:58.252 fused_ordering(982) 00:13:58.252 fused_ordering(983) 00:13:58.252 fused_ordering(984) 00:13:58.252 fused_ordering(985) 00:13:58.252 fused_ordering(986) 00:13:58.252 fused_ordering(987) 00:13:58.252 fused_ordering(988) 00:13:58.252 fused_ordering(989) 00:13:58.252 fused_ordering(990) 00:13:58.252 fused_ordering(991) 00:13:58.252 fused_ordering(992) 00:13:58.252 fused_ordering(993) 00:13:58.252 fused_ordering(994) 00:13:58.252 fused_ordering(995) 00:13:58.252 fused_ordering(996) 00:13:58.252 fused_ordering(997) 00:13:58.252 fused_ordering(998) 00:13:58.252 fused_ordering(999) 00:13:58.252 fused_ordering(1000) 00:13:58.252 fused_ordering(1001) 00:13:58.252 fused_ordering(1002) 00:13:58.252 fused_ordering(1003) 00:13:58.252 fused_ordering(1004) 00:13:58.252 fused_ordering(1005) 00:13:58.252 fused_ordering(1006) 00:13:58.252 fused_ordering(1007) 00:13:58.252 fused_ordering(1008) 00:13:58.252 fused_ordering(1009) 00:13:58.252 fused_ordering(1010) 00:13:58.252 fused_ordering(1011) 00:13:58.252 fused_ordering(1012) 00:13:58.252 fused_ordering(1013) 00:13:58.252 fused_ordering(1014) 00:13:58.252 fused_ordering(1015) 00:13:58.252 fused_ordering(1016) 00:13:58.252 fused_ordering(1017) 00:13:58.252 fused_ordering(1018) 00:13:58.252 fused_ordering(1019) 00:13:58.252 fused_ordering(1020) 00:13:58.252 fused_ordering(1021) 00:13:58.252 fused_ordering(1022) 00:13:58.252 fused_ordering(1023) 00:13:58.252 16:56:09 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:58.252 16:56:09 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:58.252 16:56:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:58.252 16:56:09 -- nvmf/common.sh@116 -- # sync 00:13:58.252 16:56:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:58.252 16:56:09 -- nvmf/common.sh@119 -- # set +e 00:13:58.252 16:56:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:58.252 16:56:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:58.252 rmmod nvme_tcp 00:13:58.252 rmmod nvme_fabrics 00:13:58.252 rmmod nvme_keyring 00:13:58.252 16:56:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:58.252 16:56:09 -- nvmf/common.sh@123 -- # set -e 00:13:58.252 16:56:09 -- nvmf/common.sh@124 -- # return 0 00:13:58.252 16:56:09 -- nvmf/common.sh@477 -- # '[' -n 172895 ']' 00:13:58.252 16:56:09 -- nvmf/common.sh@478 -- # killprocess 172895 00:13:58.252 16:56:09 -- common/autotest_common.sh@936 -- # '[' -z 172895 ']' 00:13:58.252 16:56:09 -- common/autotest_common.sh@940 -- # kill -0 172895 00:13:58.252 16:56:09 -- common/autotest_common.sh@941 -- # uname 00:13:58.252 16:56:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:58.252 16:56:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 172895 00:13:58.252 16:56:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:58.252 16:56:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:58.252 16:56:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 172895' 00:13:58.252 killing process with pid 172895 00:13:58.252 16:56:09 -- common/autotest_common.sh@955 -- # kill 172895 00:13:58.252 16:56:09 -- common/autotest_common.sh@960 -- # wait 172895 00:13:58.511 16:56:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:58.511 16:56:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:58.511 16:56:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:58.511 16:56:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:58.511 16:56:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:58.511 16:56:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:58.511 16:56:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:58.511 16:56:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.049 16:56:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:01.049 00:14:01.049 real 0m7.904s 00:14:01.049 user 0m5.905s 00:14:01.049 sys 0m2.728s 00:14:01.049 16:56:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:01.049 16:56:11 -- common/autotest_common.sh@10 -- # set +x 00:14:01.049 ************************************ 00:14:01.049 END TEST nvmf_fused_ordering 00:14:01.049 ************************************ 00:14:01.049 16:56:11 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:01.049 16:56:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:01.049 16:56:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:01.049 16:56:11 -- common/autotest_common.sh@10 -- # set +x 00:14:01.049 ************************************ 00:14:01.049 START TEST nvmf_delete_subsystem 00:14:01.049 ************************************ 00:14:01.049 16:56:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:01.049 * Looking for test storage... 00:14:01.049 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:01.049 16:56:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:01.049 16:56:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:01.049 16:56:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:01.049 16:56:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:01.049 16:56:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:01.049 16:56:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:01.049 16:56:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:01.049 16:56:12 -- scripts/common.sh@335 -- # IFS=.-: 00:14:01.049 16:56:12 -- scripts/common.sh@335 -- # read -ra ver1 00:14:01.049 16:56:12 -- scripts/common.sh@336 -- # IFS=.-: 00:14:01.049 16:56:12 -- scripts/common.sh@336 -- # read -ra ver2 00:14:01.049 16:56:12 -- scripts/common.sh@337 -- # local 'op=<' 00:14:01.049 16:56:12 -- scripts/common.sh@339 -- # ver1_l=2 00:14:01.049 16:56:12 -- scripts/common.sh@340 -- # ver2_l=1 00:14:01.049 16:56:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:01.049 16:56:12 -- scripts/common.sh@343 -- # case "$op" in 00:14:01.049 16:56:12 -- scripts/common.sh@344 -- # : 1 00:14:01.049 16:56:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:01.049 16:56:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:01.049 16:56:12 -- scripts/common.sh@364 -- # decimal 1 00:14:01.049 16:56:12 -- scripts/common.sh@352 -- # local d=1 00:14:01.049 16:56:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:01.049 16:56:12 -- scripts/common.sh@354 -- # echo 1 00:14:01.049 16:56:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:01.049 16:56:12 -- scripts/common.sh@365 -- # decimal 2 00:14:01.049 16:56:12 -- scripts/common.sh@352 -- # local d=2 00:14:01.049 16:56:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:01.049 16:56:12 -- scripts/common.sh@354 -- # echo 2 00:14:01.049 16:56:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:01.049 16:56:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:01.049 16:56:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:01.049 16:56:12 -- scripts/common.sh@367 -- # return 0 00:14:01.049 16:56:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:01.049 16:56:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:01.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.049 --rc genhtml_branch_coverage=1 00:14:01.049 --rc genhtml_function_coverage=1 00:14:01.049 --rc genhtml_legend=1 00:14:01.049 --rc geninfo_all_blocks=1 00:14:01.049 --rc geninfo_unexecuted_blocks=1 00:14:01.049 00:14:01.049 ' 00:14:01.049 16:56:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:01.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.049 --rc genhtml_branch_coverage=1 00:14:01.049 --rc genhtml_function_coverage=1 00:14:01.049 --rc genhtml_legend=1 00:14:01.049 --rc geninfo_all_blocks=1 00:14:01.049 --rc geninfo_unexecuted_blocks=1 00:14:01.049 00:14:01.049 ' 00:14:01.049 16:56:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:01.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.049 --rc genhtml_branch_coverage=1 00:14:01.049 --rc genhtml_function_coverage=1 00:14:01.049 --rc genhtml_legend=1 00:14:01.049 --rc geninfo_all_blocks=1 00:14:01.049 --rc geninfo_unexecuted_blocks=1 00:14:01.049 00:14:01.050 ' 00:14:01.050 16:56:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:01.050 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.050 --rc genhtml_branch_coverage=1 00:14:01.050 --rc genhtml_function_coverage=1 00:14:01.050 --rc genhtml_legend=1 00:14:01.050 --rc geninfo_all_blocks=1 00:14:01.050 --rc geninfo_unexecuted_blocks=1 00:14:01.050 00:14:01.050 ' 00:14:01.050 16:56:12 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:01.050 16:56:12 -- nvmf/common.sh@7 -- # uname -s 00:14:01.050 16:56:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:01.050 16:56:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:01.050 16:56:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:01.050 16:56:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:01.050 16:56:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:01.050 16:56:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:01.050 16:56:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:01.050 16:56:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:01.050 16:56:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:01.050 16:56:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:01.050 16:56:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.050 16:56:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.050 16:56:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:01.050 16:56:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:01.050 16:56:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:01.050 16:56:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:01.050 16:56:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:01.050 16:56:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:01.050 16:56:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:01.050 16:56:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.050 16:56:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.050 16:56:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.050 16:56:12 -- paths/export.sh@5 -- # export PATH 00:14:01.050 16:56:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.050 16:56:12 -- nvmf/common.sh@46 -- # : 0 00:14:01.050 16:56:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:01.050 16:56:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:01.050 16:56:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:01.050 16:56:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:01.050 16:56:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:01.050 16:56:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:01.050 16:56:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:01.050 16:56:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:01.050 16:56:12 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:01.050 16:56:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:01.050 16:56:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:01.050 16:56:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:01.050 16:56:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:01.050 16:56:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:01.050 16:56:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:01.050 16:56:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:01.050 16:56:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.050 16:56:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:01.050 16:56:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:01.050 16:56:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:01.050 16:56:12 -- common/autotest_common.sh@10 -- # set +x 00:14:02.954 16:56:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:02.954 16:56:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:02.954 16:56:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:02.954 16:56:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:02.954 16:56:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:02.954 16:56:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:02.954 16:56:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:02.954 16:56:14 -- nvmf/common.sh@294 -- # net_devs=() 00:14:02.954 16:56:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:02.954 16:56:14 -- nvmf/common.sh@295 -- # e810=() 00:14:02.954 16:56:14 -- nvmf/common.sh@295 -- # local -ga e810 00:14:02.954 16:56:14 -- nvmf/common.sh@296 -- # x722=() 00:14:02.954 16:56:14 -- nvmf/common.sh@296 -- # local -ga x722 00:14:02.954 16:56:14 -- nvmf/common.sh@297 -- # mlx=() 00:14:02.954 16:56:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:02.954 16:56:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:02.954 16:56:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:02.954 16:56:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:02.954 16:56:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:02.954 16:56:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:02.954 16:56:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:02.954 16:56:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:02.954 16:56:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:02.954 16:56:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:02.954 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:02.954 16:56:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:02.954 16:56:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:02.954 16:56:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:02.954 16:56:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:02.954 16:56:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:02.954 16:56:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:02.954 16:56:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:02.954 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:02.954 16:56:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:02.954 16:56:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:02.955 16:56:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:02.955 16:56:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:02.955 16:56:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:02.955 16:56:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:02.955 16:56:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:02.955 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:02.955 16:56:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:02.955 16:56:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:02.955 16:56:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:02.955 16:56:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:02.955 16:56:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:02.955 16:56:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:02.955 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:02.955 16:56:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:02.955 16:56:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:02.955 16:56:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:02.955 16:56:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:02.955 16:56:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:02.955 16:56:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:02.955 16:56:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:02.955 16:56:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:02.955 16:56:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:02.955 16:56:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:02.955 16:56:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:02.955 16:56:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:02.955 16:56:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:02.955 16:56:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:02.955 16:56:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:02.955 16:56:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:02.955 16:56:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:02.955 16:56:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:02.955 16:56:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:02.955 16:56:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:02.955 16:56:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:02.955 16:56:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:02.955 16:56:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:02.955 16:56:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:02.955 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:02.955 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.240 ms 00:14:02.955 00:14:02.955 --- 10.0.0.2 ping statistics --- 00:14:02.955 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:02.955 rtt min/avg/max/mdev = 0.240/0.240/0.240/0.000 ms 00:14:02.955 16:56:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:02.955 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:02.955 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.064 ms 00:14:02.955 00:14:02.955 --- 10.0.0.1 ping statistics --- 00:14:02.955 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:02.955 rtt min/avg/max/mdev = 0.064/0.064/0.064/0.000 ms 00:14:02.955 16:56:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:02.955 16:56:14 -- nvmf/common.sh@410 -- # return 0 00:14:02.955 16:56:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:02.955 16:56:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:02.955 16:56:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:02.955 16:56:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:02.955 16:56:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:02.955 16:56:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:02.955 16:56:14 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:02.955 16:56:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:02.955 16:56:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:02.955 16:56:14 -- common/autotest_common.sh@10 -- # set +x 00:14:02.955 16:56:14 -- nvmf/common.sh@469 -- # nvmfpid=175278 00:14:02.955 16:56:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:02.955 16:56:14 -- nvmf/common.sh@470 -- # waitforlisten 175278 00:14:02.955 16:56:14 -- common/autotest_common.sh@829 -- # '[' -z 175278 ']' 00:14:02.955 16:56:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:02.955 16:56:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:02.955 16:56:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:02.955 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:02.955 16:56:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:02.955 16:56:14 -- common/autotest_common.sh@10 -- # set +x 00:14:02.955 [2024-11-29 16:56:14.215617] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:02.955 [2024-11-29 16:56:14.215706] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:02.955 EAL: No free 2048 kB hugepages reported on node 1 00:14:02.955 [2024-11-29 16:56:14.287146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:03.213 [2024-11-29 16:56:14.402781] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:03.213 [2024-11-29 16:56:14.402944] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:03.213 [2024-11-29 16:56:14.402973] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:03.213 [2024-11-29 16:56:14.402990] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:03.213 [2024-11-29 16:56:14.403058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:03.213 [2024-11-29 16:56:14.403066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:04.146 16:56:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:04.146 16:56:15 -- common/autotest_common.sh@862 -- # return 0 00:14:04.146 16:56:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:04.146 16:56:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:04.146 16:56:15 -- common/autotest_common.sh@10 -- # set +x 00:14:04.146 16:56:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:04.146 16:56:15 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:04.146 16:56:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.146 16:56:15 -- common/autotest_common.sh@10 -- # set +x 00:14:04.146 [2024-11-29 16:56:15.251398] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:04.146 16:56:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.146 16:56:15 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:04.146 16:56:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.146 16:56:15 -- common/autotest_common.sh@10 -- # set +x 00:14:04.146 16:56:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.146 16:56:15 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:04.146 16:56:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.146 16:56:15 -- common/autotest_common.sh@10 -- # set +x 00:14:04.146 [2024-11-29 16:56:15.267608] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:04.146 16:56:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.146 16:56:15 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:04.146 16:56:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.146 16:56:15 -- common/autotest_common.sh@10 -- # set +x 00:14:04.146 NULL1 00:14:04.147 16:56:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.147 16:56:15 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:04.147 16:56:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.147 16:56:15 -- common/autotest_common.sh@10 -- # set +x 00:14:04.147 Delay0 00:14:04.147 16:56:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.147 16:56:15 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.147 16:56:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.147 16:56:15 -- common/autotest_common.sh@10 -- # set +x 00:14:04.147 16:56:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.147 16:56:15 -- target/delete_subsystem.sh@28 -- # perf_pid=175435 00:14:04.147 16:56:15 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:04.147 16:56:15 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:04.147 EAL: No free 2048 kB hugepages reported on node 1 00:14:04.147 [2024-11-29 16:56:15.342372] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:06.044 16:56:17 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:06.044 16:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.044 16:56:17 -- common/autotest_common.sh@10 -- # set +x 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 starting I/O failed: -6 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 starting I/O failed: -6 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 starting I/O failed: -6 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 starting I/O failed: -6 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 starting I/O failed: -6 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 starting I/O failed: -6 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 starting I/O failed: -6 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 starting I/O failed: -6 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 starting I/O failed: -6 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Write completed with error (sct=0, sc=8) 00:14:06.044 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 [2024-11-29 16:56:17.423446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeb83d0 is same with the state(5) to be set 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Write completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 Read completed with error (sct=0, sc=8) 00:14:06.045 starting I/O failed: -6 00:14:06.046 Write completed with error (sct=0, sc=8) 00:14:06.046 Read completed with error (sct=0, sc=8) 00:14:06.046 starting I/O failed: -6 00:14:06.046 Read completed with error (sct=0, sc=8) 00:14:06.046 starting I/O failed: -6 00:14:06.046 starting I/O failed: -6 00:14:06.046 starting I/O failed: -6 00:14:06.046 starting I/O failed: -6 00:14:06.978 [2024-11-29 16:56:18.400590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeb1960 is same with the state(5) to be set 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 [2024-11-29 16:56:18.425077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f787c00c480 is same with the state(5) to be set 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 [2024-11-29 16:56:18.425586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe984c0 is same with the state(5) to be set 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 [2024-11-29 16:56:18.425799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98a20 is same with the state(5) to be set 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 Write completed with error (sct=0, sc=8) 00:14:07.236 Read completed with error (sct=0, sc=8) 00:14:07.236 [2024-11-29 16:56:18.426055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f787c00bf20 is same with the state(5) to be set 00:14:07.236 16:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.236 16:56:18 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:07.236 16:56:18 -- target/delete_subsystem.sh@35 -- # kill -0 175435 00:14:07.236 16:56:18 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:07.236 [2024-11-29 16:56:18.427115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xeb1960 (9): Bad file descriptor 00:14:07.236 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:07.236 Initializing NVMe Controllers 00:14:07.236 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:07.236 Controller IO queue size 128, less than required. 00:14:07.236 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:07.236 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:07.236 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:07.236 Initialization complete. Launching workers. 00:14:07.236 ======================================================== 00:14:07.236 Latency(us) 00:14:07.236 Device Information : IOPS MiB/s Average min max 00:14:07.236 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 176.74 0.09 881530.89 695.05 1011406.62 00:14:07.236 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 189.15 0.09 897159.80 715.97 1013256.34 00:14:07.236 ======================================================== 00:14:07.236 Total : 365.90 0.18 889610.42 695.05 1013256.34 00:14:07.236 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@35 -- # kill -0 175435 00:14:07.803 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (175435) - No such process 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@45 -- # NOT wait 175435 00:14:07.803 16:56:18 -- common/autotest_common.sh@650 -- # local es=0 00:14:07.803 16:56:18 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 175435 00:14:07.803 16:56:18 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:07.803 16:56:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:07.803 16:56:18 -- common/autotest_common.sh@642 -- # type -t wait 00:14:07.803 16:56:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:07.803 16:56:18 -- common/autotest_common.sh@653 -- # wait 175435 00:14:07.803 16:56:18 -- common/autotest_common.sh@653 -- # es=1 00:14:07.803 16:56:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:07.803 16:56:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:07.803 16:56:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:07.803 16:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.803 16:56:18 -- common/autotest_common.sh@10 -- # set +x 00:14:07.803 16:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:07.803 16:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.803 16:56:18 -- common/autotest_common.sh@10 -- # set +x 00:14:07.803 [2024-11-29 16:56:18.948198] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:07.803 16:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.803 16:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.803 16:56:18 -- common/autotest_common.sh@10 -- # set +x 00:14:07.803 16:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@54 -- # perf_pid=175850 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@57 -- # kill -0 175850 00:14:07.803 16:56:18 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:07.803 EAL: No free 2048 kB hugepages reported on node 1 00:14:07.803 [2024-11-29 16:56:19.014053] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:08.061 16:56:19 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:08.061 16:56:19 -- target/delete_subsystem.sh@57 -- # kill -0 175850 00:14:08.061 16:56:19 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:08.626 16:56:19 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:08.626 16:56:19 -- target/delete_subsystem.sh@57 -- # kill -0 175850 00:14:08.626 16:56:19 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:09.191 16:56:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:09.191 16:56:20 -- target/delete_subsystem.sh@57 -- # kill -0 175850 00:14:09.191 16:56:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:09.756 16:56:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:09.756 16:56:20 -- target/delete_subsystem.sh@57 -- # kill -0 175850 00:14:09.756 16:56:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:10.322 16:56:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:10.322 16:56:21 -- target/delete_subsystem.sh@57 -- # kill -0 175850 00:14:10.322 16:56:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:10.580 16:56:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:10.580 16:56:21 -- target/delete_subsystem.sh@57 -- # kill -0 175850 00:14:10.580 16:56:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:10.838 Initializing NVMe Controllers 00:14:10.838 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:10.838 Controller IO queue size 128, less than required. 00:14:10.838 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:10.838 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:10.838 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:10.838 Initialization complete. Launching workers. 00:14:10.838 ======================================================== 00:14:10.838 Latency(us) 00:14:10.838 Device Information : IOPS MiB/s Average min max 00:14:10.838 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004629.38 1000236.64 1011644.58 00:14:10.838 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1003909.36 1000212.80 1041444.53 00:14:10.838 ======================================================== 00:14:10.838 Total : 256.00 0.12 1004269.37 1000212.80 1041444.53 00:14:10.838 00:14:11.096 16:56:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:11.096 16:56:22 -- target/delete_subsystem.sh@57 -- # kill -0 175850 00:14:11.096 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (175850) - No such process 00:14:11.096 16:56:22 -- target/delete_subsystem.sh@67 -- # wait 175850 00:14:11.096 16:56:22 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:11.096 16:56:22 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:11.096 16:56:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:11.096 16:56:22 -- nvmf/common.sh@116 -- # sync 00:14:11.096 16:56:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:11.096 16:56:22 -- nvmf/common.sh@119 -- # set +e 00:14:11.096 16:56:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:11.096 16:56:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:11.096 rmmod nvme_tcp 00:14:11.096 rmmod nvme_fabrics 00:14:11.096 rmmod nvme_keyring 00:14:11.354 16:56:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:11.354 16:56:22 -- nvmf/common.sh@123 -- # set -e 00:14:11.354 16:56:22 -- nvmf/common.sh@124 -- # return 0 00:14:11.354 16:56:22 -- nvmf/common.sh@477 -- # '[' -n 175278 ']' 00:14:11.354 16:56:22 -- nvmf/common.sh@478 -- # killprocess 175278 00:14:11.354 16:56:22 -- common/autotest_common.sh@936 -- # '[' -z 175278 ']' 00:14:11.354 16:56:22 -- common/autotest_common.sh@940 -- # kill -0 175278 00:14:11.354 16:56:22 -- common/autotest_common.sh@941 -- # uname 00:14:11.354 16:56:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:11.354 16:56:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 175278 00:14:11.354 16:56:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:11.354 16:56:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:11.354 16:56:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 175278' 00:14:11.354 killing process with pid 175278 00:14:11.354 16:56:22 -- common/autotest_common.sh@955 -- # kill 175278 00:14:11.354 16:56:22 -- common/autotest_common.sh@960 -- # wait 175278 00:14:11.613 16:56:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:11.613 16:56:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:11.613 16:56:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:11.613 16:56:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:11.613 16:56:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:11.613 16:56:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:11.613 16:56:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:11.613 16:56:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:13.519 16:56:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:13.519 00:14:13.519 real 0m12.917s 00:14:13.519 user 0m29.366s 00:14:13.519 sys 0m2.885s 00:14:13.519 16:56:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:13.519 16:56:24 -- common/autotest_common.sh@10 -- # set +x 00:14:13.519 ************************************ 00:14:13.519 END TEST nvmf_delete_subsystem 00:14:13.519 ************************************ 00:14:13.519 16:56:24 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:13.519 16:56:24 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:13.519 16:56:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:13.519 16:56:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:13.519 16:56:24 -- common/autotest_common.sh@10 -- # set +x 00:14:13.519 ************************************ 00:14:13.519 START TEST nvmf_nvme_cli 00:14:13.519 ************************************ 00:14:13.519 16:56:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:13.778 * Looking for test storage... 00:14:13.778 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:13.778 16:56:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:13.778 16:56:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:13.778 16:56:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:13.778 16:56:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:13.778 16:56:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:13.778 16:56:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:13.778 16:56:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:13.778 16:56:25 -- scripts/common.sh@335 -- # IFS=.-: 00:14:13.778 16:56:25 -- scripts/common.sh@335 -- # read -ra ver1 00:14:13.778 16:56:25 -- scripts/common.sh@336 -- # IFS=.-: 00:14:13.778 16:56:25 -- scripts/common.sh@336 -- # read -ra ver2 00:14:13.778 16:56:25 -- scripts/common.sh@337 -- # local 'op=<' 00:14:13.778 16:56:25 -- scripts/common.sh@339 -- # ver1_l=2 00:14:13.778 16:56:25 -- scripts/common.sh@340 -- # ver2_l=1 00:14:13.778 16:56:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:13.778 16:56:25 -- scripts/common.sh@343 -- # case "$op" in 00:14:13.778 16:56:25 -- scripts/common.sh@344 -- # : 1 00:14:13.778 16:56:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:13.778 16:56:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:13.778 16:56:25 -- scripts/common.sh@364 -- # decimal 1 00:14:13.778 16:56:25 -- scripts/common.sh@352 -- # local d=1 00:14:13.778 16:56:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:13.778 16:56:25 -- scripts/common.sh@354 -- # echo 1 00:14:13.778 16:56:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:13.778 16:56:25 -- scripts/common.sh@365 -- # decimal 2 00:14:13.778 16:56:25 -- scripts/common.sh@352 -- # local d=2 00:14:13.778 16:56:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:13.778 16:56:25 -- scripts/common.sh@354 -- # echo 2 00:14:13.778 16:56:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:13.778 16:56:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:13.778 16:56:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:13.778 16:56:25 -- scripts/common.sh@367 -- # return 0 00:14:13.778 16:56:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:13.778 16:56:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:13.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:13.778 --rc genhtml_branch_coverage=1 00:14:13.778 --rc genhtml_function_coverage=1 00:14:13.778 --rc genhtml_legend=1 00:14:13.778 --rc geninfo_all_blocks=1 00:14:13.778 --rc geninfo_unexecuted_blocks=1 00:14:13.778 00:14:13.778 ' 00:14:13.778 16:56:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:13.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:13.778 --rc genhtml_branch_coverage=1 00:14:13.778 --rc genhtml_function_coverage=1 00:14:13.778 --rc genhtml_legend=1 00:14:13.778 --rc geninfo_all_blocks=1 00:14:13.778 --rc geninfo_unexecuted_blocks=1 00:14:13.778 00:14:13.778 ' 00:14:13.778 16:56:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:13.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:13.778 --rc genhtml_branch_coverage=1 00:14:13.778 --rc genhtml_function_coverage=1 00:14:13.778 --rc genhtml_legend=1 00:14:13.778 --rc geninfo_all_blocks=1 00:14:13.778 --rc geninfo_unexecuted_blocks=1 00:14:13.778 00:14:13.778 ' 00:14:13.778 16:56:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:13.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:13.778 --rc genhtml_branch_coverage=1 00:14:13.778 --rc genhtml_function_coverage=1 00:14:13.778 --rc genhtml_legend=1 00:14:13.778 --rc geninfo_all_blocks=1 00:14:13.778 --rc geninfo_unexecuted_blocks=1 00:14:13.778 00:14:13.778 ' 00:14:13.778 16:56:25 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:13.778 16:56:25 -- nvmf/common.sh@7 -- # uname -s 00:14:13.778 16:56:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:13.778 16:56:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:13.778 16:56:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:13.778 16:56:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:13.778 16:56:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:13.778 16:56:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:13.778 16:56:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:13.778 16:56:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:13.778 16:56:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:13.778 16:56:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:13.778 16:56:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:13.778 16:56:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:13.778 16:56:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:13.778 16:56:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:13.778 16:56:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:13.778 16:56:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:13.778 16:56:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:13.778 16:56:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:13.778 16:56:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:13.778 16:56:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.778 16:56:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.779 16:56:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.779 16:56:25 -- paths/export.sh@5 -- # export PATH 00:14:13.779 16:56:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.779 16:56:25 -- nvmf/common.sh@46 -- # : 0 00:14:13.779 16:56:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:13.779 16:56:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:13.779 16:56:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:13.779 16:56:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:13.779 16:56:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:13.779 16:56:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:13.779 16:56:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:13.779 16:56:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:13.779 16:56:25 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:13.779 16:56:25 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:13.779 16:56:25 -- target/nvme_cli.sh@14 -- # devs=() 00:14:13.779 16:56:25 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:13.779 16:56:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:13.779 16:56:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:13.779 16:56:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:13.779 16:56:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:13.779 16:56:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:13.779 16:56:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:13.779 16:56:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:13.779 16:56:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:13.779 16:56:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:13.779 16:56:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:13.779 16:56:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:13.779 16:56:25 -- common/autotest_common.sh@10 -- # set +x 00:14:15.681 16:56:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:15.681 16:56:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:15.681 16:56:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:15.681 16:56:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:15.681 16:56:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:15.681 16:56:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:15.681 16:56:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:15.681 16:56:27 -- nvmf/common.sh@294 -- # net_devs=() 00:14:15.681 16:56:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:15.681 16:56:27 -- nvmf/common.sh@295 -- # e810=() 00:14:15.681 16:56:27 -- nvmf/common.sh@295 -- # local -ga e810 00:14:15.681 16:56:27 -- nvmf/common.sh@296 -- # x722=() 00:14:15.681 16:56:27 -- nvmf/common.sh@296 -- # local -ga x722 00:14:15.681 16:56:27 -- nvmf/common.sh@297 -- # mlx=() 00:14:15.681 16:56:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:15.681 16:56:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:15.681 16:56:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:15.682 16:56:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:15.682 16:56:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:15.682 16:56:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:15.682 16:56:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:15.682 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:15.682 16:56:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:15.682 16:56:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:15.682 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:15.682 16:56:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:15.682 16:56:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:15.682 16:56:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:15.682 16:56:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:15.682 16:56:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:15.682 16:56:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:15.682 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:15.682 16:56:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:15.682 16:56:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:15.682 16:56:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:15.682 16:56:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:15.682 16:56:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:15.682 16:56:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:15.682 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:15.682 16:56:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:15.682 16:56:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:15.682 16:56:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:15.682 16:56:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:15.682 16:56:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:15.682 16:56:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:15.682 16:56:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:15.682 16:56:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:15.682 16:56:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:15.682 16:56:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:15.682 16:56:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:15.682 16:56:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:15.682 16:56:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:15.682 16:56:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:15.682 16:56:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:15.682 16:56:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:15.682 16:56:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:15.682 16:56:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:15.940 16:56:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:15.940 16:56:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:15.940 16:56:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:15.940 16:56:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:15.940 16:56:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:15.940 16:56:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:15.940 16:56:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:15.940 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:15.940 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.329 ms 00:14:15.940 00:14:15.940 --- 10.0.0.2 ping statistics --- 00:14:15.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:15.940 rtt min/avg/max/mdev = 0.329/0.329/0.329/0.000 ms 00:14:15.940 16:56:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:15.940 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:15.940 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:14:15.940 00:14:15.940 --- 10.0.0.1 ping statistics --- 00:14:15.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:15.940 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:14:15.940 16:56:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:15.940 16:56:27 -- nvmf/common.sh@410 -- # return 0 00:14:15.940 16:56:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:15.940 16:56:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:15.940 16:56:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:15.940 16:56:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:15.940 16:56:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:15.940 16:56:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:15.940 16:56:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:15.940 16:56:27 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:15.940 16:56:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:15.940 16:56:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:15.940 16:56:27 -- common/autotest_common.sh@10 -- # set +x 00:14:15.940 16:56:27 -- nvmf/common.sh@469 -- # nvmfpid=178218 00:14:15.940 16:56:27 -- nvmf/common.sh@470 -- # waitforlisten 178218 00:14:15.940 16:56:27 -- common/autotest_common.sh@829 -- # '[' -z 178218 ']' 00:14:15.940 16:56:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:15.940 16:56:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:15.940 16:56:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:15.940 16:56:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:15.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:15.940 16:56:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:15.940 16:56:27 -- common/autotest_common.sh@10 -- # set +x 00:14:15.940 [2024-11-29 16:56:27.249763] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:15.940 [2024-11-29 16:56:27.249840] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:15.940 EAL: No free 2048 kB hugepages reported on node 1 00:14:15.940 [2024-11-29 16:56:27.317235] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:16.198 [2024-11-29 16:56:27.439307] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:16.198 [2024-11-29 16:56:27.439455] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:16.198 [2024-11-29 16:56:27.439474] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:16.198 [2024-11-29 16:56:27.439487] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:16.198 [2024-11-29 16:56:27.441985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:16.198 [2024-11-29 16:56:27.442045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:16.198 [2024-11-29 16:56:27.442130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:16.198 [2024-11-29 16:56:27.442133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:17.131 16:56:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:17.131 16:56:28 -- common/autotest_common.sh@862 -- # return 0 00:14:17.131 16:56:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:17.131 16:56:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:17.131 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:14:17.131 16:56:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:17.131 16:56:28 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:17.131 16:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.131 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:14:17.131 [2024-11-29 16:56:28.275617] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:17.131 16:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.131 16:56:28 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:17.131 16:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.131 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:14:17.131 Malloc0 00:14:17.131 16:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.131 16:56:28 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:17.131 16:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.131 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:14:17.131 Malloc1 00:14:17.131 16:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.131 16:56:28 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:17.131 16:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.131 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:14:17.132 16:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.132 16:56:28 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:17.132 16:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.132 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:14:17.132 16:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.132 16:56:28 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:17.132 16:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.132 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:14:17.132 16:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.132 16:56:28 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:17.132 16:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.132 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:14:17.132 [2024-11-29 16:56:28.361408] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:17.132 16:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.132 16:56:28 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:17.132 16:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.132 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:14:17.132 16:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.132 16:56:28 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:17.132 00:14:17.132 Discovery Log Number of Records 2, Generation counter 2 00:14:17.132 =====Discovery Log Entry 0====== 00:14:17.132 trtype: tcp 00:14:17.132 adrfam: ipv4 00:14:17.132 subtype: current discovery subsystem 00:14:17.132 treq: not required 00:14:17.132 portid: 0 00:14:17.132 trsvcid: 4420 00:14:17.132 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:17.132 traddr: 10.0.0.2 00:14:17.132 eflags: explicit discovery connections, duplicate discovery information 00:14:17.132 sectype: none 00:14:17.132 =====Discovery Log Entry 1====== 00:14:17.132 trtype: tcp 00:14:17.132 adrfam: ipv4 00:14:17.132 subtype: nvme subsystem 00:14:17.132 treq: not required 00:14:17.132 portid: 0 00:14:17.132 trsvcid: 4420 00:14:17.132 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:17.132 traddr: 10.0.0.2 00:14:17.132 eflags: none 00:14:17.132 sectype: none 00:14:17.132 16:56:28 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:17.132 16:56:28 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:17.132 16:56:28 -- nvmf/common.sh@510 -- # local dev _ 00:14:17.132 16:56:28 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:17.132 16:56:28 -- nvmf/common.sh@509 -- # nvme list 00:14:17.390 16:56:28 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:17.390 16:56:28 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:17.390 16:56:28 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:17.390 16:56:28 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:17.390 16:56:28 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:17.390 16:56:28 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:17.955 16:56:29 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:17.955 16:56:29 -- common/autotest_common.sh@1187 -- # local i=0 00:14:17.955 16:56:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:17.955 16:56:29 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:17.955 16:56:29 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:17.955 16:56:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:19.853 16:56:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:19.853 16:56:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:19.853 16:56:31 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:19.853 16:56:31 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:19.853 16:56:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:19.853 16:56:31 -- common/autotest_common.sh@1197 -- # return 0 00:14:19.853 16:56:31 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:19.853 16:56:31 -- nvmf/common.sh@510 -- # local dev _ 00:14:19.853 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:19.853 16:56:31 -- nvmf/common.sh@509 -- # nvme list 00:14:20.111 16:56:31 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:20.111 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:20.111 16:56:31 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:20.111 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:20.111 16:56:31 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:20.111 16:56:31 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:20.111 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:20.111 16:56:31 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:20.111 16:56:31 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:20.111 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:20.111 16:56:31 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:20.111 /dev/nvme0n2 ]] 00:14:20.111 16:56:31 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:20.111 16:56:31 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:20.111 16:56:31 -- nvmf/common.sh@510 -- # local dev _ 00:14:20.111 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:20.111 16:56:31 -- nvmf/common.sh@509 -- # nvme list 00:14:20.368 16:56:31 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:20.368 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:20.368 16:56:31 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:20.368 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:20.368 16:56:31 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:20.368 16:56:31 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:20.368 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:20.368 16:56:31 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:20.368 16:56:31 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:20.368 16:56:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:20.368 16:56:31 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:20.368 16:56:31 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:20.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:20.626 16:56:31 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:20.626 16:56:31 -- common/autotest_common.sh@1208 -- # local i=0 00:14:20.626 16:56:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:20.626 16:56:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:20.626 16:56:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:20.626 16:56:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:20.626 16:56:31 -- common/autotest_common.sh@1220 -- # return 0 00:14:20.626 16:56:31 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:20.626 16:56:31 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:20.626 16:56:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.626 16:56:31 -- common/autotest_common.sh@10 -- # set +x 00:14:20.626 16:56:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.626 16:56:31 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:20.626 16:56:31 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:20.626 16:56:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:20.626 16:56:31 -- nvmf/common.sh@116 -- # sync 00:14:20.626 16:56:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:20.626 16:56:31 -- nvmf/common.sh@119 -- # set +e 00:14:20.626 16:56:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:20.626 16:56:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:20.626 rmmod nvme_tcp 00:14:20.626 rmmod nvme_fabrics 00:14:20.626 rmmod nvme_keyring 00:14:20.626 16:56:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:20.626 16:56:31 -- nvmf/common.sh@123 -- # set -e 00:14:20.626 16:56:31 -- nvmf/common.sh@124 -- # return 0 00:14:20.626 16:56:31 -- nvmf/common.sh@477 -- # '[' -n 178218 ']' 00:14:20.627 16:56:31 -- nvmf/common.sh@478 -- # killprocess 178218 00:14:20.627 16:56:31 -- common/autotest_common.sh@936 -- # '[' -z 178218 ']' 00:14:20.627 16:56:31 -- common/autotest_common.sh@940 -- # kill -0 178218 00:14:20.627 16:56:31 -- common/autotest_common.sh@941 -- # uname 00:14:20.627 16:56:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:20.627 16:56:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 178218 00:14:20.627 16:56:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:20.627 16:56:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:20.627 16:56:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 178218' 00:14:20.627 killing process with pid 178218 00:14:20.627 16:56:31 -- common/autotest_common.sh@955 -- # kill 178218 00:14:20.627 16:56:31 -- common/autotest_common.sh@960 -- # wait 178218 00:14:20.885 16:56:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:20.885 16:56:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:20.885 16:56:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:20.885 16:56:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:20.885 16:56:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:20.885 16:56:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:20.885 16:56:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:20.885 16:56:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:23.421 16:56:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:23.421 00:14:23.421 real 0m9.358s 00:14:23.421 user 0m19.787s 00:14:23.421 sys 0m2.291s 00:14:23.421 16:56:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:23.421 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:14:23.421 ************************************ 00:14:23.421 END TEST nvmf_nvme_cli 00:14:23.421 ************************************ 00:14:23.421 16:56:34 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:23.421 16:56:34 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:23.421 16:56:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:23.421 16:56:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:23.421 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:14:23.421 ************************************ 00:14:23.421 START TEST nvmf_host_management 00:14:23.421 ************************************ 00:14:23.421 16:56:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:23.421 * Looking for test storage... 00:14:23.421 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:23.421 16:56:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:23.421 16:56:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:23.421 16:56:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:23.421 16:56:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:23.421 16:56:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:23.421 16:56:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:23.421 16:56:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:23.421 16:56:34 -- scripts/common.sh@335 -- # IFS=.-: 00:14:23.421 16:56:34 -- scripts/common.sh@335 -- # read -ra ver1 00:14:23.421 16:56:34 -- scripts/common.sh@336 -- # IFS=.-: 00:14:23.421 16:56:34 -- scripts/common.sh@336 -- # read -ra ver2 00:14:23.421 16:56:34 -- scripts/common.sh@337 -- # local 'op=<' 00:14:23.421 16:56:34 -- scripts/common.sh@339 -- # ver1_l=2 00:14:23.421 16:56:34 -- scripts/common.sh@340 -- # ver2_l=1 00:14:23.421 16:56:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:23.421 16:56:34 -- scripts/common.sh@343 -- # case "$op" in 00:14:23.421 16:56:34 -- scripts/common.sh@344 -- # : 1 00:14:23.421 16:56:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:23.421 16:56:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:23.421 16:56:34 -- scripts/common.sh@364 -- # decimal 1 00:14:23.421 16:56:34 -- scripts/common.sh@352 -- # local d=1 00:14:23.421 16:56:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:23.421 16:56:34 -- scripts/common.sh@354 -- # echo 1 00:14:23.421 16:56:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:23.421 16:56:34 -- scripts/common.sh@365 -- # decimal 2 00:14:23.421 16:56:34 -- scripts/common.sh@352 -- # local d=2 00:14:23.421 16:56:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:23.421 16:56:34 -- scripts/common.sh@354 -- # echo 2 00:14:23.421 16:56:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:23.421 16:56:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:23.421 16:56:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:23.421 16:56:34 -- scripts/common.sh@367 -- # return 0 00:14:23.421 16:56:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:23.421 16:56:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:23.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:23.421 --rc genhtml_branch_coverage=1 00:14:23.421 --rc genhtml_function_coverage=1 00:14:23.421 --rc genhtml_legend=1 00:14:23.421 --rc geninfo_all_blocks=1 00:14:23.421 --rc geninfo_unexecuted_blocks=1 00:14:23.421 00:14:23.421 ' 00:14:23.421 16:56:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:23.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:23.421 --rc genhtml_branch_coverage=1 00:14:23.421 --rc genhtml_function_coverage=1 00:14:23.421 --rc genhtml_legend=1 00:14:23.421 --rc geninfo_all_blocks=1 00:14:23.421 --rc geninfo_unexecuted_blocks=1 00:14:23.421 00:14:23.421 ' 00:14:23.422 16:56:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:23.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:23.422 --rc genhtml_branch_coverage=1 00:14:23.422 --rc genhtml_function_coverage=1 00:14:23.422 --rc genhtml_legend=1 00:14:23.422 --rc geninfo_all_blocks=1 00:14:23.422 --rc geninfo_unexecuted_blocks=1 00:14:23.422 00:14:23.422 ' 00:14:23.422 16:56:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:23.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:23.422 --rc genhtml_branch_coverage=1 00:14:23.422 --rc genhtml_function_coverage=1 00:14:23.422 --rc genhtml_legend=1 00:14:23.422 --rc geninfo_all_blocks=1 00:14:23.422 --rc geninfo_unexecuted_blocks=1 00:14:23.422 00:14:23.422 ' 00:14:23.422 16:56:34 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:23.422 16:56:34 -- nvmf/common.sh@7 -- # uname -s 00:14:23.422 16:56:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:23.422 16:56:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:23.422 16:56:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:23.422 16:56:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:23.422 16:56:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:23.422 16:56:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:23.422 16:56:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:23.422 16:56:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:23.422 16:56:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:23.422 16:56:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:23.422 16:56:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:23.422 16:56:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:23.422 16:56:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:23.422 16:56:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:23.422 16:56:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:23.422 16:56:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:23.422 16:56:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:23.422 16:56:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:23.422 16:56:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:23.422 16:56:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:23.422 16:56:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:23.422 16:56:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:23.422 16:56:34 -- paths/export.sh@5 -- # export PATH 00:14:23.422 16:56:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:23.422 16:56:34 -- nvmf/common.sh@46 -- # : 0 00:14:23.422 16:56:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:23.422 16:56:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:23.422 16:56:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:23.422 16:56:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:23.422 16:56:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:23.422 16:56:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:23.422 16:56:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:23.422 16:56:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:23.422 16:56:34 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:23.422 16:56:34 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:23.422 16:56:34 -- target/host_management.sh@104 -- # nvmftestinit 00:14:23.422 16:56:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:23.422 16:56:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:23.422 16:56:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:23.422 16:56:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:23.422 16:56:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:23.422 16:56:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:23.422 16:56:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:23.422 16:56:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:23.422 16:56:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:23.422 16:56:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:23.422 16:56:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:23.422 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:14:25.326 16:56:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:25.326 16:56:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:25.326 16:56:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:25.326 16:56:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:25.326 16:56:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:25.326 16:56:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:25.326 16:56:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:25.326 16:56:36 -- nvmf/common.sh@294 -- # net_devs=() 00:14:25.326 16:56:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:25.326 16:56:36 -- nvmf/common.sh@295 -- # e810=() 00:14:25.326 16:56:36 -- nvmf/common.sh@295 -- # local -ga e810 00:14:25.326 16:56:36 -- nvmf/common.sh@296 -- # x722=() 00:14:25.326 16:56:36 -- nvmf/common.sh@296 -- # local -ga x722 00:14:25.326 16:56:36 -- nvmf/common.sh@297 -- # mlx=() 00:14:25.326 16:56:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:25.326 16:56:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:25.326 16:56:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:25.326 16:56:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:25.326 16:56:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:25.326 16:56:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:25.326 16:56:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:25.326 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:25.326 16:56:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:25.326 16:56:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:25.326 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:25.326 16:56:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:25.326 16:56:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:25.326 16:56:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:25.326 16:56:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:25.326 16:56:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:25.326 16:56:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:25.326 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:25.326 16:56:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:25.326 16:56:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:25.326 16:56:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:25.326 16:56:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:25.326 16:56:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:25.326 16:56:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:25.326 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:25.326 16:56:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:25.326 16:56:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:25.326 16:56:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:25.326 16:56:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:25.326 16:56:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:25.326 16:56:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:25.326 16:56:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:25.326 16:56:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:25.327 16:56:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:25.327 16:56:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:25.327 16:56:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:25.327 16:56:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:25.327 16:56:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:25.327 16:56:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:25.327 16:56:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:25.327 16:56:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:25.327 16:56:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:25.327 16:56:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:25.327 16:56:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:25.327 16:56:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:25.327 16:56:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:25.327 16:56:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:25.327 16:56:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:25.327 16:56:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:25.327 16:56:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:25.327 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:25.327 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:14:25.327 00:14:25.327 --- 10.0.0.2 ping statistics --- 00:14:25.327 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:25.327 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:14:25.327 16:56:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:25.327 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:25.327 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:14:25.327 00:14:25.327 --- 10.0.0.1 ping statistics --- 00:14:25.327 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:25.327 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:14:25.327 16:56:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:25.327 16:56:36 -- nvmf/common.sh@410 -- # return 0 00:14:25.327 16:56:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:25.327 16:56:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:25.327 16:56:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:25.327 16:56:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:25.327 16:56:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:25.327 16:56:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:25.327 16:56:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:25.327 16:56:36 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:25.327 16:56:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:25.327 16:56:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:25.327 16:56:36 -- common/autotest_common.sh@10 -- # set +x 00:14:25.327 ************************************ 00:14:25.327 START TEST nvmf_host_management 00:14:25.327 ************************************ 00:14:25.327 16:56:36 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:25.327 16:56:36 -- target/host_management.sh@69 -- # starttarget 00:14:25.327 16:56:36 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:25.327 16:56:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:25.327 16:56:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:25.327 16:56:36 -- common/autotest_common.sh@10 -- # set +x 00:14:25.327 16:56:36 -- nvmf/common.sh@469 -- # nvmfpid=180770 00:14:25.327 16:56:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:25.327 16:56:36 -- nvmf/common.sh@470 -- # waitforlisten 180770 00:14:25.327 16:56:36 -- common/autotest_common.sh@829 -- # '[' -z 180770 ']' 00:14:25.327 16:56:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:25.327 16:56:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:25.327 16:56:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:25.327 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:25.327 16:56:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:25.327 16:56:36 -- common/autotest_common.sh@10 -- # set +x 00:14:25.327 [2024-11-29 16:56:36.684842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:25.327 [2024-11-29 16:56:36.684921] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:25.327 EAL: No free 2048 kB hugepages reported on node 1 00:14:25.585 [2024-11-29 16:56:36.760045] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:25.585 [2024-11-29 16:56:36.880268] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:25.585 [2024-11-29 16:56:36.880437] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:25.585 [2024-11-29 16:56:36.880456] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:25.585 [2024-11-29 16:56:36.880471] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:25.585 [2024-11-29 16:56:36.880589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:25.585 [2024-11-29 16:56:36.880685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:25.585 [2024-11-29 16:56:36.880746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:25.585 [2024-11-29 16:56:36.880749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:26.519 16:56:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:26.519 16:56:37 -- common/autotest_common.sh@862 -- # return 0 00:14:26.519 16:56:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:26.519 16:56:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:26.519 16:56:37 -- common/autotest_common.sh@10 -- # set +x 00:14:26.519 16:56:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:26.519 16:56:37 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:26.519 16:56:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.519 16:56:37 -- common/autotest_common.sh@10 -- # set +x 00:14:26.519 [2024-11-29 16:56:37.728707] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:26.519 16:56:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.519 16:56:37 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:26.519 16:56:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:26.519 16:56:37 -- common/autotest_common.sh@10 -- # set +x 00:14:26.519 16:56:37 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:26.519 16:56:37 -- target/host_management.sh@23 -- # cat 00:14:26.519 16:56:37 -- target/host_management.sh@30 -- # rpc_cmd 00:14:26.519 16:56:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.519 16:56:37 -- common/autotest_common.sh@10 -- # set +x 00:14:26.519 Malloc0 00:14:26.519 [2024-11-29 16:56:37.794368] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:26.519 16:56:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.519 16:56:37 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:26.519 16:56:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:26.519 16:56:37 -- common/autotest_common.sh@10 -- # set +x 00:14:26.519 16:56:37 -- target/host_management.sh@73 -- # perfpid=180946 00:14:26.519 16:56:37 -- target/host_management.sh@74 -- # waitforlisten 180946 /var/tmp/bdevperf.sock 00:14:26.519 16:56:37 -- common/autotest_common.sh@829 -- # '[' -z 180946 ']' 00:14:26.519 16:56:37 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:26.519 16:56:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:26.519 16:56:37 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:26.519 16:56:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:26.519 16:56:37 -- nvmf/common.sh@520 -- # config=() 00:14:26.519 16:56:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:26.519 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:26.519 16:56:37 -- nvmf/common.sh@520 -- # local subsystem config 00:14:26.519 16:56:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:26.519 16:56:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:26.519 16:56:37 -- common/autotest_common.sh@10 -- # set +x 00:14:26.519 16:56:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:26.519 { 00:14:26.519 "params": { 00:14:26.519 "name": "Nvme$subsystem", 00:14:26.519 "trtype": "$TEST_TRANSPORT", 00:14:26.519 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:26.519 "adrfam": "ipv4", 00:14:26.519 "trsvcid": "$NVMF_PORT", 00:14:26.519 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:26.519 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:26.519 "hdgst": ${hdgst:-false}, 00:14:26.519 "ddgst": ${ddgst:-false} 00:14:26.519 }, 00:14:26.519 "method": "bdev_nvme_attach_controller" 00:14:26.519 } 00:14:26.519 EOF 00:14:26.519 )") 00:14:26.519 16:56:37 -- nvmf/common.sh@542 -- # cat 00:14:26.519 16:56:37 -- nvmf/common.sh@544 -- # jq . 00:14:26.519 16:56:37 -- nvmf/common.sh@545 -- # IFS=, 00:14:26.519 16:56:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:26.519 "params": { 00:14:26.519 "name": "Nvme0", 00:14:26.519 "trtype": "tcp", 00:14:26.519 "traddr": "10.0.0.2", 00:14:26.519 "adrfam": "ipv4", 00:14:26.519 "trsvcid": "4420", 00:14:26.519 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:26.519 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:26.519 "hdgst": false, 00:14:26.519 "ddgst": false 00:14:26.519 }, 00:14:26.519 "method": "bdev_nvme_attach_controller" 00:14:26.519 }' 00:14:26.519 [2024-11-29 16:56:37.866053] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:26.519 [2024-11-29 16:56:37.866129] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid180946 ] 00:14:26.519 EAL: No free 2048 kB hugepages reported on node 1 00:14:26.519 [2024-11-29 16:56:37.928458] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:26.777 [2024-11-29 16:56:38.038233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:27.036 Running I/O for 10 seconds... 00:14:27.603 16:56:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:27.603 16:56:38 -- common/autotest_common.sh@862 -- # return 0 00:14:27.603 16:56:38 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:27.603 16:56:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.603 16:56:38 -- common/autotest_common.sh@10 -- # set +x 00:14:27.603 16:56:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.603 16:56:38 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:27.603 16:56:38 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:27.603 16:56:38 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:27.603 16:56:38 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:27.603 16:56:38 -- target/host_management.sh@52 -- # local ret=1 00:14:27.603 16:56:38 -- target/host_management.sh@53 -- # local i 00:14:27.603 16:56:38 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:27.603 16:56:38 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:27.603 16:56:38 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:27.603 16:56:38 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:27.603 16:56:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.603 16:56:38 -- common/autotest_common.sh@10 -- # set +x 00:14:27.603 16:56:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.603 16:56:38 -- target/host_management.sh@55 -- # read_io_count=2055 00:14:27.603 16:56:38 -- target/host_management.sh@58 -- # '[' 2055 -ge 100 ']' 00:14:27.603 16:56:38 -- target/host_management.sh@59 -- # ret=0 00:14:27.603 16:56:38 -- target/host_management.sh@60 -- # break 00:14:27.603 16:56:38 -- target/host_management.sh@64 -- # return 0 00:14:27.603 16:56:38 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:27.603 16:56:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.603 16:56:38 -- common/autotest_common.sh@10 -- # set +x 00:14:27.603 [2024-11-29 16:56:38.947088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e4e60 is same with the state(5) to be set 00:14:27.603 [2024-11-29 16:56:38.947766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.603 [2024-11-29 16:56:38.947816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.603 [2024-11-29 16:56:38.947861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.603 [2024-11-29 16:56:38.947888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.603 [2024-11-29 16:56:38.947919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.603 [2024-11-29 16:56:38.947945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.603 [2024-11-29 16:56:38.947982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.603 [2024-11-29 16:56:38.948009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.603 [2024-11-29 16:56:38.948035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.603 [2024-11-29 16:56:38.948061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.603 [2024-11-29 16:56:38.948087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.603 [2024-11-29 16:56:38.948114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.603 [2024-11-29 16:56:38.948139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.603 [2024-11-29 16:56:38.948170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.603 [2024-11-29 16:56:38.948197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.948919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.948956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.949949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.949984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.950012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.950036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.950063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.950087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.950113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.950137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.950163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.950193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.950220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.604 [2024-11-29 16:56:38.950244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.604 [2024-11-29 16:56:38.950275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.950956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.950990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.951013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.951038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.951065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.951088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.951120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.951150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.951176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:27.605 [2024-11-29 16:56:38.951200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 16:56:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.605 [2024-11-29 16:56:38.951325] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1500030 was disconnected and freed. reset controller. 00:14:27.605 [2024-11-29 16:56:38.951417] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns 16:56:38 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:27.605 id:0 cdw10:00000000 cdw11:00000000 00:14:27.605 [2024-11-29 16:56:38.951451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.951476] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:14:27.605 [2024-11-29 16:56:38.951501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.951523] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:14:27.605 [2024-11-29 16:56:38.951549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c 16:56:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.605 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.951579] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:14:27.605 [2024-11-29 16:56:38.951603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:27.605 [2024-11-29 16:56:38.951632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1502160 is same with the state(5) to be set 00:14:27.605 16:56:38 -- common/autotest_common.sh@10 -- # set +x 00:14:27.605 [2024-11-29 16:56:38.952977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:27.605 task offset: 20480 on job bdev=Nvme0n1 fails 00:14:27.605 00:14:27.605 Latency(us) 00:14:27.605 [2024-11-29T15:56:39.036Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:27.605 [2024-11-29T15:56:39.036Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:27.605 [2024-11-29T15:56:39.036Z] Job: Nvme0n1 ended in about 0.57 seconds with error 00:14:27.605 Verification LBA range: start 0x0 length 0x400 00:14:27.605 Nvme0n1 : 0.57 3909.07 244.32 112.09 0.00 15662.31 4417.61 22524.97 00:14:27.605 [2024-11-29T15:56:39.036Z] =================================================================================================================== 00:14:27.605 [2024-11-29T15:56:39.036Z] Total : 3909.07 244.32 112.09 0.00 15662.31 4417.61 22524.97 00:14:27.605 [2024-11-29 16:56:38.955197] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:27.605 [2024-11-29 16:56:38.955247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1502160 (9): Bad file descriptor 00:14:27.605 16:56:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.605 16:56:38 -- target/host_management.sh@87 -- # sleep 1 00:14:27.863 [2024-11-29 16:56:39.089092] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:28.796 16:56:39 -- target/host_management.sh@91 -- # kill -9 180946 00:14:28.796 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (180946) - No such process 00:14:28.796 16:56:39 -- target/host_management.sh@91 -- # true 00:14:28.796 16:56:39 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:28.796 16:56:39 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:28.796 16:56:39 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:28.796 16:56:39 -- nvmf/common.sh@520 -- # config=() 00:14:28.796 16:56:39 -- nvmf/common.sh@520 -- # local subsystem config 00:14:28.796 16:56:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:28.796 16:56:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:28.796 { 00:14:28.796 "params": { 00:14:28.796 "name": "Nvme$subsystem", 00:14:28.796 "trtype": "$TEST_TRANSPORT", 00:14:28.796 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:28.796 "adrfam": "ipv4", 00:14:28.796 "trsvcid": "$NVMF_PORT", 00:14:28.796 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:28.796 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:28.796 "hdgst": ${hdgst:-false}, 00:14:28.796 "ddgst": ${ddgst:-false} 00:14:28.796 }, 00:14:28.796 "method": "bdev_nvme_attach_controller" 00:14:28.796 } 00:14:28.796 EOF 00:14:28.796 )") 00:14:28.796 16:56:39 -- nvmf/common.sh@542 -- # cat 00:14:28.796 16:56:39 -- nvmf/common.sh@544 -- # jq . 00:14:28.796 16:56:39 -- nvmf/common.sh@545 -- # IFS=, 00:14:28.796 16:56:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:28.796 "params": { 00:14:28.796 "name": "Nvme0", 00:14:28.796 "trtype": "tcp", 00:14:28.796 "traddr": "10.0.0.2", 00:14:28.796 "adrfam": "ipv4", 00:14:28.796 "trsvcid": "4420", 00:14:28.796 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:28.796 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:28.796 "hdgst": false, 00:14:28.796 "ddgst": false 00:14:28.796 }, 00:14:28.796 "method": "bdev_nvme_attach_controller" 00:14:28.796 }' 00:14:28.796 [2024-11-29 16:56:40.004752] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:28.796 [2024-11-29 16:56:40.004831] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid181230 ] 00:14:28.796 EAL: No free 2048 kB hugepages reported on node 1 00:14:28.796 [2024-11-29 16:56:40.066514] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:28.796 [2024-11-29 16:56:40.178613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:29.054 Running I/O for 1 seconds... 00:14:29.988 00:14:29.988 Latency(us) 00:14:29.988 [2024-11-29T15:56:41.419Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:29.988 [2024-11-29T15:56:41.419Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:29.988 Verification LBA range: start 0x0 length 0x400 00:14:29.988 Nvme0n1 : 1.01 3830.45 239.40 0.00 0.00 16424.75 1316.79 24855.13 00:14:29.988 [2024-11-29T15:56:41.419Z] =================================================================================================================== 00:14:29.988 [2024-11-29T15:56:41.419Z] Total : 3830.45 239.40 0.00 0.00 16424.75 1316.79 24855.13 00:14:30.247 16:56:41 -- target/host_management.sh@101 -- # stoptarget 00:14:30.247 16:56:41 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:30.247 16:56:41 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:30.247 16:56:41 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:30.247 16:56:41 -- target/host_management.sh@40 -- # nvmftestfini 00:14:30.247 16:56:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:30.247 16:56:41 -- nvmf/common.sh@116 -- # sync 00:14:30.247 16:56:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:30.247 16:56:41 -- nvmf/common.sh@119 -- # set +e 00:14:30.247 16:56:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:30.247 16:56:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:30.247 rmmod nvme_tcp 00:14:30.247 rmmod nvme_fabrics 00:14:30.505 rmmod nvme_keyring 00:14:30.506 16:56:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:30.506 16:56:41 -- nvmf/common.sh@123 -- # set -e 00:14:30.506 16:56:41 -- nvmf/common.sh@124 -- # return 0 00:14:30.506 16:56:41 -- nvmf/common.sh@477 -- # '[' -n 180770 ']' 00:14:30.506 16:56:41 -- nvmf/common.sh@478 -- # killprocess 180770 00:14:30.506 16:56:41 -- common/autotest_common.sh@936 -- # '[' -z 180770 ']' 00:14:30.506 16:56:41 -- common/autotest_common.sh@940 -- # kill -0 180770 00:14:30.506 16:56:41 -- common/autotest_common.sh@941 -- # uname 00:14:30.506 16:56:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:30.506 16:56:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 180770 00:14:30.506 16:56:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:30.506 16:56:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:30.506 16:56:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 180770' 00:14:30.506 killing process with pid 180770 00:14:30.506 16:56:41 -- common/autotest_common.sh@955 -- # kill 180770 00:14:30.506 16:56:41 -- common/autotest_common.sh@960 -- # wait 180770 00:14:30.765 [2024-11-29 16:56:42.038554] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:30.765 16:56:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:30.765 16:56:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:30.765 16:56:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:30.765 16:56:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:30.765 16:56:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:30.765 16:56:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:30.765 16:56:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:30.765 16:56:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:33.296 16:56:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:33.296 00:14:33.296 real 0m7.472s 00:14:33.296 user 0m23.272s 00:14:33.296 sys 0m1.459s 00:14:33.296 16:56:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:33.296 16:56:44 -- common/autotest_common.sh@10 -- # set +x 00:14:33.296 ************************************ 00:14:33.296 END TEST nvmf_host_management 00:14:33.296 ************************************ 00:14:33.296 16:56:44 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:33.296 00:14:33.296 real 0m9.808s 00:14:33.296 user 0m24.110s 00:14:33.296 sys 0m2.988s 00:14:33.296 16:56:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:33.296 16:56:44 -- common/autotest_common.sh@10 -- # set +x 00:14:33.296 ************************************ 00:14:33.296 END TEST nvmf_host_management 00:14:33.296 ************************************ 00:14:33.296 16:56:44 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:33.296 16:56:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:33.296 16:56:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:33.296 16:56:44 -- common/autotest_common.sh@10 -- # set +x 00:14:33.296 ************************************ 00:14:33.296 START TEST nvmf_lvol 00:14:33.296 ************************************ 00:14:33.296 16:56:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:33.296 * Looking for test storage... 00:14:33.296 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:33.296 16:56:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:33.296 16:56:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:33.296 16:56:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:33.296 16:56:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:33.296 16:56:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:33.296 16:56:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:33.296 16:56:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:33.296 16:56:44 -- scripts/common.sh@335 -- # IFS=.-: 00:14:33.296 16:56:44 -- scripts/common.sh@335 -- # read -ra ver1 00:14:33.296 16:56:44 -- scripts/common.sh@336 -- # IFS=.-: 00:14:33.296 16:56:44 -- scripts/common.sh@336 -- # read -ra ver2 00:14:33.296 16:56:44 -- scripts/common.sh@337 -- # local 'op=<' 00:14:33.296 16:56:44 -- scripts/common.sh@339 -- # ver1_l=2 00:14:33.296 16:56:44 -- scripts/common.sh@340 -- # ver2_l=1 00:14:33.296 16:56:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:33.296 16:56:44 -- scripts/common.sh@343 -- # case "$op" in 00:14:33.296 16:56:44 -- scripts/common.sh@344 -- # : 1 00:14:33.296 16:56:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:33.296 16:56:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:33.296 16:56:44 -- scripts/common.sh@364 -- # decimal 1 00:14:33.296 16:56:44 -- scripts/common.sh@352 -- # local d=1 00:14:33.296 16:56:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:33.296 16:56:44 -- scripts/common.sh@354 -- # echo 1 00:14:33.296 16:56:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:33.296 16:56:44 -- scripts/common.sh@365 -- # decimal 2 00:14:33.296 16:56:44 -- scripts/common.sh@352 -- # local d=2 00:14:33.296 16:56:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:33.296 16:56:44 -- scripts/common.sh@354 -- # echo 2 00:14:33.296 16:56:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:33.296 16:56:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:33.296 16:56:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:33.296 16:56:44 -- scripts/common.sh@367 -- # return 0 00:14:33.296 16:56:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:33.296 16:56:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:33.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:33.296 --rc genhtml_branch_coverage=1 00:14:33.296 --rc genhtml_function_coverage=1 00:14:33.296 --rc genhtml_legend=1 00:14:33.296 --rc geninfo_all_blocks=1 00:14:33.296 --rc geninfo_unexecuted_blocks=1 00:14:33.296 00:14:33.296 ' 00:14:33.296 16:56:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:33.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:33.296 --rc genhtml_branch_coverage=1 00:14:33.296 --rc genhtml_function_coverage=1 00:14:33.296 --rc genhtml_legend=1 00:14:33.296 --rc geninfo_all_blocks=1 00:14:33.296 --rc geninfo_unexecuted_blocks=1 00:14:33.296 00:14:33.296 ' 00:14:33.296 16:56:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:33.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:33.296 --rc genhtml_branch_coverage=1 00:14:33.296 --rc genhtml_function_coverage=1 00:14:33.296 --rc genhtml_legend=1 00:14:33.296 --rc geninfo_all_blocks=1 00:14:33.296 --rc geninfo_unexecuted_blocks=1 00:14:33.296 00:14:33.296 ' 00:14:33.296 16:56:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:33.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:33.296 --rc genhtml_branch_coverage=1 00:14:33.296 --rc genhtml_function_coverage=1 00:14:33.296 --rc genhtml_legend=1 00:14:33.296 --rc geninfo_all_blocks=1 00:14:33.296 --rc geninfo_unexecuted_blocks=1 00:14:33.296 00:14:33.296 ' 00:14:33.296 16:56:44 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:33.296 16:56:44 -- nvmf/common.sh@7 -- # uname -s 00:14:33.296 16:56:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:33.296 16:56:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:33.296 16:56:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:33.296 16:56:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:33.296 16:56:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:33.296 16:56:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:33.296 16:56:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:33.296 16:56:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:33.296 16:56:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:33.296 16:56:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:33.296 16:56:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:33.296 16:56:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:33.296 16:56:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:33.296 16:56:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:33.296 16:56:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:33.296 16:56:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:33.296 16:56:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:33.296 16:56:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:33.296 16:56:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:33.296 16:56:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.297 16:56:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.297 16:56:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.297 16:56:44 -- paths/export.sh@5 -- # export PATH 00:14:33.297 16:56:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.297 16:56:44 -- nvmf/common.sh@46 -- # : 0 00:14:33.297 16:56:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:33.297 16:56:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:33.297 16:56:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:33.297 16:56:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:33.297 16:56:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:33.297 16:56:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:33.297 16:56:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:33.297 16:56:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:33.297 16:56:44 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:33.297 16:56:44 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:33.297 16:56:44 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:33.297 16:56:44 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:33.297 16:56:44 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:33.297 16:56:44 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:33.297 16:56:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:33.297 16:56:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:33.297 16:56:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:33.297 16:56:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:33.297 16:56:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:33.297 16:56:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:33.297 16:56:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:33.297 16:56:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:33.297 16:56:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:33.297 16:56:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:33.297 16:56:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:33.297 16:56:44 -- common/autotest_common.sh@10 -- # set +x 00:14:35.197 16:56:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:35.197 16:56:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:35.197 16:56:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:35.197 16:56:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:35.197 16:56:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:35.197 16:56:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:35.197 16:56:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:35.197 16:56:46 -- nvmf/common.sh@294 -- # net_devs=() 00:14:35.197 16:56:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:35.197 16:56:46 -- nvmf/common.sh@295 -- # e810=() 00:14:35.197 16:56:46 -- nvmf/common.sh@295 -- # local -ga e810 00:14:35.197 16:56:46 -- nvmf/common.sh@296 -- # x722=() 00:14:35.197 16:56:46 -- nvmf/common.sh@296 -- # local -ga x722 00:14:35.197 16:56:46 -- nvmf/common.sh@297 -- # mlx=() 00:14:35.197 16:56:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:35.197 16:56:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:35.197 16:56:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:35.197 16:56:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:35.197 16:56:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:35.197 16:56:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:35.197 16:56:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:35.197 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:35.197 16:56:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:35.197 16:56:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:35.197 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:35.197 16:56:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:35.197 16:56:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:35.197 16:56:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:35.197 16:56:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:35.197 16:56:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:35.197 16:56:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:35.197 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:35.197 16:56:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:35.197 16:56:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:35.197 16:56:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:35.197 16:56:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:35.197 16:56:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:35.197 16:56:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:35.197 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:35.197 16:56:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:35.197 16:56:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:35.197 16:56:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:35.197 16:56:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:35.197 16:56:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:35.197 16:56:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:35.197 16:56:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:35.197 16:56:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:35.197 16:56:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:35.197 16:56:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:35.197 16:56:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:35.197 16:56:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:35.197 16:56:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:35.197 16:56:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:35.197 16:56:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:35.197 16:56:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:35.197 16:56:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:35.197 16:56:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:35.197 16:56:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:35.197 16:56:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:35.197 16:56:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:35.197 16:56:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:35.197 16:56:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:35.197 16:56:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:35.197 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:35.197 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:14:35.197 00:14:35.197 --- 10.0.0.2 ping statistics --- 00:14:35.197 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.197 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:14:35.197 16:56:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:35.197 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:35.197 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:14:35.197 00:14:35.197 --- 10.0.0.1 ping statistics --- 00:14:35.197 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.197 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:14:35.197 16:56:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:35.197 16:56:46 -- nvmf/common.sh@410 -- # return 0 00:14:35.197 16:56:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:35.197 16:56:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:35.197 16:56:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:35.197 16:56:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:35.197 16:56:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:35.197 16:56:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:35.197 16:56:46 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:35.197 16:56:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:35.197 16:56:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:35.197 16:56:46 -- common/autotest_common.sh@10 -- # set +x 00:14:35.197 16:56:46 -- nvmf/common.sh@469 -- # nvmfpid=183468 00:14:35.197 16:56:46 -- nvmf/common.sh@470 -- # waitforlisten 183468 00:14:35.197 16:56:46 -- common/autotest_common.sh@829 -- # '[' -z 183468 ']' 00:14:35.197 16:56:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:35.197 16:56:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:35.197 16:56:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:35.197 16:56:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:35.197 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:35.197 16:56:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:35.197 16:56:46 -- common/autotest_common.sh@10 -- # set +x 00:14:35.197 [2024-11-29 16:56:46.478099] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:35.197 [2024-11-29 16:56:46.478171] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:35.197 EAL: No free 2048 kB hugepages reported on node 1 00:14:35.197 [2024-11-29 16:56:46.545769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:35.456 [2024-11-29 16:56:46.660346] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:35.456 [2024-11-29 16:56:46.660524] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:35.456 [2024-11-29 16:56:46.660557] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:35.456 [2024-11-29 16:56:46.660580] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:35.456 [2024-11-29 16:56:46.660675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:35.456 [2024-11-29 16:56:46.660749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:35.456 [2024-11-29 16:56:46.660757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:36.021 16:56:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:36.021 16:56:47 -- common/autotest_common.sh@862 -- # return 0 00:14:36.021 16:56:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:36.021 16:56:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:36.021 16:56:47 -- common/autotest_common.sh@10 -- # set +x 00:14:36.279 16:56:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:36.279 16:56:47 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:36.279 [2024-11-29 16:56:47.676432] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:36.279 16:56:47 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:36.537 16:56:47 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:36.796 16:56:47 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:37.054 16:56:48 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:37.054 16:56:48 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:37.312 16:56:48 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:37.571 16:56:48 -- target/nvmf_lvol.sh@29 -- # lvs=3b6c8055-fde8-4505-a4f0-b640d1e0c01d 00:14:37.571 16:56:48 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 3b6c8055-fde8-4505-a4f0-b640d1e0c01d lvol 20 00:14:37.829 16:56:49 -- target/nvmf_lvol.sh@32 -- # lvol=96e85e24-41d8-4849-9cf4-9890c4f8150b 00:14:37.829 16:56:49 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:38.086 16:56:49 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 96e85e24-41d8-4849-9cf4-9890c4f8150b 00:14:38.342 16:56:49 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:38.342 [2024-11-29 16:56:49.768024] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:38.599 16:56:49 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:38.600 16:56:50 -- target/nvmf_lvol.sh@42 -- # perf_pid=183913 00:14:38.600 16:56:50 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:38.857 16:56:50 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:38.857 EAL: No free 2048 kB hugepages reported on node 1 00:14:39.790 16:56:51 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 96e85e24-41d8-4849-9cf4-9890c4f8150b MY_SNAPSHOT 00:14:40.048 16:56:51 -- target/nvmf_lvol.sh@47 -- # snapshot=772a6303-ccaf-489e-b115-3d2b128a54d2 00:14:40.048 16:56:51 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 96e85e24-41d8-4849-9cf4-9890c4f8150b 30 00:14:40.306 16:56:51 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 772a6303-ccaf-489e-b115-3d2b128a54d2 MY_CLONE 00:14:40.563 16:56:51 -- target/nvmf_lvol.sh@49 -- # clone=d3b3bda5-5cca-441f-85c7-8426b1f9107e 00:14:40.563 16:56:51 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate d3b3bda5-5cca-441f-85c7-8426b1f9107e 00:14:41.129 16:56:52 -- target/nvmf_lvol.sh@53 -- # wait 183913 00:14:49.240 Initializing NVMe Controllers 00:14:49.240 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:49.240 Controller IO queue size 128, less than required. 00:14:49.240 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:49.240 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:49.240 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:49.240 Initialization complete. Launching workers. 00:14:49.240 ======================================================== 00:14:49.240 Latency(us) 00:14:49.240 Device Information : IOPS MiB/s Average min max 00:14:49.240 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10891.20 42.54 11755.89 1813.61 63721.67 00:14:49.240 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10683.90 41.73 11986.85 2277.22 64922.74 00:14:49.240 ======================================================== 00:14:49.240 Total : 21575.10 84.28 11870.26 1813.61 64922.74 00:14:49.240 00:14:49.240 16:57:00 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:49.498 16:57:00 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 96e85e24-41d8-4849-9cf4-9890c4f8150b 00:14:49.755 16:57:01 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 3b6c8055-fde8-4505-a4f0-b640d1e0c01d 00:14:50.013 16:57:01 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:50.013 16:57:01 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:50.013 16:57:01 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:50.013 16:57:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:50.013 16:57:01 -- nvmf/common.sh@116 -- # sync 00:14:50.013 16:57:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:50.013 16:57:01 -- nvmf/common.sh@119 -- # set +e 00:14:50.013 16:57:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:50.013 16:57:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:50.013 rmmod nvme_tcp 00:14:50.013 rmmod nvme_fabrics 00:14:50.014 rmmod nvme_keyring 00:14:50.014 16:57:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:50.014 16:57:01 -- nvmf/common.sh@123 -- # set -e 00:14:50.014 16:57:01 -- nvmf/common.sh@124 -- # return 0 00:14:50.014 16:57:01 -- nvmf/common.sh@477 -- # '[' -n 183468 ']' 00:14:50.014 16:57:01 -- nvmf/common.sh@478 -- # killprocess 183468 00:14:50.014 16:57:01 -- common/autotest_common.sh@936 -- # '[' -z 183468 ']' 00:14:50.014 16:57:01 -- common/autotest_common.sh@940 -- # kill -0 183468 00:14:50.014 16:57:01 -- common/autotest_common.sh@941 -- # uname 00:14:50.014 16:57:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:50.014 16:57:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 183468 00:14:50.014 16:57:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:50.014 16:57:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:50.014 16:57:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 183468' 00:14:50.014 killing process with pid 183468 00:14:50.014 16:57:01 -- common/autotest_common.sh@955 -- # kill 183468 00:14:50.014 16:57:01 -- common/autotest_common.sh@960 -- # wait 183468 00:14:50.580 16:57:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:50.580 16:57:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:50.580 16:57:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:50.580 16:57:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:50.580 16:57:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:50.580 16:57:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:50.580 16:57:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:50.580 16:57:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:52.481 16:57:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:52.481 00:14:52.481 real 0m19.620s 00:14:52.481 user 1m6.116s 00:14:52.481 sys 0m5.655s 00:14:52.481 16:57:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:52.481 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:14:52.481 ************************************ 00:14:52.481 END TEST nvmf_lvol 00:14:52.481 ************************************ 00:14:52.481 16:57:03 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:52.481 16:57:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:52.481 16:57:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:52.481 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:14:52.481 ************************************ 00:14:52.481 START TEST nvmf_lvs_grow 00:14:52.481 ************************************ 00:14:52.481 16:57:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:52.481 * Looking for test storage... 00:14:52.481 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:52.481 16:57:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:52.481 16:57:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:52.481 16:57:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:52.740 16:57:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:52.740 16:57:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:52.740 16:57:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:52.740 16:57:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:52.740 16:57:03 -- scripts/common.sh@335 -- # IFS=.-: 00:14:52.740 16:57:03 -- scripts/common.sh@335 -- # read -ra ver1 00:14:52.740 16:57:03 -- scripts/common.sh@336 -- # IFS=.-: 00:14:52.740 16:57:03 -- scripts/common.sh@336 -- # read -ra ver2 00:14:52.740 16:57:03 -- scripts/common.sh@337 -- # local 'op=<' 00:14:52.740 16:57:03 -- scripts/common.sh@339 -- # ver1_l=2 00:14:52.740 16:57:03 -- scripts/common.sh@340 -- # ver2_l=1 00:14:52.740 16:57:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:52.740 16:57:03 -- scripts/common.sh@343 -- # case "$op" in 00:14:52.740 16:57:03 -- scripts/common.sh@344 -- # : 1 00:14:52.740 16:57:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:52.740 16:57:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:52.740 16:57:03 -- scripts/common.sh@364 -- # decimal 1 00:14:52.740 16:57:03 -- scripts/common.sh@352 -- # local d=1 00:14:52.740 16:57:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:52.740 16:57:03 -- scripts/common.sh@354 -- # echo 1 00:14:52.740 16:57:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:52.740 16:57:03 -- scripts/common.sh@365 -- # decimal 2 00:14:52.740 16:57:03 -- scripts/common.sh@352 -- # local d=2 00:14:52.740 16:57:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:52.740 16:57:03 -- scripts/common.sh@354 -- # echo 2 00:14:52.740 16:57:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:52.740 16:57:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:52.740 16:57:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:52.740 16:57:03 -- scripts/common.sh@367 -- # return 0 00:14:52.740 16:57:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:52.740 16:57:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:52.740 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.740 --rc genhtml_branch_coverage=1 00:14:52.740 --rc genhtml_function_coverage=1 00:14:52.740 --rc genhtml_legend=1 00:14:52.740 --rc geninfo_all_blocks=1 00:14:52.740 --rc geninfo_unexecuted_blocks=1 00:14:52.740 00:14:52.740 ' 00:14:52.740 16:57:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:52.740 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.740 --rc genhtml_branch_coverage=1 00:14:52.740 --rc genhtml_function_coverage=1 00:14:52.740 --rc genhtml_legend=1 00:14:52.740 --rc geninfo_all_blocks=1 00:14:52.740 --rc geninfo_unexecuted_blocks=1 00:14:52.740 00:14:52.740 ' 00:14:52.741 16:57:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:52.741 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.741 --rc genhtml_branch_coverage=1 00:14:52.741 --rc genhtml_function_coverage=1 00:14:52.741 --rc genhtml_legend=1 00:14:52.741 --rc geninfo_all_blocks=1 00:14:52.741 --rc geninfo_unexecuted_blocks=1 00:14:52.741 00:14:52.741 ' 00:14:52.741 16:57:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:52.741 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.741 --rc genhtml_branch_coverage=1 00:14:52.741 --rc genhtml_function_coverage=1 00:14:52.741 --rc genhtml_legend=1 00:14:52.741 --rc geninfo_all_blocks=1 00:14:52.741 --rc geninfo_unexecuted_blocks=1 00:14:52.741 00:14:52.741 ' 00:14:52.741 16:57:03 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:52.741 16:57:03 -- nvmf/common.sh@7 -- # uname -s 00:14:52.741 16:57:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:52.741 16:57:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:52.741 16:57:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:52.741 16:57:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:52.741 16:57:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:52.741 16:57:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:52.741 16:57:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:52.741 16:57:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:52.741 16:57:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:52.741 16:57:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:52.741 16:57:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:52.741 16:57:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:52.741 16:57:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:52.741 16:57:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:52.741 16:57:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:52.741 16:57:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:52.741 16:57:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:52.741 16:57:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:52.741 16:57:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:52.741 16:57:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.741 16:57:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.741 16:57:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.741 16:57:03 -- paths/export.sh@5 -- # export PATH 00:14:52.741 16:57:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.741 16:57:03 -- nvmf/common.sh@46 -- # : 0 00:14:52.741 16:57:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:52.741 16:57:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:52.741 16:57:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:52.741 16:57:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:52.741 16:57:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:52.741 16:57:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:52.741 16:57:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:52.741 16:57:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:52.741 16:57:03 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:52.741 16:57:03 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:52.741 16:57:03 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:52.741 16:57:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:52.741 16:57:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:52.741 16:57:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:52.741 16:57:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:52.741 16:57:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:52.741 16:57:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:52.741 16:57:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:52.741 16:57:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:52.741 16:57:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:52.741 16:57:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:52.741 16:57:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:52.741 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:14:54.642 16:57:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:54.642 16:57:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:54.642 16:57:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:54.642 16:57:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:54.642 16:57:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:54.642 16:57:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:54.642 16:57:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:54.642 16:57:05 -- nvmf/common.sh@294 -- # net_devs=() 00:14:54.642 16:57:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:54.642 16:57:05 -- nvmf/common.sh@295 -- # e810=() 00:14:54.642 16:57:05 -- nvmf/common.sh@295 -- # local -ga e810 00:14:54.642 16:57:05 -- nvmf/common.sh@296 -- # x722=() 00:14:54.642 16:57:05 -- nvmf/common.sh@296 -- # local -ga x722 00:14:54.642 16:57:05 -- nvmf/common.sh@297 -- # mlx=() 00:14:54.642 16:57:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:54.642 16:57:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:54.642 16:57:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:54.642 16:57:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:54.642 16:57:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:54.642 16:57:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:54.642 16:57:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:54.642 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:54.642 16:57:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:54.642 16:57:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:54.642 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:54.642 16:57:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:54.642 16:57:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:54.642 16:57:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.642 16:57:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:54.642 16:57:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.642 16:57:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:54.642 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:54.642 16:57:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.642 16:57:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:54.642 16:57:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.642 16:57:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:54.642 16:57:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.642 16:57:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:54.642 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:54.642 16:57:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.642 16:57:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:54.642 16:57:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:54.642 16:57:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:54.642 16:57:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:54.642 16:57:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:54.642 16:57:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:54.642 16:57:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:54.642 16:57:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:54.642 16:57:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:54.643 16:57:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:54.643 16:57:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:54.643 16:57:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:54.643 16:57:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:54.643 16:57:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:54.643 16:57:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:54.643 16:57:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:54.643 16:57:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:54.643 16:57:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:54.643 16:57:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:54.643 16:57:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:54.643 16:57:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:54.643 16:57:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:54.643 16:57:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:54.643 16:57:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:54.643 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:54.643 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:14:54.643 00:14:54.643 --- 10.0.0.2 ping statistics --- 00:14:54.643 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:54.643 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:14:54.643 16:57:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:54.643 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:54.643 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:14:54.643 00:14:54.643 --- 10.0.0.1 ping statistics --- 00:14:54.643 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:54.643 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:14:54.643 16:57:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:54.643 16:57:06 -- nvmf/common.sh@410 -- # return 0 00:14:54.643 16:57:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:54.643 16:57:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:54.643 16:57:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:54.643 16:57:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:54.643 16:57:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:54.643 16:57:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:54.643 16:57:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:54.643 16:57:06 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:54.643 16:57:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:54.643 16:57:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:54.643 16:57:06 -- common/autotest_common.sh@10 -- # set +x 00:14:54.643 16:57:06 -- nvmf/common.sh@469 -- # nvmfpid=187347 00:14:54.643 16:57:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:54.643 16:57:06 -- nvmf/common.sh@470 -- # waitforlisten 187347 00:14:54.643 16:57:06 -- common/autotest_common.sh@829 -- # '[' -z 187347 ']' 00:14:54.643 16:57:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:54.643 16:57:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:54.643 16:57:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:54.643 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:54.643 16:57:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:54.643 16:57:06 -- common/autotest_common.sh@10 -- # set +x 00:14:54.902 [2024-11-29 16:57:06.078489] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:54.902 [2024-11-29 16:57:06.078561] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:54.902 EAL: No free 2048 kB hugepages reported on node 1 00:14:54.902 [2024-11-29 16:57:06.141178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:54.902 [2024-11-29 16:57:06.247719] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:54.902 [2024-11-29 16:57:06.247891] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:54.902 [2024-11-29 16:57:06.247906] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:54.902 [2024-11-29 16:57:06.247919] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:54.902 [2024-11-29 16:57:06.247968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:55.837 16:57:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:55.837 16:57:07 -- common/autotest_common.sh@862 -- # return 0 00:14:55.837 16:57:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:55.837 16:57:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:55.837 16:57:07 -- common/autotest_common.sh@10 -- # set +x 00:14:55.837 16:57:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:55.837 16:57:07 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:56.096 [2024-11-29 16:57:07.312691] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:56.096 16:57:07 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:56.096 16:57:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:56.096 16:57:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:56.096 16:57:07 -- common/autotest_common.sh@10 -- # set +x 00:14:56.096 ************************************ 00:14:56.096 START TEST lvs_grow_clean 00:14:56.123 ************************************ 00:14:56.123 16:57:07 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:56.123 16:57:07 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:56.123 16:57:07 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:56.123 16:57:07 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:56.123 16:57:07 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:56.123 16:57:07 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:56.123 16:57:07 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:56.123 16:57:07 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:56.123 16:57:07 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:56.123 16:57:07 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:56.382 16:57:07 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:56.382 16:57:07 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:56.640 16:57:07 -- target/nvmf_lvs_grow.sh@28 -- # lvs=2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:14:56.640 16:57:07 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:14:56.640 16:57:07 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:56.899 16:57:08 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:56.899 16:57:08 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:56.899 16:57:08 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 lvol 150 00:14:57.158 16:57:08 -- target/nvmf_lvs_grow.sh@33 -- # lvol=b01448e7-26cc-4b37-b6da-9f9717bb956d 00:14:57.158 16:57:08 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:57.158 16:57:08 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:57.417 [2024-11-29 16:57:08.647297] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:57.417 [2024-11-29 16:57:08.647390] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:57.417 true 00:14:57.417 16:57:08 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:14:57.417 16:57:08 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:57.676 16:57:08 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:57.676 16:57:08 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:57.934 16:57:09 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b01448e7-26cc-4b37-b6da-9f9717bb956d 00:14:58.192 16:57:09 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:58.450 [2024-11-29 16:57:09.654478] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:58.450 16:57:09 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:58.709 16:57:09 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=188430 00:14:58.709 16:57:09 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:58.709 16:57:09 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:58.709 16:57:09 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 188430 /var/tmp/bdevperf.sock 00:14:58.709 16:57:09 -- common/autotest_common.sh@829 -- # '[' -z 188430 ']' 00:14:58.709 16:57:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:58.709 16:57:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:58.709 16:57:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:58.709 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:58.709 16:57:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:58.709 16:57:09 -- common/autotest_common.sh@10 -- # set +x 00:14:58.709 [2024-11-29 16:57:09.942397] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:58.709 [2024-11-29 16:57:09.942479] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid188430 ] 00:14:58.709 EAL: No free 2048 kB hugepages reported on node 1 00:14:58.709 [2024-11-29 16:57:10.003900] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:58.709 [2024-11-29 16:57:10.126536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:59.643 16:57:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:59.643 16:57:10 -- common/autotest_common.sh@862 -- # return 0 00:14:59.643 16:57:10 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:59.902 Nvme0n1 00:14:59.902 16:57:11 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:00.160 [ 00:15:00.160 { 00:15:00.160 "name": "Nvme0n1", 00:15:00.160 "aliases": [ 00:15:00.160 "b01448e7-26cc-4b37-b6da-9f9717bb956d" 00:15:00.160 ], 00:15:00.160 "product_name": "NVMe disk", 00:15:00.160 "block_size": 4096, 00:15:00.160 "num_blocks": 38912, 00:15:00.160 "uuid": "b01448e7-26cc-4b37-b6da-9f9717bb956d", 00:15:00.160 "assigned_rate_limits": { 00:15:00.160 "rw_ios_per_sec": 0, 00:15:00.160 "rw_mbytes_per_sec": 0, 00:15:00.160 "r_mbytes_per_sec": 0, 00:15:00.160 "w_mbytes_per_sec": 0 00:15:00.160 }, 00:15:00.160 "claimed": false, 00:15:00.160 "zoned": false, 00:15:00.160 "supported_io_types": { 00:15:00.160 "read": true, 00:15:00.160 "write": true, 00:15:00.160 "unmap": true, 00:15:00.160 "write_zeroes": true, 00:15:00.160 "flush": true, 00:15:00.160 "reset": true, 00:15:00.160 "compare": true, 00:15:00.160 "compare_and_write": true, 00:15:00.160 "abort": true, 00:15:00.160 "nvme_admin": true, 00:15:00.160 "nvme_io": true 00:15:00.160 }, 00:15:00.160 "driver_specific": { 00:15:00.160 "nvme": [ 00:15:00.160 { 00:15:00.160 "trid": { 00:15:00.160 "trtype": "TCP", 00:15:00.160 "adrfam": "IPv4", 00:15:00.160 "traddr": "10.0.0.2", 00:15:00.160 "trsvcid": "4420", 00:15:00.160 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:00.160 }, 00:15:00.160 "ctrlr_data": { 00:15:00.160 "cntlid": 1, 00:15:00.160 "vendor_id": "0x8086", 00:15:00.160 "model_number": "SPDK bdev Controller", 00:15:00.160 "serial_number": "SPDK0", 00:15:00.160 "firmware_revision": "24.01.1", 00:15:00.160 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:00.160 "oacs": { 00:15:00.160 "security": 0, 00:15:00.160 "format": 0, 00:15:00.160 "firmware": 0, 00:15:00.160 "ns_manage": 0 00:15:00.160 }, 00:15:00.160 "multi_ctrlr": true, 00:15:00.160 "ana_reporting": false 00:15:00.160 }, 00:15:00.160 "vs": { 00:15:00.160 "nvme_version": "1.3" 00:15:00.160 }, 00:15:00.160 "ns_data": { 00:15:00.160 "id": 1, 00:15:00.160 "can_share": true 00:15:00.160 } 00:15:00.160 } 00:15:00.160 ], 00:15:00.160 "mp_policy": "active_passive" 00:15:00.160 } 00:15:00.160 } 00:15:00.160 ] 00:15:00.160 16:57:11 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=188585 00:15:00.160 16:57:11 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:00.160 16:57:11 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:00.418 Running I/O for 10 seconds... 00:15:01.354 Latency(us) 00:15:01.354 [2024-11-29T15:57:12.785Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.354 [2024-11-29T15:57:12.785Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.354 Nvme0n1 : 1.00 14807.00 57.84 0.00 0.00 0.00 0.00 0.00 00:15:01.354 [2024-11-29T15:57:12.785Z] =================================================================================================================== 00:15:01.354 [2024-11-29T15:57:12.785Z] Total : 14807.00 57.84 0.00 0.00 0.00 0.00 0.00 00:15:01.354 00:15:02.288 16:57:13 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:15:02.288 [2024-11-29T15:57:13.719Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.288 Nvme0n1 : 2.00 15007.00 58.62 0.00 0.00 0.00 0.00 0.00 00:15:02.288 [2024-11-29T15:57:13.719Z] =================================================================================================================== 00:15:02.288 [2024-11-29T15:57:13.719Z] Total : 15007.00 58.62 0.00 0.00 0.00 0.00 0.00 00:15:02.288 00:15:02.547 true 00:15:02.547 16:57:13 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:15:02.547 16:57:13 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:02.806 16:57:14 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:02.806 16:57:14 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:02.806 16:57:14 -- target/nvmf_lvs_grow.sh@65 -- # wait 188585 00:15:03.371 [2024-11-29T15:57:14.802Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.371 Nvme0n1 : 3.00 15106.67 59.01 0.00 0.00 0.00 0.00 0.00 00:15:03.371 [2024-11-29T15:57:14.802Z] =================================================================================================================== 00:15:03.371 [2024-11-29T15:57:14.802Z] Total : 15106.67 59.01 0.00 0.00 0.00 0.00 0.00 00:15:03.371 00:15:04.303 [2024-11-29T15:57:15.734Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.303 Nvme0n1 : 4.00 15190.00 59.34 0.00 0.00 0.00 0.00 0.00 00:15:04.303 [2024-11-29T15:57:15.734Z] =================================================================================================================== 00:15:04.303 [2024-11-29T15:57:15.734Z] Total : 15190.00 59.34 0.00 0.00 0.00 0.00 0.00 00:15:04.303 00:15:05.680 [2024-11-29T15:57:17.112Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.681 Nvme0n1 : 5.00 15279.20 59.68 0.00 0.00 0.00 0.00 0.00 00:15:05.681 [2024-11-29T15:57:17.112Z] =================================================================================================================== 00:15:05.681 [2024-11-29T15:57:17.112Z] Total : 15279.20 59.68 0.00 0.00 0.00 0.00 0.00 00:15:05.681 00:15:06.617 [2024-11-29T15:57:18.048Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.617 Nvme0n1 : 6.00 15323.17 59.86 0.00 0.00 0.00 0.00 0.00 00:15:06.617 [2024-11-29T15:57:18.048Z] =================================================================================================================== 00:15:06.617 [2024-11-29T15:57:18.048Z] Total : 15323.17 59.86 0.00 0.00 0.00 0.00 0.00 00:15:06.617 00:15:07.549 [2024-11-29T15:57:18.980Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:07.549 Nvme0n1 : 7.00 15384.71 60.10 0.00 0.00 0.00 0.00 0.00 00:15:07.549 [2024-11-29T15:57:18.980Z] =================================================================================================================== 00:15:07.549 [2024-11-29T15:57:18.980Z] Total : 15384.71 60.10 0.00 0.00 0.00 0.00 0.00 00:15:07.549 00:15:08.482 [2024-11-29T15:57:19.913Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:08.482 Nvme0n1 : 8.00 15426.62 60.26 0.00 0.00 0.00 0.00 0.00 00:15:08.482 [2024-11-29T15:57:19.913Z] =================================================================================================================== 00:15:08.482 [2024-11-29T15:57:19.913Z] Total : 15426.62 60.26 0.00 0.00 0.00 0.00 0.00 00:15:08.482 00:15:09.415 [2024-11-29T15:57:20.846Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:09.415 Nvme0n1 : 9.00 15434.89 60.29 0.00 0.00 0.00 0.00 0.00 00:15:09.415 [2024-11-29T15:57:20.846Z] =================================================================================================================== 00:15:09.415 [2024-11-29T15:57:20.846Z] Total : 15434.89 60.29 0.00 0.00 0.00 0.00 0.00 00:15:09.415 00:15:10.351 [2024-11-29T15:57:21.782Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:10.351 Nvme0n1 : 10.00 15476.60 60.46 0.00 0.00 0.00 0.00 0.00 00:15:10.351 [2024-11-29T15:57:21.782Z] =================================================================================================================== 00:15:10.351 [2024-11-29T15:57:21.782Z] Total : 15476.60 60.46 0.00 0.00 0.00 0.00 0.00 00:15:10.351 00:15:10.351 00:15:10.351 Latency(us) 00:15:10.351 [2024-11-29T15:57:21.782Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:10.351 [2024-11-29T15:57:21.782Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:10.351 Nvme0n1 : 10.00 15472.21 60.44 0.00 0.00 8266.95 4587.52 48545.19 00:15:10.351 [2024-11-29T15:57:21.782Z] =================================================================================================================== 00:15:10.351 [2024-11-29T15:57:21.782Z] Total : 15472.21 60.44 0.00 0.00 8266.95 4587.52 48545.19 00:15:10.351 0 00:15:10.351 16:57:21 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 188430 00:15:10.351 16:57:21 -- common/autotest_common.sh@936 -- # '[' -z 188430 ']' 00:15:10.351 16:57:21 -- common/autotest_common.sh@940 -- # kill -0 188430 00:15:10.351 16:57:21 -- common/autotest_common.sh@941 -- # uname 00:15:10.351 16:57:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:10.351 16:57:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 188430 00:15:10.351 16:57:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:10.351 16:57:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:10.351 16:57:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 188430' 00:15:10.351 killing process with pid 188430 00:15:10.351 16:57:21 -- common/autotest_common.sh@955 -- # kill 188430 00:15:10.351 Received shutdown signal, test time was about 10.000000 seconds 00:15:10.351 00:15:10.351 Latency(us) 00:15:10.351 [2024-11-29T15:57:21.782Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:10.351 [2024-11-29T15:57:21.782Z] =================================================================================================================== 00:15:10.351 [2024-11-29T15:57:21.782Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:10.351 16:57:21 -- common/autotest_common.sh@960 -- # wait 188430 00:15:10.610 16:57:22 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:10.868 16:57:22 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:15:10.868 16:57:22 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:11.436 16:57:22 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:11.436 16:57:22 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:11.436 16:57:22 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:11.436 [2024-11-29 16:57:22.815898] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:11.436 16:57:22 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:15:11.436 16:57:22 -- common/autotest_common.sh@650 -- # local es=0 00:15:11.436 16:57:22 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:15:11.436 16:57:22 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:11.436 16:57:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:11.436 16:57:22 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:11.436 16:57:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:11.436 16:57:22 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:11.436 16:57:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:11.436 16:57:22 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:11.436 16:57:22 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:11.436 16:57:22 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:15:11.695 request: 00:15:11.695 { 00:15:11.695 "uuid": "2c6300ae-7fd6-44c5-aadc-a0e5a59653d4", 00:15:11.695 "method": "bdev_lvol_get_lvstores", 00:15:11.695 "req_id": 1 00:15:11.695 } 00:15:11.695 Got JSON-RPC error response 00:15:11.695 response: 00:15:11.695 { 00:15:11.695 "code": -19, 00:15:11.695 "message": "No such device" 00:15:11.695 } 00:15:11.953 16:57:23 -- common/autotest_common.sh@653 -- # es=1 00:15:11.953 16:57:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:11.953 16:57:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:11.953 16:57:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:11.953 16:57:23 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:11.953 aio_bdev 00:15:12.211 16:57:23 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev b01448e7-26cc-4b37-b6da-9f9717bb956d 00:15:12.211 16:57:23 -- common/autotest_common.sh@897 -- # local bdev_name=b01448e7-26cc-4b37-b6da-9f9717bb956d 00:15:12.211 16:57:23 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:12.211 16:57:23 -- common/autotest_common.sh@899 -- # local i 00:15:12.211 16:57:23 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:12.211 16:57:23 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:12.211 16:57:23 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:12.211 16:57:23 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b b01448e7-26cc-4b37-b6da-9f9717bb956d -t 2000 00:15:12.469 [ 00:15:12.470 { 00:15:12.470 "name": "b01448e7-26cc-4b37-b6da-9f9717bb956d", 00:15:12.470 "aliases": [ 00:15:12.470 "lvs/lvol" 00:15:12.470 ], 00:15:12.470 "product_name": "Logical Volume", 00:15:12.470 "block_size": 4096, 00:15:12.470 "num_blocks": 38912, 00:15:12.470 "uuid": "b01448e7-26cc-4b37-b6da-9f9717bb956d", 00:15:12.470 "assigned_rate_limits": { 00:15:12.470 "rw_ios_per_sec": 0, 00:15:12.470 "rw_mbytes_per_sec": 0, 00:15:12.470 "r_mbytes_per_sec": 0, 00:15:12.470 "w_mbytes_per_sec": 0 00:15:12.470 }, 00:15:12.470 "claimed": false, 00:15:12.470 "zoned": false, 00:15:12.470 "supported_io_types": { 00:15:12.470 "read": true, 00:15:12.470 "write": true, 00:15:12.470 "unmap": true, 00:15:12.470 "write_zeroes": true, 00:15:12.470 "flush": false, 00:15:12.470 "reset": true, 00:15:12.470 "compare": false, 00:15:12.470 "compare_and_write": false, 00:15:12.470 "abort": false, 00:15:12.470 "nvme_admin": false, 00:15:12.470 "nvme_io": false 00:15:12.470 }, 00:15:12.470 "driver_specific": { 00:15:12.470 "lvol": { 00:15:12.470 "lvol_store_uuid": "2c6300ae-7fd6-44c5-aadc-a0e5a59653d4", 00:15:12.470 "base_bdev": "aio_bdev", 00:15:12.470 "thin_provision": false, 00:15:12.470 "snapshot": false, 00:15:12.470 "clone": false, 00:15:12.470 "esnap_clone": false 00:15:12.470 } 00:15:12.470 } 00:15:12.470 } 00:15:12.470 ] 00:15:12.470 16:57:23 -- common/autotest_common.sh@905 -- # return 0 00:15:12.470 16:57:23 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:15:12.470 16:57:23 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:12.728 16:57:24 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:12.728 16:57:24 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:15:12.728 16:57:24 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:12.986 16:57:24 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:12.986 16:57:24 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b01448e7-26cc-4b37-b6da-9f9717bb956d 00:15:13.552 16:57:24 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 2c6300ae-7fd6-44c5-aadc-a0e5a59653d4 00:15:13.552 16:57:24 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:13.811 16:57:25 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:13.811 00:15:13.811 real 0m17.871s 00:15:13.811 user 0m17.588s 00:15:13.811 sys 0m1.852s 00:15:13.811 16:57:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:13.811 16:57:25 -- common/autotest_common.sh@10 -- # set +x 00:15:13.811 ************************************ 00:15:13.811 END TEST lvs_grow_clean 00:15:13.811 ************************************ 00:15:13.811 16:57:25 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:13.811 16:57:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:13.811 16:57:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:13.811 16:57:25 -- common/autotest_common.sh@10 -- # set +x 00:15:13.811 ************************************ 00:15:13.811 START TEST lvs_grow_dirty 00:15:13.811 ************************************ 00:15:13.811 16:57:25 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:15:13.811 16:57:25 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:13.811 16:57:25 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:13.811 16:57:25 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:13.811 16:57:25 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:13.811 16:57:25 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:13.811 16:57:25 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:13.811 16:57:25 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:14.068 16:57:25 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:14.068 16:57:25 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:14.325 16:57:25 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:14.325 16:57:25 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:14.584 16:57:25 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:14.584 16:57:25 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:14.584 16:57:25 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:14.842 16:57:26 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:14.842 16:57:26 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:14.842 16:57:26 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e8680aa4-c6cc-4d69-b290-0e853d813df2 lvol 150 00:15:15.100 16:57:26 -- target/nvmf_lvs_grow.sh@33 -- # lvol=adba4fb2-e5f2-40c9-8ebf-9d9cecec377f 00:15:15.100 16:57:26 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:15.100 16:57:26 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:15.359 [2024-11-29 16:57:26.581431] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:15.359 [2024-11-29 16:57:26.581516] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:15.359 true 00:15:15.359 16:57:26 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:15.359 16:57:26 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:15.618 16:57:26 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:15.618 16:57:26 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:15.877 16:57:27 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 adba4fb2-e5f2-40c9-8ebf-9d9cecec377f 00:15:16.137 16:57:27 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:16.398 16:57:27 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:16.658 16:57:27 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=190672 00:15:16.658 16:57:27 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:16.658 16:57:27 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:16.658 16:57:27 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 190672 /var/tmp/bdevperf.sock 00:15:16.658 16:57:27 -- common/autotest_common.sh@829 -- # '[' -z 190672 ']' 00:15:16.658 16:57:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:16.658 16:57:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:16.658 16:57:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:16.658 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:16.658 16:57:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:16.658 16:57:27 -- common/autotest_common.sh@10 -- # set +x 00:15:16.658 [2024-11-29 16:57:27.929403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:16.658 [2024-11-29 16:57:27.929481] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid190672 ] 00:15:16.658 EAL: No free 2048 kB hugepages reported on node 1 00:15:16.658 [2024-11-29 16:57:27.984929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:16.658 [2024-11-29 16:57:28.088206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:17.592 16:57:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:17.592 16:57:28 -- common/autotest_common.sh@862 -- # return 0 00:15:17.592 16:57:28 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:18.159 Nvme0n1 00:15:18.159 16:57:29 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:18.417 [ 00:15:18.417 { 00:15:18.417 "name": "Nvme0n1", 00:15:18.417 "aliases": [ 00:15:18.417 "adba4fb2-e5f2-40c9-8ebf-9d9cecec377f" 00:15:18.417 ], 00:15:18.417 "product_name": "NVMe disk", 00:15:18.417 "block_size": 4096, 00:15:18.417 "num_blocks": 38912, 00:15:18.417 "uuid": "adba4fb2-e5f2-40c9-8ebf-9d9cecec377f", 00:15:18.417 "assigned_rate_limits": { 00:15:18.417 "rw_ios_per_sec": 0, 00:15:18.417 "rw_mbytes_per_sec": 0, 00:15:18.417 "r_mbytes_per_sec": 0, 00:15:18.417 "w_mbytes_per_sec": 0 00:15:18.417 }, 00:15:18.417 "claimed": false, 00:15:18.417 "zoned": false, 00:15:18.417 "supported_io_types": { 00:15:18.417 "read": true, 00:15:18.417 "write": true, 00:15:18.417 "unmap": true, 00:15:18.417 "write_zeroes": true, 00:15:18.417 "flush": true, 00:15:18.417 "reset": true, 00:15:18.417 "compare": true, 00:15:18.417 "compare_and_write": true, 00:15:18.417 "abort": true, 00:15:18.417 "nvme_admin": true, 00:15:18.417 "nvme_io": true 00:15:18.417 }, 00:15:18.417 "driver_specific": { 00:15:18.417 "nvme": [ 00:15:18.417 { 00:15:18.417 "trid": { 00:15:18.417 "trtype": "TCP", 00:15:18.417 "adrfam": "IPv4", 00:15:18.417 "traddr": "10.0.0.2", 00:15:18.417 "trsvcid": "4420", 00:15:18.417 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:18.417 }, 00:15:18.417 "ctrlr_data": { 00:15:18.417 "cntlid": 1, 00:15:18.417 "vendor_id": "0x8086", 00:15:18.417 "model_number": "SPDK bdev Controller", 00:15:18.417 "serial_number": "SPDK0", 00:15:18.417 "firmware_revision": "24.01.1", 00:15:18.417 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:18.417 "oacs": { 00:15:18.417 "security": 0, 00:15:18.417 "format": 0, 00:15:18.417 "firmware": 0, 00:15:18.417 "ns_manage": 0 00:15:18.417 }, 00:15:18.417 "multi_ctrlr": true, 00:15:18.417 "ana_reporting": false 00:15:18.417 }, 00:15:18.417 "vs": { 00:15:18.417 "nvme_version": "1.3" 00:15:18.417 }, 00:15:18.417 "ns_data": { 00:15:18.417 "id": 1, 00:15:18.417 "can_share": true 00:15:18.417 } 00:15:18.417 } 00:15:18.417 ], 00:15:18.417 "mp_policy": "active_passive" 00:15:18.417 } 00:15:18.417 } 00:15:18.417 ] 00:15:18.417 16:57:29 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=190819 00:15:18.417 16:57:29 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:18.417 16:57:29 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:18.417 Running I/O for 10 seconds... 00:15:19.791 Latency(us) 00:15:19.791 [2024-11-29T15:57:31.222Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.791 [2024-11-29T15:57:31.222Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:19.791 Nvme0n1 : 1.00 14627.00 57.14 0.00 0.00 0.00 0.00 0.00 00:15:19.791 [2024-11-29T15:57:31.222Z] =================================================================================================================== 00:15:19.791 [2024-11-29T15:57:31.222Z] Total : 14627.00 57.14 0.00 0.00 0.00 0.00 0.00 00:15:19.791 00:15:20.358 16:57:31 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:20.616 [2024-11-29T15:57:32.047Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.616 Nvme0n1 : 2.00 14933.50 58.33 0.00 0.00 0.00 0.00 0.00 00:15:20.616 [2024-11-29T15:57:32.047Z] =================================================================================================================== 00:15:20.616 [2024-11-29T15:57:32.047Z] Total : 14933.50 58.33 0.00 0.00 0.00 0.00 0.00 00:15:20.616 00:15:20.616 true 00:15:20.616 16:57:32 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:20.616 16:57:32 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:20.875 16:57:32 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:20.875 16:57:32 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:20.875 16:57:32 -- target/nvmf_lvs_grow.sh@65 -- # wait 190819 00:15:21.442 [2024-11-29T15:57:32.873Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:21.442 Nvme0n1 : 3.00 15121.67 59.07 0.00 0.00 0.00 0.00 0.00 00:15:21.442 [2024-11-29T15:57:32.873Z] =================================================================================================================== 00:15:21.442 [2024-11-29T15:57:32.873Z] Total : 15121.67 59.07 0.00 0.00 0.00 0.00 0.00 00:15:21.442 00:15:22.378 [2024-11-29T15:57:33.809Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:22.378 Nvme0n1 : 4.00 15184.50 59.31 0.00 0.00 0.00 0.00 0.00 00:15:22.378 [2024-11-29T15:57:33.809Z] =================================================================================================================== 00:15:22.378 [2024-11-29T15:57:33.809Z] Total : 15184.50 59.31 0.00 0.00 0.00 0.00 0.00 00:15:22.378 00:15:23.753 [2024-11-29T15:57:35.184Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:23.753 Nvme0n1 : 5.00 15260.60 59.61 0.00 0.00 0.00 0.00 0.00 00:15:23.753 [2024-11-29T15:57:35.184Z] =================================================================================================================== 00:15:23.753 [2024-11-29T15:57:35.184Z] Total : 15260.60 59.61 0.00 0.00 0.00 0.00 0.00 00:15:23.753 00:15:24.686 [2024-11-29T15:57:36.117Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:24.686 Nvme0n1 : 6.00 15302.67 59.78 0.00 0.00 0.00 0.00 0.00 00:15:24.686 [2024-11-29T15:57:36.117Z] =================================================================================================================== 00:15:24.686 [2024-11-29T15:57:36.117Z] Total : 15302.67 59.78 0.00 0.00 0.00 0.00 0.00 00:15:24.686 00:15:25.619 [2024-11-29T15:57:37.050Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:25.619 Nvme0n1 : 7.00 15339.71 59.92 0.00 0.00 0.00 0.00 0.00 00:15:25.619 [2024-11-29T15:57:37.050Z] =================================================================================================================== 00:15:25.619 [2024-11-29T15:57:37.050Z] Total : 15339.71 59.92 0.00 0.00 0.00 0.00 0.00 00:15:25.619 00:15:26.552 [2024-11-29T15:57:37.983Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:26.552 Nvme0n1 : 8.00 15383.00 60.09 0.00 0.00 0.00 0.00 0.00 00:15:26.552 [2024-11-29T15:57:37.983Z] =================================================================================================================== 00:15:26.552 [2024-11-29T15:57:37.983Z] Total : 15383.00 60.09 0.00 0.00 0.00 0.00 0.00 00:15:26.552 00:15:27.486 [2024-11-29T15:57:38.917Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:27.486 Nvme0n1 : 9.00 15417.00 60.22 0.00 0.00 0.00 0.00 0.00 00:15:27.486 [2024-11-29T15:57:38.917Z] =================================================================================================================== 00:15:27.486 [2024-11-29T15:57:38.917Z] Total : 15417.00 60.22 0.00 0.00 0.00 0.00 0.00 00:15:27.486 00:15:28.422 00:15:28.422 Latency(us) 00:15:28.422 [2024-11-29T15:57:39.853Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:28.422 [2024-11-29T15:57:39.853Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:28.422 Nvme0n1 : 10.00 15447.91 60.34 0.00 0.00 8281.32 4733.16 16699.54 00:15:28.422 [2024-11-29T15:57:39.853Z] =================================================================================================================== 00:15:28.422 [2024-11-29T15:57:39.853Z] Total : 15447.91 60.34 0.00 0.00 8281.32 4733.16 16699.54 00:15:28.422 0 00:15:28.422 16:57:39 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 190672 00:15:28.422 16:57:39 -- common/autotest_common.sh@936 -- # '[' -z 190672 ']' 00:15:28.422 16:57:39 -- common/autotest_common.sh@940 -- # kill -0 190672 00:15:28.422 16:57:39 -- common/autotest_common.sh@941 -- # uname 00:15:28.422 16:57:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:28.422 16:57:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 190672 00:15:28.680 16:57:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:28.680 16:57:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:28.680 16:57:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 190672' 00:15:28.680 killing process with pid 190672 00:15:28.680 16:57:39 -- common/autotest_common.sh@955 -- # kill 190672 00:15:28.680 Received shutdown signal, test time was about 10.000000 seconds 00:15:28.680 00:15:28.680 Latency(us) 00:15:28.680 [2024-11-29T15:57:40.111Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:28.680 [2024-11-29T15:57:40.111Z] =================================================================================================================== 00:15:28.680 [2024-11-29T15:57:40.111Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:28.680 16:57:39 -- common/autotest_common.sh@960 -- # wait 190672 00:15:28.938 16:57:40 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:29.196 16:57:40 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:29.196 16:57:40 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:29.454 16:57:40 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:29.454 16:57:40 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:29.454 16:57:40 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 187347 00:15:29.455 16:57:40 -- target/nvmf_lvs_grow.sh@74 -- # wait 187347 00:15:29.455 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 187347 Killed "${NVMF_APP[@]}" "$@" 00:15:29.455 16:57:40 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:29.455 16:57:40 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:29.455 16:57:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:29.455 16:57:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:29.455 16:57:40 -- common/autotest_common.sh@10 -- # set +x 00:15:29.455 16:57:40 -- nvmf/common.sh@469 -- # nvmfpid=192180 00:15:29.455 16:57:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:29.455 16:57:40 -- nvmf/common.sh@470 -- # waitforlisten 192180 00:15:29.455 16:57:40 -- common/autotest_common.sh@829 -- # '[' -z 192180 ']' 00:15:29.455 16:57:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:29.455 16:57:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:29.455 16:57:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:29.455 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:29.455 16:57:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:29.455 16:57:40 -- common/autotest_common.sh@10 -- # set +x 00:15:29.455 [2024-11-29 16:57:40.790980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.455 [2024-11-29 16:57:40.791060] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:29.455 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.455 [2024-11-29 16:57:40.855918] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:29.714 [2024-11-29 16:57:40.962532] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:29.714 [2024-11-29 16:57:40.962656] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:29.714 [2024-11-29 16:57:40.962672] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:29.714 [2024-11-29 16:57:40.962684] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:29.714 [2024-11-29 16:57:40.962715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:30.648 16:57:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:30.648 16:57:41 -- common/autotest_common.sh@862 -- # return 0 00:15:30.648 16:57:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:30.648 16:57:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:30.648 16:57:41 -- common/autotest_common.sh@10 -- # set +x 00:15:30.648 16:57:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:30.648 16:57:41 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:30.648 [2024-11-29 16:57:42.067385] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:30.648 [2024-11-29 16:57:42.067568] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:30.648 [2024-11-29 16:57:42.067628] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:30.906 16:57:42 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:30.906 16:57:42 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev adba4fb2-e5f2-40c9-8ebf-9d9cecec377f 00:15:30.906 16:57:42 -- common/autotest_common.sh@897 -- # local bdev_name=adba4fb2-e5f2-40c9-8ebf-9d9cecec377f 00:15:30.906 16:57:42 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:30.906 16:57:42 -- common/autotest_common.sh@899 -- # local i 00:15:30.906 16:57:42 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:30.906 16:57:42 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:30.906 16:57:42 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:31.164 16:57:42 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b adba4fb2-e5f2-40c9-8ebf-9d9cecec377f -t 2000 00:15:31.164 [ 00:15:31.164 { 00:15:31.164 "name": "adba4fb2-e5f2-40c9-8ebf-9d9cecec377f", 00:15:31.164 "aliases": [ 00:15:31.164 "lvs/lvol" 00:15:31.164 ], 00:15:31.164 "product_name": "Logical Volume", 00:15:31.164 "block_size": 4096, 00:15:31.164 "num_blocks": 38912, 00:15:31.164 "uuid": "adba4fb2-e5f2-40c9-8ebf-9d9cecec377f", 00:15:31.164 "assigned_rate_limits": { 00:15:31.164 "rw_ios_per_sec": 0, 00:15:31.164 "rw_mbytes_per_sec": 0, 00:15:31.164 "r_mbytes_per_sec": 0, 00:15:31.164 "w_mbytes_per_sec": 0 00:15:31.164 }, 00:15:31.164 "claimed": false, 00:15:31.164 "zoned": false, 00:15:31.164 "supported_io_types": { 00:15:31.164 "read": true, 00:15:31.164 "write": true, 00:15:31.164 "unmap": true, 00:15:31.164 "write_zeroes": true, 00:15:31.164 "flush": false, 00:15:31.164 "reset": true, 00:15:31.164 "compare": false, 00:15:31.164 "compare_and_write": false, 00:15:31.164 "abort": false, 00:15:31.164 "nvme_admin": false, 00:15:31.164 "nvme_io": false 00:15:31.164 }, 00:15:31.164 "driver_specific": { 00:15:31.164 "lvol": { 00:15:31.164 "lvol_store_uuid": "e8680aa4-c6cc-4d69-b290-0e853d813df2", 00:15:31.164 "base_bdev": "aio_bdev", 00:15:31.164 "thin_provision": false, 00:15:31.164 "snapshot": false, 00:15:31.164 "clone": false, 00:15:31.164 "esnap_clone": false 00:15:31.164 } 00:15:31.164 } 00:15:31.164 } 00:15:31.164 ] 00:15:31.423 16:57:42 -- common/autotest_common.sh@905 -- # return 0 00:15:31.423 16:57:42 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:31.423 16:57:42 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:31.423 16:57:42 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:31.423 16:57:42 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:31.423 16:57:42 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:31.681 16:57:43 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:31.681 16:57:43 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:32.247 [2024-11-29 16:57:43.372532] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:32.247 16:57:43 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:32.247 16:57:43 -- common/autotest_common.sh@650 -- # local es=0 00:15:32.247 16:57:43 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:32.247 16:57:43 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:32.247 16:57:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:32.247 16:57:43 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:32.247 16:57:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:32.247 16:57:43 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:32.247 16:57:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:32.247 16:57:43 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:32.247 16:57:43 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:32.247 16:57:43 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:32.247 request: 00:15:32.247 { 00:15:32.247 "uuid": "e8680aa4-c6cc-4d69-b290-0e853d813df2", 00:15:32.247 "method": "bdev_lvol_get_lvstores", 00:15:32.247 "req_id": 1 00:15:32.247 } 00:15:32.247 Got JSON-RPC error response 00:15:32.247 response: 00:15:32.247 { 00:15:32.247 "code": -19, 00:15:32.247 "message": "No such device" 00:15:32.247 } 00:15:32.247 16:57:43 -- common/autotest_common.sh@653 -- # es=1 00:15:32.247 16:57:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:32.247 16:57:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:32.247 16:57:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:32.247 16:57:43 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:32.505 aio_bdev 00:15:32.764 16:57:43 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev adba4fb2-e5f2-40c9-8ebf-9d9cecec377f 00:15:32.764 16:57:43 -- common/autotest_common.sh@897 -- # local bdev_name=adba4fb2-e5f2-40c9-8ebf-9d9cecec377f 00:15:32.764 16:57:43 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:32.764 16:57:43 -- common/autotest_common.sh@899 -- # local i 00:15:32.764 16:57:43 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:32.764 16:57:43 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:32.764 16:57:43 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:33.023 16:57:44 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b adba4fb2-e5f2-40c9-8ebf-9d9cecec377f -t 2000 00:15:33.282 [ 00:15:33.282 { 00:15:33.282 "name": "adba4fb2-e5f2-40c9-8ebf-9d9cecec377f", 00:15:33.282 "aliases": [ 00:15:33.282 "lvs/lvol" 00:15:33.282 ], 00:15:33.282 "product_name": "Logical Volume", 00:15:33.282 "block_size": 4096, 00:15:33.282 "num_blocks": 38912, 00:15:33.282 "uuid": "adba4fb2-e5f2-40c9-8ebf-9d9cecec377f", 00:15:33.282 "assigned_rate_limits": { 00:15:33.282 "rw_ios_per_sec": 0, 00:15:33.282 "rw_mbytes_per_sec": 0, 00:15:33.282 "r_mbytes_per_sec": 0, 00:15:33.282 "w_mbytes_per_sec": 0 00:15:33.282 }, 00:15:33.282 "claimed": false, 00:15:33.282 "zoned": false, 00:15:33.282 "supported_io_types": { 00:15:33.282 "read": true, 00:15:33.282 "write": true, 00:15:33.282 "unmap": true, 00:15:33.282 "write_zeroes": true, 00:15:33.282 "flush": false, 00:15:33.282 "reset": true, 00:15:33.282 "compare": false, 00:15:33.282 "compare_and_write": false, 00:15:33.282 "abort": false, 00:15:33.282 "nvme_admin": false, 00:15:33.282 "nvme_io": false 00:15:33.282 }, 00:15:33.282 "driver_specific": { 00:15:33.282 "lvol": { 00:15:33.282 "lvol_store_uuid": "e8680aa4-c6cc-4d69-b290-0e853d813df2", 00:15:33.282 "base_bdev": "aio_bdev", 00:15:33.282 "thin_provision": false, 00:15:33.282 "snapshot": false, 00:15:33.282 "clone": false, 00:15:33.282 "esnap_clone": false 00:15:33.282 } 00:15:33.282 } 00:15:33.282 } 00:15:33.282 ] 00:15:33.282 16:57:44 -- common/autotest_common.sh@905 -- # return 0 00:15:33.282 16:57:44 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:33.282 16:57:44 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:33.540 16:57:44 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:33.540 16:57:44 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:33.540 16:57:44 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:33.796 16:57:45 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:33.796 16:57:45 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete adba4fb2-e5f2-40c9-8ebf-9d9cecec377f 00:15:34.053 16:57:45 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e8680aa4-c6cc-4d69-b290-0e853d813df2 00:15:34.311 16:57:45 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:34.568 16:57:45 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:34.568 00:15:34.568 real 0m20.692s 00:15:34.568 user 0m51.400s 00:15:34.568 sys 0m4.746s 00:15:34.568 16:57:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:34.568 16:57:45 -- common/autotest_common.sh@10 -- # set +x 00:15:34.568 ************************************ 00:15:34.568 END TEST lvs_grow_dirty 00:15:34.568 ************************************ 00:15:34.568 16:57:45 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:34.568 16:57:45 -- common/autotest_common.sh@806 -- # type=--id 00:15:34.568 16:57:45 -- common/autotest_common.sh@807 -- # id=0 00:15:34.568 16:57:45 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:34.568 16:57:45 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:34.568 16:57:45 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:34.568 16:57:45 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:34.568 16:57:45 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:34.568 16:57:45 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:34.568 nvmf_trace.0 00:15:34.568 16:57:45 -- common/autotest_common.sh@821 -- # return 0 00:15:34.568 16:57:45 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:34.568 16:57:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:34.568 16:57:45 -- nvmf/common.sh@116 -- # sync 00:15:34.568 16:57:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:34.568 16:57:45 -- nvmf/common.sh@119 -- # set +e 00:15:34.568 16:57:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:34.568 16:57:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:34.568 rmmod nvme_tcp 00:15:34.568 rmmod nvme_fabrics 00:15:34.826 rmmod nvme_keyring 00:15:34.826 16:57:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:34.826 16:57:46 -- nvmf/common.sh@123 -- # set -e 00:15:34.826 16:57:46 -- nvmf/common.sh@124 -- # return 0 00:15:34.826 16:57:46 -- nvmf/common.sh@477 -- # '[' -n 192180 ']' 00:15:34.826 16:57:46 -- nvmf/common.sh@478 -- # killprocess 192180 00:15:34.826 16:57:46 -- common/autotest_common.sh@936 -- # '[' -z 192180 ']' 00:15:34.826 16:57:46 -- common/autotest_common.sh@940 -- # kill -0 192180 00:15:34.826 16:57:46 -- common/autotest_common.sh@941 -- # uname 00:15:34.826 16:57:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:34.826 16:57:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 192180 00:15:34.826 16:57:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:34.826 16:57:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:34.826 16:57:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 192180' 00:15:34.826 killing process with pid 192180 00:15:34.826 16:57:46 -- common/autotest_common.sh@955 -- # kill 192180 00:15:34.826 16:57:46 -- common/autotest_common.sh@960 -- # wait 192180 00:15:35.085 16:57:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:35.085 16:57:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:35.085 16:57:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:35.085 16:57:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:35.085 16:57:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:35.085 16:57:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:35.085 16:57:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:35.085 16:57:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:36.987 16:57:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:36.987 00:15:36.987 real 0m44.597s 00:15:36.987 user 1m15.907s 00:15:36.987 sys 0m8.453s 00:15:36.987 16:57:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:36.987 16:57:48 -- common/autotest_common.sh@10 -- # set +x 00:15:36.987 ************************************ 00:15:36.987 END TEST nvmf_lvs_grow 00:15:36.987 ************************************ 00:15:37.245 16:57:48 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:37.245 16:57:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:37.245 16:57:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:37.245 16:57:48 -- common/autotest_common.sh@10 -- # set +x 00:15:37.245 ************************************ 00:15:37.245 START TEST nvmf_bdev_io_wait 00:15:37.245 ************************************ 00:15:37.245 16:57:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:37.245 * Looking for test storage... 00:15:37.245 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:37.245 16:57:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:37.245 16:57:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:37.245 16:57:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:37.245 16:57:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:37.245 16:57:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:37.245 16:57:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:37.245 16:57:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:37.245 16:57:48 -- scripts/common.sh@335 -- # IFS=.-: 00:15:37.245 16:57:48 -- scripts/common.sh@335 -- # read -ra ver1 00:15:37.245 16:57:48 -- scripts/common.sh@336 -- # IFS=.-: 00:15:37.245 16:57:48 -- scripts/common.sh@336 -- # read -ra ver2 00:15:37.245 16:57:48 -- scripts/common.sh@337 -- # local 'op=<' 00:15:37.245 16:57:48 -- scripts/common.sh@339 -- # ver1_l=2 00:15:37.245 16:57:48 -- scripts/common.sh@340 -- # ver2_l=1 00:15:37.245 16:57:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:37.245 16:57:48 -- scripts/common.sh@343 -- # case "$op" in 00:15:37.245 16:57:48 -- scripts/common.sh@344 -- # : 1 00:15:37.245 16:57:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:37.245 16:57:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:37.245 16:57:48 -- scripts/common.sh@364 -- # decimal 1 00:15:37.245 16:57:48 -- scripts/common.sh@352 -- # local d=1 00:15:37.245 16:57:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:37.245 16:57:48 -- scripts/common.sh@354 -- # echo 1 00:15:37.245 16:57:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:37.245 16:57:48 -- scripts/common.sh@365 -- # decimal 2 00:15:37.245 16:57:48 -- scripts/common.sh@352 -- # local d=2 00:15:37.245 16:57:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:37.245 16:57:48 -- scripts/common.sh@354 -- # echo 2 00:15:37.245 16:57:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:37.245 16:57:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:37.245 16:57:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:37.245 16:57:48 -- scripts/common.sh@367 -- # return 0 00:15:37.245 16:57:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:37.245 16:57:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:37.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:37.245 --rc genhtml_branch_coverage=1 00:15:37.245 --rc genhtml_function_coverage=1 00:15:37.245 --rc genhtml_legend=1 00:15:37.245 --rc geninfo_all_blocks=1 00:15:37.246 --rc geninfo_unexecuted_blocks=1 00:15:37.246 00:15:37.246 ' 00:15:37.246 16:57:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:37.246 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:37.246 --rc genhtml_branch_coverage=1 00:15:37.246 --rc genhtml_function_coverage=1 00:15:37.246 --rc genhtml_legend=1 00:15:37.246 --rc geninfo_all_blocks=1 00:15:37.246 --rc geninfo_unexecuted_blocks=1 00:15:37.246 00:15:37.246 ' 00:15:37.246 16:57:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:37.246 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:37.246 --rc genhtml_branch_coverage=1 00:15:37.246 --rc genhtml_function_coverage=1 00:15:37.246 --rc genhtml_legend=1 00:15:37.246 --rc geninfo_all_blocks=1 00:15:37.246 --rc geninfo_unexecuted_blocks=1 00:15:37.246 00:15:37.246 ' 00:15:37.246 16:57:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:37.246 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:37.246 --rc genhtml_branch_coverage=1 00:15:37.246 --rc genhtml_function_coverage=1 00:15:37.246 --rc genhtml_legend=1 00:15:37.246 --rc geninfo_all_blocks=1 00:15:37.246 --rc geninfo_unexecuted_blocks=1 00:15:37.246 00:15:37.246 ' 00:15:37.246 16:57:48 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:37.246 16:57:48 -- nvmf/common.sh@7 -- # uname -s 00:15:37.246 16:57:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:37.246 16:57:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:37.246 16:57:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:37.246 16:57:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:37.246 16:57:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:37.246 16:57:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:37.246 16:57:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:37.246 16:57:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:37.246 16:57:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:37.246 16:57:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:37.246 16:57:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:37.246 16:57:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:37.246 16:57:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:37.246 16:57:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:37.246 16:57:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:37.246 16:57:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:37.246 16:57:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:37.246 16:57:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:37.246 16:57:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:37.246 16:57:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.246 16:57:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.246 16:57:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.246 16:57:48 -- paths/export.sh@5 -- # export PATH 00:15:37.246 16:57:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.246 16:57:48 -- nvmf/common.sh@46 -- # : 0 00:15:37.246 16:57:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:37.246 16:57:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:37.246 16:57:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:37.246 16:57:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:37.246 16:57:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:37.246 16:57:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:37.246 16:57:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:37.246 16:57:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:37.246 16:57:48 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:37.246 16:57:48 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:37.246 16:57:48 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:37.246 16:57:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:37.246 16:57:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:37.246 16:57:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:37.246 16:57:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:37.246 16:57:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:37.246 16:57:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:37.246 16:57:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:37.246 16:57:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:37.246 16:57:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:37.246 16:57:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:37.246 16:57:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:37.246 16:57:48 -- common/autotest_common.sh@10 -- # set +x 00:15:39.777 16:57:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:39.777 16:57:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:39.777 16:57:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:39.777 16:57:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:39.777 16:57:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:39.777 16:57:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:39.777 16:57:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:39.777 16:57:50 -- nvmf/common.sh@294 -- # net_devs=() 00:15:39.777 16:57:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:39.777 16:57:50 -- nvmf/common.sh@295 -- # e810=() 00:15:39.777 16:57:50 -- nvmf/common.sh@295 -- # local -ga e810 00:15:39.777 16:57:50 -- nvmf/common.sh@296 -- # x722=() 00:15:39.777 16:57:50 -- nvmf/common.sh@296 -- # local -ga x722 00:15:39.777 16:57:50 -- nvmf/common.sh@297 -- # mlx=() 00:15:39.777 16:57:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:39.777 16:57:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:39.777 16:57:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:39.777 16:57:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:39.777 16:57:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:39.777 16:57:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:39.777 16:57:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:39.777 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:39.777 16:57:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:39.777 16:57:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:39.777 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:39.777 16:57:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:39.777 16:57:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:39.777 16:57:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:39.777 16:57:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:39.777 16:57:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:39.777 16:57:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:39.777 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:39.777 16:57:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:39.777 16:57:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:39.777 16:57:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:39.777 16:57:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:39.777 16:57:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:39.777 16:57:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:39.777 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:39.777 16:57:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:39.777 16:57:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:39.777 16:57:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:39.777 16:57:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:39.777 16:57:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:39.777 16:57:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:39.777 16:57:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:39.777 16:57:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:39.777 16:57:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:39.777 16:57:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:39.777 16:57:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:39.777 16:57:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:39.777 16:57:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:39.777 16:57:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:39.777 16:57:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:39.777 16:57:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:39.777 16:57:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:39.777 16:57:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:39.777 16:57:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:39.777 16:57:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:39.777 16:57:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:39.777 16:57:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:39.777 16:57:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:39.777 16:57:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:39.777 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:39.777 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:15:39.777 00:15:39.777 --- 10.0.0.2 ping statistics --- 00:15:39.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:39.777 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:15:39.777 16:57:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:39.777 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:39.777 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:15:39.777 00:15:39.777 --- 10.0.0.1 ping statistics --- 00:15:39.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:39.777 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:15:39.777 16:57:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:39.777 16:57:50 -- nvmf/common.sh@410 -- # return 0 00:15:39.777 16:57:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:39.777 16:57:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:39.777 16:57:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:39.777 16:57:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:39.777 16:57:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:39.777 16:57:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:39.777 16:57:50 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:39.777 16:57:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:39.777 16:57:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:39.777 16:57:50 -- common/autotest_common.sh@10 -- # set +x 00:15:39.777 16:57:50 -- nvmf/common.sh@469 -- # nvmfpid=194889 00:15:39.777 16:57:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:39.777 16:57:50 -- nvmf/common.sh@470 -- # waitforlisten 194889 00:15:39.777 16:57:50 -- common/autotest_common.sh@829 -- # '[' -z 194889 ']' 00:15:39.777 16:57:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:39.777 16:57:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:39.777 16:57:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:39.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:39.777 16:57:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:39.777 16:57:50 -- common/autotest_common.sh@10 -- # set +x 00:15:39.777 [2024-11-29 16:57:50.981256] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:39.777 [2024-11-29 16:57:50.981317] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:39.777 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.777 [2024-11-29 16:57:51.046354] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:39.777 [2024-11-29 16:57:51.163603] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:39.777 [2024-11-29 16:57:51.163758] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:39.777 [2024-11-29 16:57:51.163782] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:39.778 [2024-11-29 16:57:51.163797] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:39.778 [2024-11-29 16:57:51.163905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:39.778 [2024-11-29 16:57:51.163987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:39.778 [2024-11-29 16:57:51.164086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:39.778 [2024-11-29 16:57:51.164090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:40.759 16:57:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:40.759 16:57:51 -- common/autotest_common.sh@862 -- # return 0 00:15:40.759 16:57:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:40.759 16:57:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:40.759 16:57:51 -- common/autotest_common.sh@10 -- # set +x 00:15:40.759 16:57:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:40.759 16:57:51 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:40.759 16:57:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.759 16:57:51 -- common/autotest_common.sh@10 -- # set +x 00:15:40.759 16:57:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.759 16:57:51 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:40.759 16:57:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.759 16:57:51 -- common/autotest_common.sh@10 -- # set +x 00:15:40.759 16:57:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:40.759 16:57:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.759 16:57:52 -- common/autotest_common.sh@10 -- # set +x 00:15:40.759 [2024-11-29 16:57:52.035244] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:40.759 16:57:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:40.759 16:57:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.759 16:57:52 -- common/autotest_common.sh@10 -- # set +x 00:15:40.759 Malloc0 00:15:40.759 16:57:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:40.759 16:57:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.759 16:57:52 -- common/autotest_common.sh@10 -- # set +x 00:15:40.759 16:57:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:40.759 16:57:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.759 16:57:52 -- common/autotest_common.sh@10 -- # set +x 00:15:40.759 16:57:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:40.759 16:57:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.759 16:57:52 -- common/autotest_common.sh@10 -- # set +x 00:15:40.759 [2024-11-29 16:57:52.097593] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:40.759 16:57:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=195056 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@30 -- # READ_PID=195058 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:40.759 16:57:52 -- nvmf/common.sh@520 -- # config=() 00:15:40.759 16:57:52 -- nvmf/common.sh@520 -- # local subsystem config 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=195060 00:15:40.759 16:57:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:40.759 16:57:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:40.759 { 00:15:40.759 "params": { 00:15:40.759 "name": "Nvme$subsystem", 00:15:40.759 "trtype": "$TEST_TRANSPORT", 00:15:40.759 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:40.759 "adrfam": "ipv4", 00:15:40.759 "trsvcid": "$NVMF_PORT", 00:15:40.759 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:40.759 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:40.759 "hdgst": ${hdgst:-false}, 00:15:40.759 "ddgst": ${ddgst:-false} 00:15:40.759 }, 00:15:40.759 "method": "bdev_nvme_attach_controller" 00:15:40.759 } 00:15:40.759 EOF 00:15:40.759 )") 00:15:40.759 16:57:52 -- nvmf/common.sh@520 -- # config=() 00:15:40.759 16:57:52 -- nvmf/common.sh@520 -- # local subsystem config 00:15:40.759 16:57:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:40.759 16:57:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:40.759 { 00:15:40.759 "params": { 00:15:40.759 "name": "Nvme$subsystem", 00:15:40.759 "trtype": "$TEST_TRANSPORT", 00:15:40.759 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:40.759 "adrfam": "ipv4", 00:15:40.759 "trsvcid": "$NVMF_PORT", 00:15:40.759 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:40.759 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:40.759 "hdgst": ${hdgst:-false}, 00:15:40.759 "ddgst": ${ddgst:-false} 00:15:40.759 }, 00:15:40.759 "method": "bdev_nvme_attach_controller" 00:15:40.759 } 00:15:40.759 EOF 00:15:40.759 )") 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=195062 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@35 -- # sync 00:15:40.759 16:57:52 -- nvmf/common.sh@520 -- # config=() 00:15:40.759 16:57:52 -- nvmf/common.sh@520 -- # local subsystem config 00:15:40.759 16:57:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:40.759 16:57:52 -- nvmf/common.sh@542 -- # cat 00:15:40.759 16:57:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:40.759 { 00:15:40.759 "params": { 00:15:40.759 "name": "Nvme$subsystem", 00:15:40.759 "trtype": "$TEST_TRANSPORT", 00:15:40.759 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:40.759 "adrfam": "ipv4", 00:15:40.759 "trsvcid": "$NVMF_PORT", 00:15:40.759 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:40.759 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:40.759 "hdgst": ${hdgst:-false}, 00:15:40.759 "ddgst": ${ddgst:-false} 00:15:40.759 }, 00:15:40.759 "method": "bdev_nvme_attach_controller" 00:15:40.759 } 00:15:40.759 EOF 00:15:40.759 )") 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:40.759 16:57:52 -- nvmf/common.sh@520 -- # config=() 00:15:40.759 16:57:52 -- nvmf/common.sh@542 -- # cat 00:15:40.759 16:57:52 -- nvmf/common.sh@520 -- # local subsystem config 00:15:40.759 16:57:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:40.759 16:57:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:40.759 { 00:15:40.759 "params": { 00:15:40.759 "name": "Nvme$subsystem", 00:15:40.759 "trtype": "$TEST_TRANSPORT", 00:15:40.759 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:40.759 "adrfam": "ipv4", 00:15:40.759 "trsvcid": "$NVMF_PORT", 00:15:40.759 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:40.759 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:40.759 "hdgst": ${hdgst:-false}, 00:15:40.759 "ddgst": ${ddgst:-false} 00:15:40.759 }, 00:15:40.759 "method": "bdev_nvme_attach_controller" 00:15:40.759 } 00:15:40.759 EOF 00:15:40.759 )") 00:15:40.759 16:57:52 -- nvmf/common.sh@542 -- # cat 00:15:40.759 16:57:52 -- target/bdev_io_wait.sh@37 -- # wait 195056 00:15:40.759 16:57:52 -- nvmf/common.sh@542 -- # cat 00:15:40.759 16:57:52 -- nvmf/common.sh@544 -- # jq . 00:15:40.759 16:57:52 -- nvmf/common.sh@544 -- # jq . 00:15:40.759 16:57:52 -- nvmf/common.sh@544 -- # jq . 00:15:40.759 16:57:52 -- nvmf/common.sh@544 -- # jq . 00:15:40.759 16:57:52 -- nvmf/common.sh@545 -- # IFS=, 00:15:40.759 16:57:52 -- nvmf/common.sh@545 -- # IFS=, 00:15:40.760 16:57:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:40.760 "params": { 00:15:40.760 "name": "Nvme1", 00:15:40.760 "trtype": "tcp", 00:15:40.760 "traddr": "10.0.0.2", 00:15:40.760 "adrfam": "ipv4", 00:15:40.760 "trsvcid": "4420", 00:15:40.760 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:40.760 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:40.760 "hdgst": false, 00:15:40.760 "ddgst": false 00:15:40.760 }, 00:15:40.760 "method": "bdev_nvme_attach_controller" 00:15:40.760 }' 00:15:40.760 16:57:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:40.760 "params": { 00:15:40.760 "name": "Nvme1", 00:15:40.760 "trtype": "tcp", 00:15:40.760 "traddr": "10.0.0.2", 00:15:40.760 "adrfam": "ipv4", 00:15:40.760 "trsvcid": "4420", 00:15:40.760 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:40.760 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:40.760 "hdgst": false, 00:15:40.760 "ddgst": false 00:15:40.760 }, 00:15:40.760 "method": "bdev_nvme_attach_controller" 00:15:40.760 }' 00:15:40.760 16:57:52 -- nvmf/common.sh@545 -- # IFS=, 00:15:40.760 16:57:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:40.760 "params": { 00:15:40.760 "name": "Nvme1", 00:15:40.760 "trtype": "tcp", 00:15:40.760 "traddr": "10.0.0.2", 00:15:40.760 "adrfam": "ipv4", 00:15:40.760 "trsvcid": "4420", 00:15:40.760 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:40.760 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:40.760 "hdgst": false, 00:15:40.760 "ddgst": false 00:15:40.760 }, 00:15:40.760 "method": "bdev_nvme_attach_controller" 00:15:40.760 }' 00:15:40.760 16:57:52 -- nvmf/common.sh@545 -- # IFS=, 00:15:40.760 16:57:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:40.760 "params": { 00:15:40.760 "name": "Nvme1", 00:15:40.760 "trtype": "tcp", 00:15:40.760 "traddr": "10.0.0.2", 00:15:40.760 "adrfam": "ipv4", 00:15:40.760 "trsvcid": "4420", 00:15:40.760 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:40.760 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:40.760 "hdgst": false, 00:15:40.760 "ddgst": false 00:15:40.760 }, 00:15:40.760 "method": "bdev_nvme_attach_controller" 00:15:40.760 }' 00:15:40.760 [2024-11-29 16:57:52.140324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:40.760 [2024-11-29 16:57:52.140324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:40.760 [2024-11-29 16:57:52.140325] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:40.760 [2024-11-29 16:57:52.140413] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-29 16:57:52.140413] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-29 16:57:52.140413] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:40.760 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:40.760 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:40.760 [2024-11-29 16:57:52.140841] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:40.760 [2024-11-29 16:57:52.140903] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:40.760 EAL: No free 2048 kB hugepages reported on node 1 00:15:41.017 EAL: No free 2048 kB hugepages reported on node 1 00:15:41.017 [2024-11-29 16:57:52.311053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:41.017 EAL: No free 2048 kB hugepages reported on node 1 00:15:41.017 [2024-11-29 16:57:52.404648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:41.017 [2024-11-29 16:57:52.410198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:41.274 EAL: No free 2048 kB hugepages reported on node 1 00:15:41.274 [2024-11-29 16:57:52.507758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:41.274 [2024-11-29 16:57:52.512017] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:41.274 [2024-11-29 16:57:52.581230] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:41.274 [2024-11-29 16:57:52.608623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:41.274 [2024-11-29 16:57:52.674134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:41.531 Running I/O for 1 seconds... 00:15:41.532 Running I/O for 1 seconds... 00:15:41.532 Running I/O for 1 seconds... 00:15:41.788 Running I/O for 1 seconds... 00:15:42.353 00:15:42.353 Latency(us) 00:15:42.353 [2024-11-29T15:57:53.784Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:42.353 [2024-11-29T15:57:53.784Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:42.353 Nvme1n1 : 1.01 12256.35 47.88 0.00 0.00 10407.35 5801.15 19126.80 00:15:42.353 [2024-11-29T15:57:53.784Z] =================================================================================================================== 00:15:42.353 [2024-11-29T15:57:53.784Z] Total : 12256.35 47.88 0.00 0.00 10407.35 5801.15 19126.80 00:15:42.611 00:15:42.611 Latency(us) 00:15:42.611 [2024-11-29T15:57:54.042Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:42.611 [2024-11-29T15:57:54.043Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:42.612 Nvme1n1 : 1.02 5910.65 23.09 0.00 0.00 21430.08 11553.75 38253.61 00:15:42.612 [2024-11-29T15:57:54.043Z] =================================================================================================================== 00:15:42.612 [2024-11-29T15:57:54.043Z] Total : 5910.65 23.09 0.00 0.00 21430.08 11553.75 38253.61 00:15:42.612 00:15:42.612 Latency(us) 00:15:42.612 [2024-11-29T15:57:54.043Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:42.612 [2024-11-29T15:57:54.043Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:42.612 Nvme1n1 : 1.00 199812.86 780.52 0.00 0.00 638.33 253.35 928.43 00:15:42.612 [2024-11-29T15:57:54.043Z] =================================================================================================================== 00:15:42.612 [2024-11-29T15:57:54.043Z] Total : 199812.86 780.52 0.00 0.00 638.33 253.35 928.43 00:15:42.612 00:15:42.612 Latency(us) 00:15:42.612 [2024-11-29T15:57:54.043Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:42.612 [2024-11-29T15:57:54.043Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:42.612 Nvme1n1 : 1.01 6312.22 24.66 0.00 0.00 20207.36 6189.51 51652.08 00:15:42.612 [2024-11-29T15:57:54.043Z] =================================================================================================================== 00:15:42.612 [2024-11-29T15:57:54.043Z] Total : 6312.22 24.66 0.00 0.00 20207.36 6189.51 51652.08 00:15:42.612 16:57:54 -- target/bdev_io_wait.sh@38 -- # wait 195058 00:15:42.880 16:57:54 -- target/bdev_io_wait.sh@39 -- # wait 195060 00:15:42.880 16:57:54 -- target/bdev_io_wait.sh@40 -- # wait 195062 00:15:43.158 16:57:54 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:43.159 16:57:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:43.159 16:57:54 -- common/autotest_common.sh@10 -- # set +x 00:15:43.159 16:57:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:43.159 16:57:54 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:43.159 16:57:54 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:43.159 16:57:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:43.159 16:57:54 -- nvmf/common.sh@116 -- # sync 00:15:43.159 16:57:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:43.159 16:57:54 -- nvmf/common.sh@119 -- # set +e 00:15:43.159 16:57:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:43.159 16:57:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:43.159 rmmod nvme_tcp 00:15:43.159 rmmod nvme_fabrics 00:15:43.159 rmmod nvme_keyring 00:15:43.159 16:57:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:43.159 16:57:54 -- nvmf/common.sh@123 -- # set -e 00:15:43.159 16:57:54 -- nvmf/common.sh@124 -- # return 0 00:15:43.159 16:57:54 -- nvmf/common.sh@477 -- # '[' -n 194889 ']' 00:15:43.159 16:57:54 -- nvmf/common.sh@478 -- # killprocess 194889 00:15:43.159 16:57:54 -- common/autotest_common.sh@936 -- # '[' -z 194889 ']' 00:15:43.159 16:57:54 -- common/autotest_common.sh@940 -- # kill -0 194889 00:15:43.159 16:57:54 -- common/autotest_common.sh@941 -- # uname 00:15:43.159 16:57:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:43.159 16:57:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 194889 00:15:43.159 16:57:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:43.159 16:57:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:43.159 16:57:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 194889' 00:15:43.159 killing process with pid 194889 00:15:43.159 16:57:54 -- common/autotest_common.sh@955 -- # kill 194889 00:15:43.159 16:57:54 -- common/autotest_common.sh@960 -- # wait 194889 00:15:43.438 16:57:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:43.438 16:57:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:43.438 16:57:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:43.438 16:57:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:43.438 16:57:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:43.438 16:57:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:43.438 16:57:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:43.438 16:57:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:45.441 16:57:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:45.441 00:15:45.441 real 0m8.265s 00:15:45.441 user 0m20.348s 00:15:45.441 sys 0m3.481s 00:15:45.441 16:57:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:45.441 16:57:56 -- common/autotest_common.sh@10 -- # set +x 00:15:45.441 ************************************ 00:15:45.441 END TEST nvmf_bdev_io_wait 00:15:45.441 ************************************ 00:15:45.441 16:57:56 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:45.441 16:57:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:45.441 16:57:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:45.441 16:57:56 -- common/autotest_common.sh@10 -- # set +x 00:15:45.441 ************************************ 00:15:45.441 START TEST nvmf_queue_depth 00:15:45.441 ************************************ 00:15:45.441 16:57:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:45.441 * Looking for test storage... 00:15:45.441 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:45.441 16:57:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:45.441 16:57:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:45.441 16:57:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:45.441 16:57:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:45.441 16:57:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:45.441 16:57:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:45.441 16:57:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:45.441 16:57:56 -- scripts/common.sh@335 -- # IFS=.-: 00:15:45.441 16:57:56 -- scripts/common.sh@335 -- # read -ra ver1 00:15:45.441 16:57:56 -- scripts/common.sh@336 -- # IFS=.-: 00:15:45.441 16:57:56 -- scripts/common.sh@336 -- # read -ra ver2 00:15:45.441 16:57:56 -- scripts/common.sh@337 -- # local 'op=<' 00:15:45.441 16:57:56 -- scripts/common.sh@339 -- # ver1_l=2 00:15:45.441 16:57:56 -- scripts/common.sh@340 -- # ver2_l=1 00:15:45.441 16:57:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:45.441 16:57:56 -- scripts/common.sh@343 -- # case "$op" in 00:15:45.441 16:57:56 -- scripts/common.sh@344 -- # : 1 00:15:45.441 16:57:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:45.441 16:57:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:45.441 16:57:56 -- scripts/common.sh@364 -- # decimal 1 00:15:45.441 16:57:56 -- scripts/common.sh@352 -- # local d=1 00:15:45.441 16:57:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:45.441 16:57:56 -- scripts/common.sh@354 -- # echo 1 00:15:45.441 16:57:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:45.441 16:57:56 -- scripts/common.sh@365 -- # decimal 2 00:15:45.441 16:57:56 -- scripts/common.sh@352 -- # local d=2 00:15:45.441 16:57:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:45.441 16:57:56 -- scripts/common.sh@354 -- # echo 2 00:15:45.441 16:57:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:45.441 16:57:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:45.441 16:57:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:45.441 16:57:56 -- scripts/common.sh@367 -- # return 0 00:15:45.441 16:57:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:45.441 16:57:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:45.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:45.441 --rc genhtml_branch_coverage=1 00:15:45.441 --rc genhtml_function_coverage=1 00:15:45.441 --rc genhtml_legend=1 00:15:45.441 --rc geninfo_all_blocks=1 00:15:45.441 --rc geninfo_unexecuted_blocks=1 00:15:45.441 00:15:45.441 ' 00:15:45.441 16:57:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:45.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:45.441 --rc genhtml_branch_coverage=1 00:15:45.441 --rc genhtml_function_coverage=1 00:15:45.441 --rc genhtml_legend=1 00:15:45.441 --rc geninfo_all_blocks=1 00:15:45.441 --rc geninfo_unexecuted_blocks=1 00:15:45.441 00:15:45.441 ' 00:15:45.442 16:57:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:45.442 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:45.442 --rc genhtml_branch_coverage=1 00:15:45.442 --rc genhtml_function_coverage=1 00:15:45.442 --rc genhtml_legend=1 00:15:45.442 --rc geninfo_all_blocks=1 00:15:45.442 --rc geninfo_unexecuted_blocks=1 00:15:45.442 00:15:45.442 ' 00:15:45.442 16:57:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:45.442 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:45.442 --rc genhtml_branch_coverage=1 00:15:45.442 --rc genhtml_function_coverage=1 00:15:45.442 --rc genhtml_legend=1 00:15:45.442 --rc geninfo_all_blocks=1 00:15:45.442 --rc geninfo_unexecuted_blocks=1 00:15:45.442 00:15:45.442 ' 00:15:45.442 16:57:56 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:45.722 16:57:56 -- nvmf/common.sh@7 -- # uname -s 00:15:45.722 16:57:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:45.722 16:57:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:45.722 16:57:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:45.722 16:57:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:45.722 16:57:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:45.722 16:57:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:45.722 16:57:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:45.722 16:57:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:45.722 16:57:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:45.722 16:57:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:45.722 16:57:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:45.722 16:57:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:45.722 16:57:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:45.722 16:57:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:45.722 16:57:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:45.722 16:57:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:45.722 16:57:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:45.722 16:57:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:45.722 16:57:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:45.723 16:57:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:45.723 16:57:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:45.723 16:57:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:45.723 16:57:56 -- paths/export.sh@5 -- # export PATH 00:15:45.723 16:57:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:45.723 16:57:56 -- nvmf/common.sh@46 -- # : 0 00:15:45.723 16:57:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:45.723 16:57:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:45.723 16:57:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:45.723 16:57:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:45.723 16:57:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:45.723 16:57:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:45.723 16:57:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:45.723 16:57:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:45.723 16:57:56 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:45.723 16:57:56 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:45.723 16:57:56 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:45.723 16:57:56 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:45.723 16:57:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:45.723 16:57:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:45.723 16:57:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:45.723 16:57:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:45.723 16:57:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:45.723 16:57:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:45.723 16:57:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:45.723 16:57:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:45.723 16:57:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:45.723 16:57:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:45.723 16:57:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:45.723 16:57:56 -- common/autotest_common.sh@10 -- # set +x 00:15:47.722 16:57:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:47.722 16:57:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:47.722 16:57:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:47.722 16:57:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:47.722 16:57:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:47.722 16:57:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:47.722 16:57:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:47.722 16:57:58 -- nvmf/common.sh@294 -- # net_devs=() 00:15:47.722 16:57:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:47.722 16:57:58 -- nvmf/common.sh@295 -- # e810=() 00:15:47.722 16:57:58 -- nvmf/common.sh@295 -- # local -ga e810 00:15:47.722 16:57:58 -- nvmf/common.sh@296 -- # x722=() 00:15:47.722 16:57:58 -- nvmf/common.sh@296 -- # local -ga x722 00:15:47.722 16:57:58 -- nvmf/common.sh@297 -- # mlx=() 00:15:47.722 16:57:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:47.722 16:57:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:47.722 16:57:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:47.722 16:57:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:47.722 16:57:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:47.722 16:57:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:47.722 16:57:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:47.722 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:47.722 16:57:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:47.722 16:57:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:47.722 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:47.722 16:57:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:47.722 16:57:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:47.722 16:57:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:47.722 16:57:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:47.722 16:57:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:47.722 16:57:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:47.722 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:47.722 16:57:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:47.722 16:57:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:47.722 16:57:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:47.722 16:57:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:47.722 16:57:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:47.722 16:57:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:47.722 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:47.722 16:57:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:47.722 16:57:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:47.722 16:57:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:47.722 16:57:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:47.722 16:57:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:47.722 16:57:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:47.722 16:57:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:47.722 16:57:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:47.722 16:57:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:47.722 16:57:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:47.722 16:57:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:47.722 16:57:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:47.722 16:57:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:47.722 16:57:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:47.722 16:57:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:47.722 16:57:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:47.722 16:57:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:47.722 16:57:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:47.722 16:57:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:47.722 16:57:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:47.722 16:57:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:47.722 16:57:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:47.722 16:57:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:47.722 16:57:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:47.722 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:47.722 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:15:47.722 00:15:47.722 --- 10.0.0.2 ping statistics --- 00:15:47.722 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:47.722 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:15:47.722 16:57:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:47.722 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:47.722 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:15:47.722 00:15:47.722 --- 10.0.0.1 ping statistics --- 00:15:47.722 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:47.722 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:15:47.722 16:57:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:47.722 16:57:58 -- nvmf/common.sh@410 -- # return 0 00:15:47.722 16:57:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:47.722 16:57:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:47.722 16:57:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:47.722 16:57:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:47.722 16:57:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:47.722 16:57:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:47.722 16:57:58 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:47.723 16:57:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:47.723 16:57:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:47.723 16:57:58 -- common/autotest_common.sh@10 -- # set +x 00:15:47.723 16:57:58 -- nvmf/common.sh@469 -- # nvmfpid=197325 00:15:47.723 16:57:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:47.723 16:57:58 -- nvmf/common.sh@470 -- # waitforlisten 197325 00:15:47.723 16:57:58 -- common/autotest_common.sh@829 -- # '[' -z 197325 ']' 00:15:47.723 16:57:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:47.723 16:57:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:47.723 16:57:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:47.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:47.723 16:57:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:47.723 16:57:58 -- common/autotest_common.sh@10 -- # set +x 00:15:47.723 [2024-11-29 16:57:59.001835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:47.723 [2024-11-29 16:57:59.001920] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:47.723 EAL: No free 2048 kB hugepages reported on node 1 00:15:47.723 [2024-11-29 16:57:59.063772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:48.025 [2024-11-29 16:57:59.170267] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:48.025 [2024-11-29 16:57:59.170423] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:48.025 [2024-11-29 16:57:59.170442] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:48.025 [2024-11-29 16:57:59.170454] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:48.025 [2024-11-29 16:57:59.170481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:48.676 16:57:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:48.676 16:57:59 -- common/autotest_common.sh@862 -- # return 0 00:15:48.676 16:57:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:48.676 16:57:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:48.676 16:57:59 -- common/autotest_common.sh@10 -- # set +x 00:15:48.676 16:58:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:48.676 16:58:00 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:48.676 16:58:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.676 16:58:00 -- common/autotest_common.sh@10 -- # set +x 00:15:48.676 [2024-11-29 16:58:00.009473] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:48.676 16:58:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.676 16:58:00 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:48.676 16:58:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.676 16:58:00 -- common/autotest_common.sh@10 -- # set +x 00:15:48.676 Malloc0 00:15:48.676 16:58:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.676 16:58:00 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:48.676 16:58:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.676 16:58:00 -- common/autotest_common.sh@10 -- # set +x 00:15:48.676 16:58:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.676 16:58:00 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:48.676 16:58:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.676 16:58:00 -- common/autotest_common.sh@10 -- # set +x 00:15:48.676 16:58:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.676 16:58:00 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:48.676 16:58:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.676 16:58:00 -- common/autotest_common.sh@10 -- # set +x 00:15:48.676 [2024-11-29 16:58:00.067880] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:48.676 16:58:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.676 16:58:00 -- target/queue_depth.sh@30 -- # bdevperf_pid=197486 00:15:48.676 16:58:00 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:48.676 16:58:00 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:48.676 16:58:00 -- target/queue_depth.sh@33 -- # waitforlisten 197486 /var/tmp/bdevperf.sock 00:15:48.676 16:58:00 -- common/autotest_common.sh@829 -- # '[' -z 197486 ']' 00:15:48.676 16:58:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:48.676 16:58:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:48.676 16:58:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:48.676 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:48.676 16:58:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:48.676 16:58:00 -- common/autotest_common.sh@10 -- # set +x 00:15:48.942 [2024-11-29 16:58:00.110889] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:48.942 [2024-11-29 16:58:00.110986] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid197486 ] 00:15:48.942 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.942 [2024-11-29 16:58:00.173268] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:48.942 [2024-11-29 16:58:00.290651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:49.972 16:58:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:49.972 16:58:01 -- common/autotest_common.sh@862 -- # return 0 00:15:49.972 16:58:01 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:49.972 16:58:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:49.972 16:58:01 -- common/autotest_common.sh@10 -- # set +x 00:15:49.972 NVMe0n1 00:15:49.972 16:58:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:49.973 16:58:01 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:49.973 Running I/O for 10 seconds... 00:16:00.021 00:16:00.021 Latency(us) 00:16:00.021 [2024-11-29T15:58:11.452Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:00.021 [2024-11-29T15:58:11.452Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:16:00.021 Verification LBA range: start 0x0 length 0x4000 00:16:00.021 NVMe0n1 : 10.07 12381.25 48.36 0.00 0.00 82374.94 15049.01 62137.84 00:16:00.021 [2024-11-29T15:58:11.452Z] =================================================================================================================== 00:16:00.021 [2024-11-29T15:58:11.452Z] Total : 12381.25 48.36 0.00 0.00 82374.94 15049.01 62137.84 00:16:00.021 0 00:16:00.281 16:58:11 -- target/queue_depth.sh@39 -- # killprocess 197486 00:16:00.281 16:58:11 -- common/autotest_common.sh@936 -- # '[' -z 197486 ']' 00:16:00.281 16:58:11 -- common/autotest_common.sh@940 -- # kill -0 197486 00:16:00.281 16:58:11 -- common/autotest_common.sh@941 -- # uname 00:16:00.281 16:58:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:00.281 16:58:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 197486 00:16:00.281 16:58:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:00.281 16:58:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:00.281 16:58:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 197486' 00:16:00.281 killing process with pid 197486 00:16:00.281 16:58:11 -- common/autotest_common.sh@955 -- # kill 197486 00:16:00.281 Received shutdown signal, test time was about 10.000000 seconds 00:16:00.281 00:16:00.281 Latency(us) 00:16:00.281 [2024-11-29T15:58:11.712Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:00.281 [2024-11-29T15:58:11.712Z] =================================================================================================================== 00:16:00.281 [2024-11-29T15:58:11.712Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:00.281 16:58:11 -- common/autotest_common.sh@960 -- # wait 197486 00:16:00.540 16:58:11 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:16:00.540 16:58:11 -- target/queue_depth.sh@43 -- # nvmftestfini 00:16:00.540 16:58:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:00.540 16:58:11 -- nvmf/common.sh@116 -- # sync 00:16:00.540 16:58:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:00.540 16:58:11 -- nvmf/common.sh@119 -- # set +e 00:16:00.540 16:58:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:00.540 16:58:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:00.540 rmmod nvme_tcp 00:16:00.540 rmmod nvme_fabrics 00:16:00.540 rmmod nvme_keyring 00:16:00.540 16:58:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:00.540 16:58:11 -- nvmf/common.sh@123 -- # set -e 00:16:00.540 16:58:11 -- nvmf/common.sh@124 -- # return 0 00:16:00.540 16:58:11 -- nvmf/common.sh@477 -- # '[' -n 197325 ']' 00:16:00.540 16:58:11 -- nvmf/common.sh@478 -- # killprocess 197325 00:16:00.540 16:58:11 -- common/autotest_common.sh@936 -- # '[' -z 197325 ']' 00:16:00.540 16:58:11 -- common/autotest_common.sh@940 -- # kill -0 197325 00:16:00.540 16:58:11 -- common/autotest_common.sh@941 -- # uname 00:16:00.540 16:58:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:00.540 16:58:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 197325 00:16:00.540 16:58:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:00.540 16:58:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:00.540 16:58:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 197325' 00:16:00.540 killing process with pid 197325 00:16:00.540 16:58:11 -- common/autotest_common.sh@955 -- # kill 197325 00:16:00.540 16:58:11 -- common/autotest_common.sh@960 -- # wait 197325 00:16:00.798 16:58:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:00.798 16:58:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:00.798 16:58:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:00.798 16:58:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:00.798 16:58:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:00.798 16:58:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.798 16:58:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.798 16:58:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:03.332 16:58:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:03.332 00:16:03.332 real 0m17.505s 00:16:03.332 user 0m25.360s 00:16:03.332 sys 0m3.001s 00:16:03.332 16:58:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:03.332 16:58:14 -- common/autotest_common.sh@10 -- # set +x 00:16:03.332 ************************************ 00:16:03.332 END TEST nvmf_queue_depth 00:16:03.332 ************************************ 00:16:03.332 16:58:14 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:16:03.332 16:58:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:03.332 16:58:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:03.332 16:58:14 -- common/autotest_common.sh@10 -- # set +x 00:16:03.332 ************************************ 00:16:03.332 START TEST nvmf_multipath 00:16:03.332 ************************************ 00:16:03.332 16:58:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:16:03.332 * Looking for test storage... 00:16:03.332 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:03.332 16:58:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:03.332 16:58:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:03.332 16:58:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:03.332 16:58:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:03.332 16:58:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:03.332 16:58:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:03.332 16:58:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:03.332 16:58:14 -- scripts/common.sh@335 -- # IFS=.-: 00:16:03.333 16:58:14 -- scripts/common.sh@335 -- # read -ra ver1 00:16:03.333 16:58:14 -- scripts/common.sh@336 -- # IFS=.-: 00:16:03.333 16:58:14 -- scripts/common.sh@336 -- # read -ra ver2 00:16:03.333 16:58:14 -- scripts/common.sh@337 -- # local 'op=<' 00:16:03.333 16:58:14 -- scripts/common.sh@339 -- # ver1_l=2 00:16:03.333 16:58:14 -- scripts/common.sh@340 -- # ver2_l=1 00:16:03.333 16:58:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:03.333 16:58:14 -- scripts/common.sh@343 -- # case "$op" in 00:16:03.333 16:58:14 -- scripts/common.sh@344 -- # : 1 00:16:03.333 16:58:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:03.333 16:58:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:03.333 16:58:14 -- scripts/common.sh@364 -- # decimal 1 00:16:03.333 16:58:14 -- scripts/common.sh@352 -- # local d=1 00:16:03.333 16:58:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:03.333 16:58:14 -- scripts/common.sh@354 -- # echo 1 00:16:03.333 16:58:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:03.333 16:58:14 -- scripts/common.sh@365 -- # decimal 2 00:16:03.333 16:58:14 -- scripts/common.sh@352 -- # local d=2 00:16:03.333 16:58:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:03.333 16:58:14 -- scripts/common.sh@354 -- # echo 2 00:16:03.333 16:58:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:03.333 16:58:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:03.333 16:58:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:03.333 16:58:14 -- scripts/common.sh@367 -- # return 0 00:16:03.333 16:58:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:03.333 16:58:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:03.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:03.333 --rc genhtml_branch_coverage=1 00:16:03.333 --rc genhtml_function_coverage=1 00:16:03.333 --rc genhtml_legend=1 00:16:03.333 --rc geninfo_all_blocks=1 00:16:03.333 --rc geninfo_unexecuted_blocks=1 00:16:03.333 00:16:03.333 ' 00:16:03.333 16:58:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:03.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:03.333 --rc genhtml_branch_coverage=1 00:16:03.333 --rc genhtml_function_coverage=1 00:16:03.333 --rc genhtml_legend=1 00:16:03.333 --rc geninfo_all_blocks=1 00:16:03.333 --rc geninfo_unexecuted_blocks=1 00:16:03.333 00:16:03.333 ' 00:16:03.333 16:58:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:03.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:03.333 --rc genhtml_branch_coverage=1 00:16:03.333 --rc genhtml_function_coverage=1 00:16:03.333 --rc genhtml_legend=1 00:16:03.333 --rc geninfo_all_blocks=1 00:16:03.333 --rc geninfo_unexecuted_blocks=1 00:16:03.333 00:16:03.333 ' 00:16:03.333 16:58:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:03.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:03.333 --rc genhtml_branch_coverage=1 00:16:03.333 --rc genhtml_function_coverage=1 00:16:03.333 --rc genhtml_legend=1 00:16:03.333 --rc geninfo_all_blocks=1 00:16:03.333 --rc geninfo_unexecuted_blocks=1 00:16:03.333 00:16:03.333 ' 00:16:03.333 16:58:14 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:03.333 16:58:14 -- nvmf/common.sh@7 -- # uname -s 00:16:03.333 16:58:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:03.333 16:58:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:03.333 16:58:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:03.333 16:58:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:03.333 16:58:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:03.333 16:58:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:03.333 16:58:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:03.333 16:58:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:03.333 16:58:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:03.333 16:58:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:03.333 16:58:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:03.333 16:58:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:03.333 16:58:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:03.333 16:58:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:03.333 16:58:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:03.333 16:58:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:03.333 16:58:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:03.333 16:58:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:03.333 16:58:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:03.333 16:58:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.333 16:58:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.333 16:58:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.333 16:58:14 -- paths/export.sh@5 -- # export PATH 00:16:03.333 16:58:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.333 16:58:14 -- nvmf/common.sh@46 -- # : 0 00:16:03.333 16:58:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:03.333 16:58:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:03.333 16:58:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:03.333 16:58:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:03.333 16:58:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:03.333 16:58:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:03.333 16:58:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:03.333 16:58:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:03.333 16:58:14 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:03.333 16:58:14 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:03.333 16:58:14 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:16:03.333 16:58:14 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:03.333 16:58:14 -- target/multipath.sh@43 -- # nvmftestinit 00:16:03.333 16:58:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:03.333 16:58:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:03.333 16:58:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:03.333 16:58:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:03.333 16:58:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:03.333 16:58:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:03.333 16:58:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:03.333 16:58:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:03.333 16:58:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:03.333 16:58:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:03.333 16:58:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:03.333 16:58:14 -- common/autotest_common.sh@10 -- # set +x 00:16:05.237 16:58:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:05.237 16:58:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:05.237 16:58:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:05.237 16:58:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:05.237 16:58:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:05.237 16:58:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:05.237 16:58:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:05.237 16:58:16 -- nvmf/common.sh@294 -- # net_devs=() 00:16:05.237 16:58:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:05.237 16:58:16 -- nvmf/common.sh@295 -- # e810=() 00:16:05.237 16:58:16 -- nvmf/common.sh@295 -- # local -ga e810 00:16:05.237 16:58:16 -- nvmf/common.sh@296 -- # x722=() 00:16:05.237 16:58:16 -- nvmf/common.sh@296 -- # local -ga x722 00:16:05.237 16:58:16 -- nvmf/common.sh@297 -- # mlx=() 00:16:05.237 16:58:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:05.237 16:58:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:05.237 16:58:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:05.237 16:58:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:05.237 16:58:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:05.237 16:58:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:05.237 16:58:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:05.237 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:05.237 16:58:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:05.237 16:58:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:05.237 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:05.237 16:58:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:05.237 16:58:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:05.237 16:58:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:05.237 16:58:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:05.237 16:58:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:05.237 16:58:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:05.237 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:05.237 16:58:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:05.237 16:58:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:05.237 16:58:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:05.237 16:58:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:05.237 16:58:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:05.237 16:58:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:05.237 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:05.237 16:58:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:05.237 16:58:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:05.237 16:58:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:05.237 16:58:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:05.237 16:58:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:05.237 16:58:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:05.237 16:58:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:05.237 16:58:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:05.237 16:58:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:05.237 16:58:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:05.237 16:58:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:05.237 16:58:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:05.237 16:58:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:05.237 16:58:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:05.237 16:58:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:05.237 16:58:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:05.237 16:58:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:05.237 16:58:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:05.237 16:58:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:05.237 16:58:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:05.237 16:58:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:05.237 16:58:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:05.237 16:58:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:05.237 16:58:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:05.237 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:05.237 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.329 ms 00:16:05.237 00:16:05.237 --- 10.0.0.2 ping statistics --- 00:16:05.237 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:05.237 rtt min/avg/max/mdev = 0.329/0.329/0.329/0.000 ms 00:16:05.237 16:58:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:05.237 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:05.237 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:16:05.237 00:16:05.237 --- 10.0.0.1 ping statistics --- 00:16:05.237 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:05.237 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:16:05.237 16:58:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:05.237 16:58:16 -- nvmf/common.sh@410 -- # return 0 00:16:05.237 16:58:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:05.237 16:58:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:05.237 16:58:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:05.237 16:58:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:05.237 16:58:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:05.237 16:58:16 -- target/multipath.sh@45 -- # '[' -z ']' 00:16:05.237 16:58:16 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:16:05.237 only one NIC for nvmf test 00:16:05.237 16:58:16 -- target/multipath.sh@47 -- # nvmftestfini 00:16:05.237 16:58:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:05.237 16:58:16 -- nvmf/common.sh@116 -- # sync 00:16:05.237 16:58:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:05.237 16:58:16 -- nvmf/common.sh@119 -- # set +e 00:16:05.237 16:58:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:05.237 16:58:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:05.237 rmmod nvme_tcp 00:16:05.237 rmmod nvme_fabrics 00:16:05.237 rmmod nvme_keyring 00:16:05.237 16:58:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:05.237 16:58:16 -- nvmf/common.sh@123 -- # set -e 00:16:05.237 16:58:16 -- nvmf/common.sh@124 -- # return 0 00:16:05.237 16:58:16 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:05.237 16:58:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:05.237 16:58:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:05.237 16:58:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:05.237 16:58:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:05.237 16:58:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:05.237 16:58:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:05.237 16:58:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:07.780 16:58:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:07.780 16:58:18 -- target/multipath.sh@48 -- # exit 0 00:16:07.780 16:58:18 -- target/multipath.sh@1 -- # nvmftestfini 00:16:07.780 16:58:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:07.780 16:58:18 -- nvmf/common.sh@116 -- # sync 00:16:07.780 16:58:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:07.780 16:58:18 -- nvmf/common.sh@119 -- # set +e 00:16:07.780 16:58:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:07.780 16:58:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:07.780 16:58:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:07.780 16:58:18 -- nvmf/common.sh@123 -- # set -e 00:16:07.780 16:58:18 -- nvmf/common.sh@124 -- # return 0 00:16:07.780 16:58:18 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:07.780 16:58:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:07.780 16:58:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:07.780 16:58:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:07.780 16:58:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:07.780 16:58:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:07.780 16:58:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:07.780 16:58:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:07.780 16:58:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:07.780 16:58:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:07.780 00:16:07.780 real 0m4.440s 00:16:07.780 user 0m0.882s 00:16:07.780 sys 0m1.526s 00:16:07.780 16:58:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:07.780 16:58:18 -- common/autotest_common.sh@10 -- # set +x 00:16:07.780 ************************************ 00:16:07.780 END TEST nvmf_multipath 00:16:07.780 ************************************ 00:16:07.780 16:58:18 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:07.780 16:58:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:07.780 16:58:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:07.780 16:58:18 -- common/autotest_common.sh@10 -- # set +x 00:16:07.780 ************************************ 00:16:07.780 START TEST nvmf_zcopy 00:16:07.780 ************************************ 00:16:07.780 16:58:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:07.780 * Looking for test storage... 00:16:07.780 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:07.780 16:58:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:07.780 16:58:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:07.780 16:58:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:07.780 16:58:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:07.780 16:58:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:07.780 16:58:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:07.780 16:58:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:07.780 16:58:18 -- scripts/common.sh@335 -- # IFS=.-: 00:16:07.780 16:58:18 -- scripts/common.sh@335 -- # read -ra ver1 00:16:07.780 16:58:18 -- scripts/common.sh@336 -- # IFS=.-: 00:16:07.780 16:58:18 -- scripts/common.sh@336 -- # read -ra ver2 00:16:07.780 16:58:18 -- scripts/common.sh@337 -- # local 'op=<' 00:16:07.780 16:58:18 -- scripts/common.sh@339 -- # ver1_l=2 00:16:07.780 16:58:18 -- scripts/common.sh@340 -- # ver2_l=1 00:16:07.780 16:58:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:07.780 16:58:18 -- scripts/common.sh@343 -- # case "$op" in 00:16:07.780 16:58:18 -- scripts/common.sh@344 -- # : 1 00:16:07.780 16:58:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:07.781 16:58:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:07.781 16:58:18 -- scripts/common.sh@364 -- # decimal 1 00:16:07.781 16:58:18 -- scripts/common.sh@352 -- # local d=1 00:16:07.781 16:58:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:07.781 16:58:18 -- scripts/common.sh@354 -- # echo 1 00:16:07.781 16:58:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:07.781 16:58:18 -- scripts/common.sh@365 -- # decimal 2 00:16:07.781 16:58:18 -- scripts/common.sh@352 -- # local d=2 00:16:07.781 16:58:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:07.781 16:58:18 -- scripts/common.sh@354 -- # echo 2 00:16:07.781 16:58:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:07.781 16:58:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:07.781 16:58:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:07.781 16:58:18 -- scripts/common.sh@367 -- # return 0 00:16:07.781 16:58:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:07.781 16:58:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:07.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.781 --rc genhtml_branch_coverage=1 00:16:07.781 --rc genhtml_function_coverage=1 00:16:07.781 --rc genhtml_legend=1 00:16:07.781 --rc geninfo_all_blocks=1 00:16:07.781 --rc geninfo_unexecuted_blocks=1 00:16:07.781 00:16:07.781 ' 00:16:07.781 16:58:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:07.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.781 --rc genhtml_branch_coverage=1 00:16:07.781 --rc genhtml_function_coverage=1 00:16:07.781 --rc genhtml_legend=1 00:16:07.781 --rc geninfo_all_blocks=1 00:16:07.781 --rc geninfo_unexecuted_blocks=1 00:16:07.781 00:16:07.781 ' 00:16:07.781 16:58:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:07.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.781 --rc genhtml_branch_coverage=1 00:16:07.781 --rc genhtml_function_coverage=1 00:16:07.781 --rc genhtml_legend=1 00:16:07.781 --rc geninfo_all_blocks=1 00:16:07.781 --rc geninfo_unexecuted_blocks=1 00:16:07.781 00:16:07.781 ' 00:16:07.781 16:58:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:07.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.781 --rc genhtml_branch_coverage=1 00:16:07.781 --rc genhtml_function_coverage=1 00:16:07.781 --rc genhtml_legend=1 00:16:07.781 --rc geninfo_all_blocks=1 00:16:07.781 --rc geninfo_unexecuted_blocks=1 00:16:07.781 00:16:07.781 ' 00:16:07.781 16:58:18 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:07.781 16:58:18 -- nvmf/common.sh@7 -- # uname -s 00:16:07.781 16:58:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:07.781 16:58:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:07.781 16:58:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:07.781 16:58:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:07.781 16:58:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:07.781 16:58:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:07.781 16:58:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:07.781 16:58:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:07.781 16:58:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:07.781 16:58:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:07.781 16:58:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:07.781 16:58:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:07.781 16:58:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:07.781 16:58:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:07.781 16:58:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:07.781 16:58:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:07.781 16:58:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:07.781 16:58:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:07.781 16:58:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:07.781 16:58:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.781 16:58:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.781 16:58:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.781 16:58:18 -- paths/export.sh@5 -- # export PATH 00:16:07.781 16:58:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.781 16:58:18 -- nvmf/common.sh@46 -- # : 0 00:16:07.781 16:58:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:07.781 16:58:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:07.781 16:58:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:07.781 16:58:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:07.781 16:58:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:07.781 16:58:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:07.781 16:58:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:07.781 16:58:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:07.781 16:58:18 -- target/zcopy.sh@12 -- # nvmftestinit 00:16:07.781 16:58:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:07.781 16:58:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:07.781 16:58:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:07.781 16:58:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:07.781 16:58:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:07.781 16:58:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:07.781 16:58:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:07.781 16:58:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:07.781 16:58:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:07.781 16:58:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:07.781 16:58:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:07.781 16:58:18 -- common/autotest_common.sh@10 -- # set +x 00:16:09.687 16:58:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:09.687 16:58:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:09.687 16:58:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:09.687 16:58:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:09.687 16:58:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:09.687 16:58:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:09.687 16:58:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:09.687 16:58:21 -- nvmf/common.sh@294 -- # net_devs=() 00:16:09.687 16:58:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:09.687 16:58:21 -- nvmf/common.sh@295 -- # e810=() 00:16:09.687 16:58:21 -- nvmf/common.sh@295 -- # local -ga e810 00:16:09.687 16:58:21 -- nvmf/common.sh@296 -- # x722=() 00:16:09.687 16:58:21 -- nvmf/common.sh@296 -- # local -ga x722 00:16:09.687 16:58:21 -- nvmf/common.sh@297 -- # mlx=() 00:16:09.687 16:58:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:09.687 16:58:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:09.687 16:58:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:09.687 16:58:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:09.687 16:58:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:09.687 16:58:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:09.687 16:58:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:09.687 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:09.687 16:58:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:09.687 16:58:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:09.687 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:09.687 16:58:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:09.687 16:58:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:09.687 16:58:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:09.687 16:58:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:09.687 16:58:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:09.687 16:58:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:09.687 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:09.687 16:58:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:09.687 16:58:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:09.687 16:58:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:09.687 16:58:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:09.687 16:58:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:09.687 16:58:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:09.687 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:09.687 16:58:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:09.687 16:58:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:09.687 16:58:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:09.687 16:58:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:09.687 16:58:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:09.687 16:58:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:09.687 16:58:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:09.688 16:58:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:09.688 16:58:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:09.688 16:58:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:09.688 16:58:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:09.688 16:58:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:09.688 16:58:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:09.688 16:58:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:09.688 16:58:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:09.688 16:58:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:09.688 16:58:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:09.688 16:58:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:09.688 16:58:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:09.688 16:58:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:09.688 16:58:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:09.688 16:58:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:09.947 16:58:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:09.947 16:58:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:09.947 16:58:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:09.947 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:09.947 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.355 ms 00:16:09.947 00:16:09.947 --- 10.0.0.2 ping statistics --- 00:16:09.947 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:09.947 rtt min/avg/max/mdev = 0.355/0.355/0.355/0.000 ms 00:16:09.947 16:58:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:09.947 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:09.947 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:16:09.947 00:16:09.947 --- 10.0.0.1 ping statistics --- 00:16:09.947 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:09.947 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:16:09.947 16:58:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:09.947 16:58:21 -- nvmf/common.sh@410 -- # return 0 00:16:09.947 16:58:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:09.947 16:58:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:09.947 16:58:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:09.947 16:58:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:09.947 16:58:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:09.947 16:58:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:09.947 16:58:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:09.947 16:58:21 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:09.947 16:58:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:09.947 16:58:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:09.947 16:58:21 -- common/autotest_common.sh@10 -- # set +x 00:16:09.947 16:58:21 -- nvmf/common.sh@469 -- # nvmfpid=202895 00:16:09.947 16:58:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:09.947 16:58:21 -- nvmf/common.sh@470 -- # waitforlisten 202895 00:16:09.947 16:58:21 -- common/autotest_common.sh@829 -- # '[' -z 202895 ']' 00:16:09.947 16:58:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:09.947 16:58:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:09.947 16:58:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:09.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:09.947 16:58:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:09.947 16:58:21 -- common/autotest_common.sh@10 -- # set +x 00:16:09.947 [2024-11-29 16:58:21.214884] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:09.947 [2024-11-29 16:58:21.214985] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:09.947 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.947 [2024-11-29 16:58:21.279150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:10.205 [2024-11-29 16:58:21.388794] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:10.205 [2024-11-29 16:58:21.388948] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:10.205 [2024-11-29 16:58:21.388974] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:10.205 [2024-11-29 16:58:21.389003] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:10.205 [2024-11-29 16:58:21.389031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:11.139 16:58:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:11.139 16:58:22 -- common/autotest_common.sh@862 -- # return 0 00:16:11.139 16:58:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:11.139 16:58:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:11.139 16:58:22 -- common/autotest_common.sh@10 -- # set +x 00:16:11.139 16:58:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:11.139 16:58:22 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:16:11.139 16:58:22 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:16:11.139 16:58:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:11.139 16:58:22 -- common/autotest_common.sh@10 -- # set +x 00:16:11.139 [2024-11-29 16:58:22.263767] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:11.139 16:58:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:11.139 16:58:22 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:11.139 16:58:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:11.139 16:58:22 -- common/autotest_common.sh@10 -- # set +x 00:16:11.139 16:58:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:11.139 16:58:22 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:11.139 16:58:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:11.139 16:58:22 -- common/autotest_common.sh@10 -- # set +x 00:16:11.139 [2024-11-29 16:58:22.279994] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:11.139 16:58:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:11.139 16:58:22 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:11.139 16:58:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:11.139 16:58:22 -- common/autotest_common.sh@10 -- # set +x 00:16:11.139 16:58:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:11.139 16:58:22 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:16:11.139 16:58:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:11.139 16:58:22 -- common/autotest_common.sh@10 -- # set +x 00:16:11.139 malloc0 00:16:11.139 16:58:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:11.139 16:58:22 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:11.139 16:58:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:11.139 16:58:22 -- common/autotest_common.sh@10 -- # set +x 00:16:11.139 16:58:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:11.139 16:58:22 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:16:11.139 16:58:22 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:16:11.139 16:58:22 -- nvmf/common.sh@520 -- # config=() 00:16:11.139 16:58:22 -- nvmf/common.sh@520 -- # local subsystem config 00:16:11.139 16:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:11.139 16:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:11.139 { 00:16:11.139 "params": { 00:16:11.139 "name": "Nvme$subsystem", 00:16:11.139 "trtype": "$TEST_TRANSPORT", 00:16:11.139 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:11.139 "adrfam": "ipv4", 00:16:11.139 "trsvcid": "$NVMF_PORT", 00:16:11.139 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:11.139 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:11.139 "hdgst": ${hdgst:-false}, 00:16:11.139 "ddgst": ${ddgst:-false} 00:16:11.139 }, 00:16:11.139 "method": "bdev_nvme_attach_controller" 00:16:11.139 } 00:16:11.139 EOF 00:16:11.139 )") 00:16:11.139 16:58:22 -- nvmf/common.sh@542 -- # cat 00:16:11.139 16:58:22 -- nvmf/common.sh@544 -- # jq . 00:16:11.139 16:58:22 -- nvmf/common.sh@545 -- # IFS=, 00:16:11.139 16:58:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:11.139 "params": { 00:16:11.139 "name": "Nvme1", 00:16:11.139 "trtype": "tcp", 00:16:11.139 "traddr": "10.0.0.2", 00:16:11.139 "adrfam": "ipv4", 00:16:11.139 "trsvcid": "4420", 00:16:11.139 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:11.139 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:11.139 "hdgst": false, 00:16:11.139 "ddgst": false 00:16:11.139 }, 00:16:11.139 "method": "bdev_nvme_attach_controller" 00:16:11.139 }' 00:16:11.139 [2024-11-29 16:58:22.359042] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:11.140 [2024-11-29 16:58:22.359122] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid203053 ] 00:16:11.140 EAL: No free 2048 kB hugepages reported on node 1 00:16:11.140 [2024-11-29 16:58:22.427023] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:11.140 [2024-11-29 16:58:22.548095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:11.706 Running I/O for 10 seconds... 00:16:21.672 00:16:21.672 Latency(us) 00:16:21.672 [2024-11-29T15:58:33.103Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:21.672 [2024-11-29T15:58:33.103Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:21.672 Verification LBA range: start 0x0 length 0x1000 00:16:21.672 Nvme1n1 : 10.01 8802.96 68.77 0.00 0.00 14505.89 1268.24 20874.43 00:16:21.672 [2024-11-29T15:58:33.103Z] =================================================================================================================== 00:16:21.672 [2024-11-29T15:58:33.103Z] Total : 8802.96 68.77 0.00 0.00 14505.89 1268.24 20874.43 00:16:21.931 16:58:33 -- target/zcopy.sh@39 -- # perfpid=204292 00:16:21.931 16:58:33 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:21.931 16:58:33 -- common/autotest_common.sh@10 -- # set +x 00:16:21.931 16:58:33 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:21.931 16:58:33 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:21.931 16:58:33 -- nvmf/common.sh@520 -- # config=() 00:16:21.931 16:58:33 -- nvmf/common.sh@520 -- # local subsystem config 00:16:21.931 16:58:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:21.931 16:58:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:21.931 { 00:16:21.931 "params": { 00:16:21.931 "name": "Nvme$subsystem", 00:16:21.931 "trtype": "$TEST_TRANSPORT", 00:16:21.931 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:21.931 "adrfam": "ipv4", 00:16:21.931 "trsvcid": "$NVMF_PORT", 00:16:21.931 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:21.931 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:21.931 "hdgst": ${hdgst:-false}, 00:16:21.931 "ddgst": ${ddgst:-false} 00:16:21.931 }, 00:16:21.931 "method": "bdev_nvme_attach_controller" 00:16:21.931 } 00:16:21.931 EOF 00:16:21.931 )") 00:16:21.931 16:58:33 -- nvmf/common.sh@542 -- # cat 00:16:21.931 [2024-11-29 16:58:33.222378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.222423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 16:58:33 -- nvmf/common.sh@544 -- # jq . 00:16:21.931 16:58:33 -- nvmf/common.sh@545 -- # IFS=, 00:16:21.931 16:58:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:21.931 "params": { 00:16:21.931 "name": "Nvme1", 00:16:21.931 "trtype": "tcp", 00:16:21.931 "traddr": "10.0.0.2", 00:16:21.931 "adrfam": "ipv4", 00:16:21.931 "trsvcid": "4420", 00:16:21.931 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:21.931 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:21.931 "hdgst": false, 00:16:21.931 "ddgst": false 00:16:21.931 }, 00:16:21.931 "method": "bdev_nvme_attach_controller" 00:16:21.931 }' 00:16:21.931 [2024-11-29 16:58:33.230340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.230367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.238357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.238382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.246382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.246406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.254402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.254426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.257840] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:21.931 [2024-11-29 16:58:33.257906] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid204292 ] 00:16:21.931 [2024-11-29 16:58:33.262423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.262447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.270446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.270470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.278469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.278493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.286491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.286516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 EAL: No free 2048 kB hugepages reported on node 1 00:16:21.931 [2024-11-29 16:58:33.294512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.294544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.302534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.302557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.310556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.310580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.318578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.318601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.326602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.326625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.931 [2024-11-29 16:58:33.326823] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:21.931 [2024-11-29 16:58:33.334659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.931 [2024-11-29 16:58:33.334696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.932 [2024-11-29 16:58:33.342678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.932 [2024-11-29 16:58:33.342714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.932 [2024-11-29 16:58:33.350702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.932 [2024-11-29 16:58:33.350727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.932 [2024-11-29 16:58:33.358695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.932 [2024-11-29 16:58:33.358719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.190 [2024-11-29 16:58:33.366719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.366744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.374742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.374768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.382768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.382796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.390789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.390814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.398833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.398870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.406835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.406870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.414853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.414877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.422876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.422900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.430898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.430922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.438920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.438944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.446941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.446979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.448295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:22.191 [2024-11-29 16:58:33.454970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.454994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.463002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.463030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.471041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.471077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.479065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.479104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.487090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.487131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.495101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.495138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.503122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.503160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.511132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.511164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.519144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.519170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.527190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.527228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.535216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.535255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.543210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.543233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.551231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.551255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.559264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.559290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.567287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.567314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.575310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.575336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.583332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.583358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.591357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.591392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.599380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.599407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.607400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.607424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.191 [2024-11-29 16:58:33.615424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.191 [2024-11-29 16:58:33.615448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.623449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.623472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.631470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.631493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.639495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.639520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.647518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.647543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.655538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.655562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.663564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.663588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.671586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.671609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.679610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.679633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.687639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.687665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.695656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.695680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.703678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.703701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.711699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.711722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.719722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.719745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.727750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.727775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.735770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.735793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.743824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.743853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.751836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.751861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 Running I/O for 5 seconds... 00:16:22.450 [2024-11-29 16:58:33.759869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.759897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.774321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.774351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.785071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.785100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.795746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.795776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.806480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.806509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.817552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.817581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.830336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.830366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.840039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.840068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.850756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.850785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.861577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.861606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.450 [2024-11-29 16:58:33.872626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.450 [2024-11-29 16:58:33.872655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.708 [2024-11-29 16:58:33.883882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.708 [2024-11-29 16:58:33.883911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.708 [2024-11-29 16:58:33.894883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.708 [2024-11-29 16:58:33.894912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.708 [2024-11-29 16:58:33.905418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:33.905447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:33.916007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:33.916036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:33.926765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:33.926794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:33.937614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:33.937643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:33.948399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:33.948428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:33.958985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:33.959015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:33.969999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:33.970028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:33.980505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:33.980534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:33.991299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:33.991328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.001796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.001825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.012147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.012177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.022943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.022981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.034082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.034111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.045405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.045434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.056205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.056234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.066536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.066566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.077093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.077133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.088121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.088150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.100523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.100552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.110495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.110524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.121308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.121337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.709 [2024-11-29 16:58:34.132795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.709 [2024-11-29 16:58:34.132824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.967 [2024-11-29 16:58:34.143218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.143247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.153710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.153739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.164516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.164546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.176844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.176873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.186267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.186296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.199263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.199292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.209457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.209486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.220205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.220235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.231466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.231496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.242191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.242222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.255346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.255375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.265654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.265684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.276266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.276295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.289092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.289121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.299527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.299556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.310650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.310679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.321879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.321909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.333358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.333389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.344374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.344404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.357157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.357198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.367389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.367418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.378468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.378498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:22.968 [2024-11-29 16:58:34.389630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:22.968 [2024-11-29 16:58:34.389660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.400700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.400730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.413367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.413396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.423133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.423163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.434775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.434805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.447090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.447119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.456519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.456548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.469432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.469462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.479838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.479867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.490971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.490999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.501829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.501859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.512523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.512553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.523630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.523660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.534531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.534561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.547296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.547326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.557272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.557301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.568592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.227 [2024-11-29 16:58:34.568630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.227 [2024-11-29 16:58:34.579701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.228 [2024-11-29 16:58:34.579732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.228 [2024-11-29 16:58:34.590784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.228 [2024-11-29 16:58:34.590813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.228 [2024-11-29 16:58:34.601948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.228 [2024-11-29 16:58:34.601986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.228 [2024-11-29 16:58:34.613176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.228 [2024-11-29 16:58:34.613214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.228 [2024-11-29 16:58:34.626267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.228 [2024-11-29 16:58:34.626297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.228 [2024-11-29 16:58:34.636723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.228 [2024-11-29 16:58:34.636752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.228 [2024-11-29 16:58:34.647711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.228 [2024-11-29 16:58:34.647741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.661145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.661176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.671924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.671954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.683222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.683256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.696197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.696227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.705871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.705900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.717008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.717037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.727681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.727710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.738439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.738468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.749417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.749447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.760482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.760511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.771489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.771518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.782329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.782368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.793450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.793479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.804490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.804519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.817525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.817554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.828077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.828106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.486 [2024-11-29 16:58:34.838488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.486 [2024-11-29 16:58:34.838517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.487 [2024-11-29 16:58:34.849100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.487 [2024-11-29 16:58:34.849129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.487 [2024-11-29 16:58:34.859498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.487 [2024-11-29 16:58:34.859527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.487 [2024-11-29 16:58:34.869997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.487 [2024-11-29 16:58:34.870026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.487 [2024-11-29 16:58:34.880777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.487 [2024-11-29 16:58:34.880806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.487 [2024-11-29 16:58:34.893769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.487 [2024-11-29 16:58:34.893799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.487 [2024-11-29 16:58:34.904220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.487 [2024-11-29 16:58:34.904249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.487 [2024-11-29 16:58:34.914702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.487 [2024-11-29 16:58:34.914731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:34.926972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:34.927001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:34.936103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:34.936132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:34.949115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:34.949144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:34.959669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:34.959698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:34.970177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:34.970206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:34.981487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:34.981517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:34.992357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:34.992396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.005150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.005179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.014873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.014902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.026188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.026218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.037280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.037309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.047989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.048018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.060523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.060552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.071896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.071925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.080835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.080865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.092469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.092500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.103660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.103689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.114608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.745 [2024-11-29 16:58:35.114639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.745 [2024-11-29 16:58:35.127419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.746 [2024-11-29 16:58:35.127448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.746 [2024-11-29 16:58:35.137813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.746 [2024-11-29 16:58:35.137842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.746 [2024-11-29 16:58:35.148398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.746 [2024-11-29 16:58:35.148427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.746 [2024-11-29 16:58:35.159451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.746 [2024-11-29 16:58:35.159480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:23.746 [2024-11-29 16:58:35.170536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:23.746 [2024-11-29 16:58:35.170565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.180820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.180849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.191638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.191667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.204326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.204355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.214451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.214480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.225035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.225064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.235976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.236005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.246618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.246648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.259486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.259515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.270000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.270027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.279735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.279761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.291042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.291069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.302113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.302140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.313493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.313523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.324992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.325056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.335934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.335983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.349456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.349485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.360168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.360197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.370695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.370721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.380986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.381012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.391760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.391789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.402253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.402278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.413214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.413254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.003 [2024-11-29 16:58:35.425803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.003 [2024-11-29 16:58:35.425829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.436088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.436118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.447121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.447147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.459474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.459503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.469516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.469541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.480232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.480261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.493350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.493375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.503147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.503173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.514049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.514076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.526652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.526682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.536707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.536737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.547790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.547820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.560302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.560331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.570271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.570300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.580802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.580831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.591849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.591879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.604114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.604143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.613507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.613536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.626858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.626887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.637777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.637807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.648396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.648427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.659159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.659190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.671755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.671784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.262 [2024-11-29 16:58:35.681851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.262 [2024-11-29 16:58:35.681881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.692796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.692825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.705727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.705757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.716123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.716153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.727242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.727271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.739996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.740027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.750922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.750951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.761713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.761750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.775102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.775134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.785355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.785384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.796305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.522 [2024-11-29 16:58:35.796334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.522 [2024-11-29 16:58:35.808998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.809029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.818504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.818533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.829555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.829585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.842424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.842453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.852833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.852862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.863730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.863759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.874277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.874306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.885446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.885476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.898339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.898368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.908351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.908380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.919172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.919201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.931291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.931321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.941464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.941494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.523 [2024-11-29 16:58:35.952789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.523 [2024-11-29 16:58:35.952818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.781 [2024-11-29 16:58:35.965415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.781 [2024-11-29 16:58:35.965445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.781 [2024-11-29 16:58:35.975766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.781 [2024-11-29 16:58:35.975796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.781 [2024-11-29 16:58:35.986387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.781 [2024-11-29 16:58:35.986417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.781 [2024-11-29 16:58:35.997368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.781 [2024-11-29 16:58:35.997398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.781 [2024-11-29 16:58:36.008176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.781 [2024-11-29 16:58:36.008205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.781 [2024-11-29 16:58:36.020656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.020686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.030573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.030602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.041651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.041689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.054931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.054969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.064941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.064982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.076075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.076105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.086855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.086885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.097614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.097643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.110084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.110113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.120052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.120081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.130982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.131011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.141443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.141472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.152560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.152590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.165656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.165686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.176227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.176256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.187411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.187440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.200008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.200038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.782 [2024-11-29 16:58:36.210136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:24.782 [2024-11-29 16:58:36.210165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.221105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.221134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.234095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.234124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.244374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.244403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.255361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.255400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.266256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.266284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.276677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.276706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.287201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.287230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.297714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.297742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.308781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.308810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.319965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.319994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.330903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.330932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.343749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.343778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.353821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.353850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.364420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.364450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.375156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.375186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.386204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.386234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.397278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.397307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.408077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.408107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.421066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.421096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.431389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.431420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.442157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.442187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.452616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.452646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.041 [2024-11-29 16:58:36.463207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.041 [2024-11-29 16:58:36.463246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.476224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.476254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.486593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.486622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.497186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.497215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.509471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.509500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.519919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.519948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.530826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.530856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.543975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.544004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.554394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.554423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.565146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.565175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.575706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.575735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.586846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.586875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.599579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.599608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.609697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.609726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.620465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.620494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.631429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.631458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.642721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.642750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.654016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.654045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.664716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.664746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.677470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.677508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.687751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.687781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.698592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.698621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.712076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.712106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.300 [2024-11-29 16:58:36.722424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.300 [2024-11-29 16:58:36.722453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.733302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.733332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.743826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.743856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.754547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.754576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.767535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.767565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.778022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.778051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.788804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.788833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.801673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.801703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.812454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.812484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.823839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.823868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.834596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.834626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.845991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.846021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.856459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.856489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.867367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.867396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.880702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.880732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.890910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.890939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.901860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.901889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.912381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.912410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.923318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.923347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.936272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.936301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.948248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.948277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.957302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.957331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.969116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.969145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.559 [2024-11-29 16:58:36.979905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.559 [2024-11-29 16:58:36.979934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:36.990758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:36.990788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.001265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.001295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.011938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.011977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.024877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.024906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.034797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.034826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.045683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.045712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.056787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.056816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.067664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.067693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.080748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.080778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.091000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.091030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.102113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.102143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.114846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.114876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.124837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.124867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.135220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.135248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.146386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.146415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.157529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.157558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.170524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.170553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.180886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.180915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.191853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.191882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.204876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.204906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.214842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.214872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.225623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.225652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.237929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.237967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:25.818 [2024-11-29 16:58:37.246885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:25.818 [2024-11-29 16:58:37.246915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.259975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.260004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.270660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.270689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.281354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.281383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.294079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.294108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.304259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.304289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.314921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.314951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.326100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.326130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.337261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.337291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.350170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.350200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.360700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.360729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.371527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.371556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.383952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.383990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.393911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.393941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.405314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.405344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.416041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.416070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.426912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.426941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.438000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.438029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.448808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.448837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.461364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.461393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.471351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.471380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.482671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.482701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.495728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.495757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.077 [2024-11-29 16:58:37.506085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.077 [2024-11-29 16:58:37.506114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.336 [2024-11-29 16:58:37.516901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.336 [2024-11-29 16:58:37.516931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.336 [2024-11-29 16:58:37.530448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.336 [2024-11-29 16:58:37.530478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.336 [2024-11-29 16:58:37.540585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.336 [2024-11-29 16:58:37.540614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.336 [2024-11-29 16:58:37.551469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.336 [2024-11-29 16:58:37.551498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.336 [2024-11-29 16:58:37.564675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.336 [2024-11-29 16:58:37.564704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.336 [2024-11-29 16:58:37.574942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.336 [2024-11-29 16:58:37.574981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.336 [2024-11-29 16:58:37.586182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.336 [2024-11-29 16:58:37.586210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.336 [2024-11-29 16:58:37.598922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.336 [2024-11-29 16:58:37.598952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.336 [2024-11-29 16:58:37.609863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.336 [2024-11-29 16:58:37.609892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.621046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.621077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.633699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.633728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.643791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.643821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.654271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.654301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.665438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.665468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.676423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.676453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.687110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.687139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.699758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.699790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.709899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.709928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.721254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.721284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.732353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.732393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.743853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.743882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.756583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.756612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.337 [2024-11-29 16:58:37.767130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.337 [2024-11-29 16:58:37.767159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.777728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.777758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.789077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.789106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.799990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.800020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.812808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.812837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.823439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.823468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.834387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.834416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.846994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.847024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.857141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.857171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.867703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.867732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.880175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.880205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.890407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.890437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.900998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.901028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.913358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.913388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.923149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.923177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.933880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.933909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.944508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.944547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.957513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.957542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.967805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.967834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.978594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.978630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:37.991241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:37.991281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:38.001166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:38.001195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:38.011775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.595 [2024-11-29 16:58:38.011804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.595 [2024-11-29 16:58:38.022290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.596 [2024-11-29 16:58:38.022319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.033352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.033381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.046057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.046087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.056587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.056616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.067158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.067187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.077601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.077630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.088403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.088432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.101754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.101783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.112172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.112201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.122828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.122857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.133354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.133383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.143677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.143706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.154197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.154236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.164786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.164815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.175346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.175376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.186052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.186081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.198775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.198805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.209023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.209052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.219750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.219779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.232625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.232655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.243019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.243048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.253921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.253968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.265231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.265268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.856 [2024-11-29 16:58:38.276291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.856 [2024-11-29 16:58:38.276321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.287494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.287523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.298464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.298494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.308740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.308769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.319586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.319615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.332146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.332176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.342188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.342217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.352894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.352923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.364033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.364072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.374841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.374870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.387469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.387499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.396501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.396530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.408185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.408214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.421084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.421113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.431635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.431665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.442510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.442540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.455781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.455810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.466078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.466108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.476886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.476915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.487602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.487631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.498274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.498303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.509109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.509138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.520603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.520632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.531341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.531370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.115 [2024-11-29 16:58:38.541648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.115 [2024-11-29 16:58:38.541678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.552847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.552876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.565701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.565731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.580934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.580974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.590452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.590481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.602154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.602183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.612933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.612972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.624328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.624358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.635468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.635497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.646315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.646344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.657405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.657435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.670075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.670104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.681053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.681083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.691943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.691982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.704762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.704793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.714872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.714902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.725782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.725811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.737203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.737233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.748372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.748401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.761306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.761337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.771502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.771532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.777090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.777119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 00:16:27.374 Latency(us) 00:16:27.374 [2024-11-29T15:58:38.805Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:27.374 [2024-11-29T15:58:38.805Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:27.374 Nvme1n1 : 5.01 11714.22 91.52 0.00 0.00 10911.25 4757.43 20583.16 00:16:27.374 [2024-11-29T15:58:38.805Z] =================================================================================================================== 00:16:27.374 [2024-11-29T15:58:38.805Z] Total : 11714.22 91.52 0.00 0.00 10911.25 4757.43 20583.16 00:16:27.374 [2024-11-29 16:58:38.785145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.785174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.793149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.793176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.374 [2024-11-29 16:58:38.801180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.374 [2024-11-29 16:58:38.801220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.809250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.809296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.817257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.817305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.825282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.825329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.833317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.833365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.841321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.841364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.849351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.849399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.857369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.857413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.865394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.865438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.873427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.873476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.881446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.881492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.889468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.889514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.897481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.897528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.905504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.905549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.913529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.913574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.921553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.921598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.929531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.929557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.937552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.937575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.945574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.945597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.953598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.953622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.961617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.961640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.969684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.969728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.977707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.977751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.985718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.985759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:38.993702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:38.993731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:39.001723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:39.001746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:39.009743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:39.009768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:39.017767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:39.017794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:39.025808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:39.025840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:39.033871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:39.033916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:39.041891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:39.041935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:39.049858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:39.049882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 [2024-11-29 16:58:39.057876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.633 [2024-11-29 16:58:39.057911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.633 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (204292) - No such process 00:16:27.892 16:58:39 -- target/zcopy.sh@49 -- # wait 204292 00:16:27.892 16:58:39 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:27.892 16:58:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.892 16:58:39 -- common/autotest_common.sh@10 -- # set +x 00:16:27.892 16:58:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.892 16:58:39 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:27.892 16:58:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.892 16:58:39 -- common/autotest_common.sh@10 -- # set +x 00:16:27.892 delay0 00:16:27.892 16:58:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.892 16:58:39 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:27.892 16:58:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.892 16:58:39 -- common/autotest_common.sh@10 -- # set +x 00:16:27.892 16:58:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.892 16:58:39 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:27.892 EAL: No free 2048 kB hugepages reported on node 1 00:16:27.892 [2024-11-29 16:58:39.180785] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:34.451 Initializing NVMe Controllers 00:16:34.451 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:34.451 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:34.451 Initialization complete. Launching workers. 00:16:34.451 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 76 00:16:34.451 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 363, failed to submit 33 00:16:34.451 success 180, unsuccess 183, failed 0 00:16:34.451 16:58:45 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:34.451 16:58:45 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:34.451 16:58:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:34.451 16:58:45 -- nvmf/common.sh@116 -- # sync 00:16:34.451 16:58:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:34.451 16:58:45 -- nvmf/common.sh@119 -- # set +e 00:16:34.451 16:58:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:34.451 16:58:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:34.451 rmmod nvme_tcp 00:16:34.451 rmmod nvme_fabrics 00:16:34.451 rmmod nvme_keyring 00:16:34.451 16:58:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:34.451 16:58:45 -- nvmf/common.sh@123 -- # set -e 00:16:34.451 16:58:45 -- nvmf/common.sh@124 -- # return 0 00:16:34.451 16:58:45 -- nvmf/common.sh@477 -- # '[' -n 202895 ']' 00:16:34.451 16:58:45 -- nvmf/common.sh@478 -- # killprocess 202895 00:16:34.451 16:58:45 -- common/autotest_common.sh@936 -- # '[' -z 202895 ']' 00:16:34.451 16:58:45 -- common/autotest_common.sh@940 -- # kill -0 202895 00:16:34.451 16:58:45 -- common/autotest_common.sh@941 -- # uname 00:16:34.451 16:58:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:34.451 16:58:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 202895 00:16:34.451 16:58:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:34.451 16:58:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:34.451 16:58:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 202895' 00:16:34.451 killing process with pid 202895 00:16:34.451 16:58:45 -- common/autotest_common.sh@955 -- # kill 202895 00:16:34.451 16:58:45 -- common/autotest_common.sh@960 -- # wait 202895 00:16:34.451 16:58:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:34.451 16:58:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:34.451 16:58:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:34.451 16:58:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:34.451 16:58:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:34.451 16:58:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:34.451 16:58:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:34.451 16:58:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:36.439 16:58:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:36.439 00:16:36.439 real 0m28.995s 00:16:36.439 user 0m43.423s 00:16:36.439 sys 0m7.516s 00:16:36.439 16:58:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:36.439 16:58:47 -- common/autotest_common.sh@10 -- # set +x 00:16:36.439 ************************************ 00:16:36.439 END TEST nvmf_zcopy 00:16:36.439 ************************************ 00:16:36.439 16:58:47 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:36.439 16:58:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:36.439 16:58:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:36.439 16:58:47 -- common/autotest_common.sh@10 -- # set +x 00:16:36.439 ************************************ 00:16:36.439 START TEST nvmf_nmic 00:16:36.439 ************************************ 00:16:36.439 16:58:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:36.439 * Looking for test storage... 00:16:36.439 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:36.439 16:58:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:36.439 16:58:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:36.439 16:58:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:36.699 16:58:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:36.699 16:58:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:36.699 16:58:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:36.699 16:58:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:36.699 16:58:47 -- scripts/common.sh@335 -- # IFS=.-: 00:16:36.699 16:58:47 -- scripts/common.sh@335 -- # read -ra ver1 00:16:36.699 16:58:47 -- scripts/common.sh@336 -- # IFS=.-: 00:16:36.699 16:58:47 -- scripts/common.sh@336 -- # read -ra ver2 00:16:36.699 16:58:47 -- scripts/common.sh@337 -- # local 'op=<' 00:16:36.699 16:58:47 -- scripts/common.sh@339 -- # ver1_l=2 00:16:36.699 16:58:47 -- scripts/common.sh@340 -- # ver2_l=1 00:16:36.699 16:58:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:36.699 16:58:47 -- scripts/common.sh@343 -- # case "$op" in 00:16:36.699 16:58:47 -- scripts/common.sh@344 -- # : 1 00:16:36.699 16:58:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:36.699 16:58:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:36.699 16:58:47 -- scripts/common.sh@364 -- # decimal 1 00:16:36.699 16:58:47 -- scripts/common.sh@352 -- # local d=1 00:16:36.699 16:58:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:36.699 16:58:47 -- scripts/common.sh@354 -- # echo 1 00:16:36.699 16:58:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:36.699 16:58:47 -- scripts/common.sh@365 -- # decimal 2 00:16:36.699 16:58:47 -- scripts/common.sh@352 -- # local d=2 00:16:36.699 16:58:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:36.699 16:58:47 -- scripts/common.sh@354 -- # echo 2 00:16:36.699 16:58:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:36.699 16:58:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:36.699 16:58:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:36.699 16:58:47 -- scripts/common.sh@367 -- # return 0 00:16:36.699 16:58:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:36.699 16:58:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:36.699 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.699 --rc genhtml_branch_coverage=1 00:16:36.699 --rc genhtml_function_coverage=1 00:16:36.699 --rc genhtml_legend=1 00:16:36.699 --rc geninfo_all_blocks=1 00:16:36.699 --rc geninfo_unexecuted_blocks=1 00:16:36.699 00:16:36.699 ' 00:16:36.699 16:58:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:36.699 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.699 --rc genhtml_branch_coverage=1 00:16:36.699 --rc genhtml_function_coverage=1 00:16:36.699 --rc genhtml_legend=1 00:16:36.699 --rc geninfo_all_blocks=1 00:16:36.699 --rc geninfo_unexecuted_blocks=1 00:16:36.699 00:16:36.699 ' 00:16:36.699 16:58:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:36.699 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.699 --rc genhtml_branch_coverage=1 00:16:36.699 --rc genhtml_function_coverage=1 00:16:36.699 --rc genhtml_legend=1 00:16:36.699 --rc geninfo_all_blocks=1 00:16:36.699 --rc geninfo_unexecuted_blocks=1 00:16:36.699 00:16:36.699 ' 00:16:36.699 16:58:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:36.699 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.699 --rc genhtml_branch_coverage=1 00:16:36.699 --rc genhtml_function_coverage=1 00:16:36.699 --rc genhtml_legend=1 00:16:36.699 --rc geninfo_all_blocks=1 00:16:36.699 --rc geninfo_unexecuted_blocks=1 00:16:36.699 00:16:36.699 ' 00:16:36.699 16:58:47 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:36.699 16:58:47 -- nvmf/common.sh@7 -- # uname -s 00:16:36.699 16:58:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:36.699 16:58:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:36.699 16:58:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:36.699 16:58:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:36.699 16:58:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:36.699 16:58:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:36.699 16:58:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:36.699 16:58:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:36.699 16:58:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:36.699 16:58:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:36.699 16:58:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:36.699 16:58:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:36.699 16:58:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:36.699 16:58:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:36.699 16:58:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:36.699 16:58:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:36.699 16:58:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:36.699 16:58:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:36.699 16:58:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:36.699 16:58:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.699 16:58:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.699 16:58:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.699 16:58:47 -- paths/export.sh@5 -- # export PATH 00:16:36.699 16:58:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.699 16:58:47 -- nvmf/common.sh@46 -- # : 0 00:16:36.699 16:58:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:36.699 16:58:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:36.699 16:58:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:36.699 16:58:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:36.699 16:58:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:36.699 16:58:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:36.699 16:58:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:36.699 16:58:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:36.699 16:58:47 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:36.699 16:58:47 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:36.699 16:58:47 -- target/nmic.sh@14 -- # nvmftestinit 00:16:36.699 16:58:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:36.699 16:58:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:36.699 16:58:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:36.699 16:58:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:36.699 16:58:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:36.700 16:58:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:36.700 16:58:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:36.700 16:58:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:36.700 16:58:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:36.700 16:58:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:36.700 16:58:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:36.700 16:58:47 -- common/autotest_common.sh@10 -- # set +x 00:16:38.606 16:58:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:38.606 16:58:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:38.606 16:58:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:38.606 16:58:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:38.606 16:58:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:38.606 16:58:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:38.606 16:58:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:38.606 16:58:49 -- nvmf/common.sh@294 -- # net_devs=() 00:16:38.606 16:58:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:38.606 16:58:49 -- nvmf/common.sh@295 -- # e810=() 00:16:38.606 16:58:49 -- nvmf/common.sh@295 -- # local -ga e810 00:16:38.606 16:58:49 -- nvmf/common.sh@296 -- # x722=() 00:16:38.606 16:58:49 -- nvmf/common.sh@296 -- # local -ga x722 00:16:38.606 16:58:49 -- nvmf/common.sh@297 -- # mlx=() 00:16:38.606 16:58:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:38.606 16:58:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:38.606 16:58:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:38.606 16:58:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:38.606 16:58:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:38.606 16:58:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:38.607 16:58:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:38.607 16:58:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:38.607 16:58:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:38.607 16:58:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:38.607 16:58:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:38.607 16:58:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:38.607 16:58:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:38.607 16:58:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:38.607 16:58:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:38.607 16:58:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:38.607 16:58:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:38.607 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:38.607 16:58:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:38.607 16:58:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:38.607 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:38.607 16:58:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:38.607 16:58:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:38.607 16:58:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:38.607 16:58:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:38.607 16:58:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:38.607 16:58:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:38.607 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:38.607 16:58:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:38.607 16:58:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:38.607 16:58:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:38.607 16:58:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:38.607 16:58:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:38.607 16:58:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:38.607 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:38.607 16:58:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:38.607 16:58:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:38.607 16:58:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:38.607 16:58:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:38.607 16:58:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:38.607 16:58:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:38.607 16:58:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:38.607 16:58:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:38.607 16:58:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:38.607 16:58:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:38.607 16:58:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:38.607 16:58:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:38.607 16:58:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:38.607 16:58:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:38.607 16:58:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:38.607 16:58:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:38.607 16:58:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:38.607 16:58:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:38.607 16:58:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:38.607 16:58:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:38.607 16:58:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:38.607 16:58:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:38.607 16:58:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:38.607 16:58:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:38.607 16:58:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:38.607 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:38.607 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:16:38.607 00:16:38.607 --- 10.0.0.2 ping statistics --- 00:16:38.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:38.607 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:16:38.607 16:58:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:38.607 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:38.607 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:16:38.607 00:16:38.607 --- 10.0.0.1 ping statistics --- 00:16:38.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:38.607 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:16:38.607 16:58:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:38.607 16:58:50 -- nvmf/common.sh@410 -- # return 0 00:16:38.607 16:58:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:38.607 16:58:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:38.607 16:58:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:38.607 16:58:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:38.607 16:58:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:38.607 16:58:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:38.607 16:58:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:38.866 16:58:50 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:38.866 16:58:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:38.866 16:58:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:38.866 16:58:50 -- common/autotest_common.sh@10 -- # set +x 00:16:38.866 16:58:50 -- nvmf/common.sh@469 -- # nvmfpid=207733 00:16:38.866 16:58:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:38.866 16:58:50 -- nvmf/common.sh@470 -- # waitforlisten 207733 00:16:38.866 16:58:50 -- common/autotest_common.sh@829 -- # '[' -z 207733 ']' 00:16:38.866 16:58:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:38.866 16:58:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:38.866 16:58:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:38.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:38.866 16:58:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:38.866 16:58:50 -- common/autotest_common.sh@10 -- # set +x 00:16:38.866 [2024-11-29 16:58:50.094571] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:38.866 [2024-11-29 16:58:50.094650] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:38.866 EAL: No free 2048 kB hugepages reported on node 1 00:16:38.866 [2024-11-29 16:58:50.160814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:38.866 [2024-11-29 16:58:50.269337] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:38.866 [2024-11-29 16:58:50.269487] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:38.866 [2024-11-29 16:58:50.269505] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:38.866 [2024-11-29 16:58:50.269518] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:38.866 [2024-11-29 16:58:50.269651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:38.866 [2024-11-29 16:58:50.269708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:38.866 [2024-11-29 16:58:50.269773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:38.866 [2024-11-29 16:58:50.269776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:39.802 16:58:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:39.802 16:58:51 -- common/autotest_common.sh@862 -- # return 0 00:16:39.802 16:58:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:39.802 16:58:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:39.802 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:39.802 16:58:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:39.802 16:58:51 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:39.802 16:58:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.802 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:39.802 [2024-11-29 16:58:51.151787] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:39.802 16:58:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.802 16:58:51 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:39.802 16:58:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.802 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:39.802 Malloc0 00:16:39.802 16:58:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.802 16:58:51 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:39.802 16:58:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.802 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:39.802 16:58:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.802 16:58:51 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:39.802 16:58:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.802 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:39.802 16:58:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.802 16:58:51 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:39.802 16:58:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.802 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:39.802 [2024-11-29 16:58:51.205911] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:39.802 16:58:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.802 16:58:51 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:39.802 test case1: single bdev can't be used in multiple subsystems 00:16:39.802 16:58:51 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:39.802 16:58:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.802 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:39.802 16:58:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.802 16:58:51 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:39.802 16:58:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.802 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:39.802 16:58:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.802 16:58:51 -- target/nmic.sh@28 -- # nmic_status=0 00:16:39.802 16:58:51 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:39.802 16:58:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.802 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:39.802 [2024-11-29 16:58:51.229748] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:39.802 [2024-11-29 16:58:51.229778] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:39.802 [2024-11-29 16:58:51.229793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:40.060 request: 00:16:40.060 { 00:16:40.060 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:40.060 "namespace": { 00:16:40.060 "bdev_name": "Malloc0" 00:16:40.060 }, 00:16:40.060 "method": "nvmf_subsystem_add_ns", 00:16:40.060 "req_id": 1 00:16:40.060 } 00:16:40.060 Got JSON-RPC error response 00:16:40.060 response: 00:16:40.060 { 00:16:40.060 "code": -32602, 00:16:40.060 "message": "Invalid parameters" 00:16:40.060 } 00:16:40.060 16:58:51 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:40.060 16:58:51 -- target/nmic.sh@29 -- # nmic_status=1 00:16:40.060 16:58:51 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:40.060 16:58:51 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:40.060 Adding namespace failed - expected result. 00:16:40.060 16:58:51 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:40.060 test case2: host connect to nvmf target in multiple paths 00:16:40.060 16:58:51 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:40.060 16:58:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:40.060 16:58:51 -- common/autotest_common.sh@10 -- # set +x 00:16:40.060 [2024-11-29 16:58:51.237878] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:40.060 16:58:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:40.060 16:58:51 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:40.627 16:58:51 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:41.193 16:58:52 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:41.193 16:58:52 -- common/autotest_common.sh@1187 -- # local i=0 00:16:41.193 16:58:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:41.193 16:58:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:41.193 16:58:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:43.093 16:58:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:43.093 16:58:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:43.093 16:58:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:43.093 16:58:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:43.093 16:58:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:43.093 16:58:54 -- common/autotest_common.sh@1197 -- # return 0 00:16:43.093 16:58:54 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:43.093 [global] 00:16:43.093 thread=1 00:16:43.093 invalidate=1 00:16:43.093 rw=write 00:16:43.093 time_based=1 00:16:43.093 runtime=1 00:16:43.093 ioengine=libaio 00:16:43.093 direct=1 00:16:43.093 bs=4096 00:16:43.093 iodepth=1 00:16:43.093 norandommap=0 00:16:43.093 numjobs=1 00:16:43.093 00:16:43.093 verify_dump=1 00:16:43.093 verify_backlog=512 00:16:43.093 verify_state_save=0 00:16:43.093 do_verify=1 00:16:43.093 verify=crc32c-intel 00:16:43.093 [job0] 00:16:43.093 filename=/dev/nvme0n1 00:16:43.093 Could not set queue depth (nvme0n1) 00:16:43.658 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.658 fio-3.35 00:16:43.658 Starting 1 thread 00:16:45.031 00:16:45.031 job0: (groupid=0, jobs=1): err= 0: pid=208403: Fri Nov 29 16:58:56 2024 00:16:45.031 read: IOPS=22, BW=90.1KiB/s (92.3kB/s)(92.0KiB/1021msec) 00:16:45.031 slat (nsec): min=6731, max=33719, avg=28426.57, stdev=8605.69 00:16:45.031 clat (usec): min=40882, max=41133, avg=40967.61, stdev=50.05 00:16:45.031 lat (usec): min=40915, max=41139, avg=40996.03, stdev=44.69 00:16:45.031 clat percentiles (usec): 00:16:45.031 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:45.031 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:45.031 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:45.031 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:45.031 | 99.99th=[41157] 00:16:45.031 write: IOPS=501, BW=2006KiB/s (2054kB/s)(2048KiB/1021msec); 0 zone resets 00:16:45.031 slat (nsec): min=5590, max=43019, avg=8158.15, stdev=3019.33 00:16:45.031 clat (usec): min=120, max=234, avg=140.79, stdev=11.36 00:16:45.031 lat (usec): min=126, max=277, avg=148.95, stdev=12.17 00:16:45.031 clat percentiles (usec): 00:16:45.031 | 1.00th=[ 124], 5.00th=[ 127], 10.00th=[ 129], 20.00th=[ 133], 00:16:45.031 | 30.00th=[ 135], 40.00th=[ 137], 50.00th=[ 139], 60.00th=[ 143], 00:16:45.031 | 70.00th=[ 145], 80.00th=[ 149], 90.00th=[ 155], 95.00th=[ 159], 00:16:45.031 | 99.00th=[ 178], 99.50th=[ 192], 99.90th=[ 235], 99.95th=[ 235], 00:16:45.031 | 99.99th=[ 235] 00:16:45.031 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:45.031 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:45.031 lat (usec) : 250=95.70% 00:16:45.031 lat (msec) : 50=4.30% 00:16:45.031 cpu : usr=0.10%, sys=0.59%, ctx=535, majf=0, minf=1 00:16:45.031 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.031 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.031 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.031 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.031 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.031 00:16:45.031 Run status group 0 (all jobs): 00:16:45.031 READ: bw=90.1KiB/s (92.3kB/s), 90.1KiB/s-90.1KiB/s (92.3kB/s-92.3kB/s), io=92.0KiB (94.2kB), run=1021-1021msec 00:16:45.031 WRITE: bw=2006KiB/s (2054kB/s), 2006KiB/s-2006KiB/s (2054kB/s-2054kB/s), io=2048KiB (2097kB), run=1021-1021msec 00:16:45.031 00:16:45.031 Disk stats (read/write): 00:16:45.031 nvme0n1: ios=70/512, merge=0/0, ticks=844/70, in_queue=914, util=91.38% 00:16:45.031 16:58:56 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:45.031 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:45.031 16:58:56 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:45.031 16:58:56 -- common/autotest_common.sh@1208 -- # local i=0 00:16:45.031 16:58:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:45.031 16:58:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:45.031 16:58:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:45.031 16:58:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:45.031 16:58:56 -- common/autotest_common.sh@1220 -- # return 0 00:16:45.031 16:58:56 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:45.031 16:58:56 -- target/nmic.sh@53 -- # nvmftestfini 00:16:45.031 16:58:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:45.031 16:58:56 -- nvmf/common.sh@116 -- # sync 00:16:45.031 16:58:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:45.031 16:58:56 -- nvmf/common.sh@119 -- # set +e 00:16:45.031 16:58:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:45.031 16:58:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:45.031 rmmod nvme_tcp 00:16:45.031 rmmod nvme_fabrics 00:16:45.031 rmmod nvme_keyring 00:16:45.031 16:58:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:45.031 16:58:56 -- nvmf/common.sh@123 -- # set -e 00:16:45.031 16:58:56 -- nvmf/common.sh@124 -- # return 0 00:16:45.031 16:58:56 -- nvmf/common.sh@477 -- # '[' -n 207733 ']' 00:16:45.031 16:58:56 -- nvmf/common.sh@478 -- # killprocess 207733 00:16:45.031 16:58:56 -- common/autotest_common.sh@936 -- # '[' -z 207733 ']' 00:16:45.031 16:58:56 -- common/autotest_common.sh@940 -- # kill -0 207733 00:16:45.031 16:58:56 -- common/autotest_common.sh@941 -- # uname 00:16:45.031 16:58:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:45.031 16:58:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 207733 00:16:45.031 16:58:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:45.031 16:58:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:45.031 16:58:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 207733' 00:16:45.031 killing process with pid 207733 00:16:45.031 16:58:56 -- common/autotest_common.sh@955 -- # kill 207733 00:16:45.031 16:58:56 -- common/autotest_common.sh@960 -- # wait 207733 00:16:45.291 16:58:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:45.291 16:58:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:45.291 16:58:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:45.291 16:58:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:45.291 16:58:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:45.291 16:58:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:45.291 16:58:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:45.291 16:58:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:47.201 16:58:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:47.201 00:16:47.201 real 0m10.878s 00:16:47.201 user 0m26.247s 00:16:47.201 sys 0m2.582s 00:16:47.201 16:58:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:47.201 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:16:47.201 ************************************ 00:16:47.201 END TEST nvmf_nmic 00:16:47.201 ************************************ 00:16:47.461 16:58:58 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:47.461 16:58:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:47.461 16:58:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:47.461 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:16:47.461 ************************************ 00:16:47.461 START TEST nvmf_fio_target 00:16:47.461 ************************************ 00:16:47.461 16:58:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:47.461 * Looking for test storage... 00:16:47.461 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:47.461 16:58:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:47.461 16:58:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:47.461 16:58:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:47.461 16:58:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:47.461 16:58:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:47.461 16:58:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:47.461 16:58:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:47.461 16:58:58 -- scripts/common.sh@335 -- # IFS=.-: 00:16:47.461 16:58:58 -- scripts/common.sh@335 -- # read -ra ver1 00:16:47.461 16:58:58 -- scripts/common.sh@336 -- # IFS=.-: 00:16:47.461 16:58:58 -- scripts/common.sh@336 -- # read -ra ver2 00:16:47.461 16:58:58 -- scripts/common.sh@337 -- # local 'op=<' 00:16:47.461 16:58:58 -- scripts/common.sh@339 -- # ver1_l=2 00:16:47.461 16:58:58 -- scripts/common.sh@340 -- # ver2_l=1 00:16:47.461 16:58:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:47.461 16:58:58 -- scripts/common.sh@343 -- # case "$op" in 00:16:47.461 16:58:58 -- scripts/common.sh@344 -- # : 1 00:16:47.461 16:58:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:47.461 16:58:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:47.461 16:58:58 -- scripts/common.sh@364 -- # decimal 1 00:16:47.461 16:58:58 -- scripts/common.sh@352 -- # local d=1 00:16:47.461 16:58:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:47.461 16:58:58 -- scripts/common.sh@354 -- # echo 1 00:16:47.461 16:58:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:47.461 16:58:58 -- scripts/common.sh@365 -- # decimal 2 00:16:47.461 16:58:58 -- scripts/common.sh@352 -- # local d=2 00:16:47.461 16:58:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:47.461 16:58:58 -- scripts/common.sh@354 -- # echo 2 00:16:47.461 16:58:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:47.461 16:58:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:47.461 16:58:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:47.461 16:58:58 -- scripts/common.sh@367 -- # return 0 00:16:47.461 16:58:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:47.461 16:58:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:47.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:47.461 --rc genhtml_branch_coverage=1 00:16:47.461 --rc genhtml_function_coverage=1 00:16:47.461 --rc genhtml_legend=1 00:16:47.461 --rc geninfo_all_blocks=1 00:16:47.461 --rc geninfo_unexecuted_blocks=1 00:16:47.461 00:16:47.461 ' 00:16:47.461 16:58:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:47.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:47.461 --rc genhtml_branch_coverage=1 00:16:47.461 --rc genhtml_function_coverage=1 00:16:47.461 --rc genhtml_legend=1 00:16:47.461 --rc geninfo_all_blocks=1 00:16:47.461 --rc geninfo_unexecuted_blocks=1 00:16:47.461 00:16:47.461 ' 00:16:47.461 16:58:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:47.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:47.461 --rc genhtml_branch_coverage=1 00:16:47.461 --rc genhtml_function_coverage=1 00:16:47.461 --rc genhtml_legend=1 00:16:47.461 --rc geninfo_all_blocks=1 00:16:47.461 --rc geninfo_unexecuted_blocks=1 00:16:47.461 00:16:47.461 ' 00:16:47.461 16:58:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:47.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:47.461 --rc genhtml_branch_coverage=1 00:16:47.461 --rc genhtml_function_coverage=1 00:16:47.461 --rc genhtml_legend=1 00:16:47.461 --rc geninfo_all_blocks=1 00:16:47.461 --rc geninfo_unexecuted_blocks=1 00:16:47.461 00:16:47.461 ' 00:16:47.461 16:58:58 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:47.461 16:58:58 -- nvmf/common.sh@7 -- # uname -s 00:16:47.461 16:58:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:47.461 16:58:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:47.461 16:58:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:47.461 16:58:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:47.461 16:58:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:47.461 16:58:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:47.461 16:58:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:47.461 16:58:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:47.461 16:58:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:47.461 16:58:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:47.461 16:58:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:47.461 16:58:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:47.461 16:58:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:47.461 16:58:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:47.461 16:58:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:47.461 16:58:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:47.461 16:58:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:47.461 16:58:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:47.461 16:58:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:47.461 16:58:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:47.461 16:58:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:47.461 16:58:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:47.461 16:58:58 -- paths/export.sh@5 -- # export PATH 00:16:47.461 16:58:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:47.461 16:58:58 -- nvmf/common.sh@46 -- # : 0 00:16:47.461 16:58:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:47.461 16:58:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:47.461 16:58:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:47.462 16:58:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:47.462 16:58:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:47.462 16:58:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:47.462 16:58:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:47.462 16:58:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:47.462 16:58:58 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:47.462 16:58:58 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:47.462 16:58:58 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:47.462 16:58:58 -- target/fio.sh@16 -- # nvmftestinit 00:16:47.462 16:58:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:47.462 16:58:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:47.462 16:58:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:47.462 16:58:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:47.462 16:58:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:47.462 16:58:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:47.462 16:58:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:47.462 16:58:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:47.462 16:58:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:47.462 16:58:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:47.462 16:58:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:47.462 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:16:50.000 16:59:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:50.000 16:59:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:50.000 16:59:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:50.000 16:59:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:50.000 16:59:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:50.000 16:59:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:50.000 16:59:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:50.000 16:59:00 -- nvmf/common.sh@294 -- # net_devs=() 00:16:50.000 16:59:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:50.000 16:59:00 -- nvmf/common.sh@295 -- # e810=() 00:16:50.000 16:59:00 -- nvmf/common.sh@295 -- # local -ga e810 00:16:50.000 16:59:00 -- nvmf/common.sh@296 -- # x722=() 00:16:50.000 16:59:00 -- nvmf/common.sh@296 -- # local -ga x722 00:16:50.000 16:59:00 -- nvmf/common.sh@297 -- # mlx=() 00:16:50.000 16:59:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:50.000 16:59:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:50.000 16:59:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:50.000 16:59:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:50.000 16:59:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:50.000 16:59:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:50.000 16:59:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:50.000 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:50.000 16:59:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:50.000 16:59:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:50.000 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:50.000 16:59:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:50.000 16:59:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:50.000 16:59:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:50.000 16:59:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:50.000 16:59:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:50.000 16:59:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:50.000 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:50.000 16:59:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:50.000 16:59:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:50.000 16:59:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:50.000 16:59:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:50.000 16:59:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:50.000 16:59:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:50.000 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:50.000 16:59:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:50.000 16:59:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:50.000 16:59:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:50.000 16:59:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:50.000 16:59:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:50.000 16:59:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:50.000 16:59:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:50.000 16:59:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:50.000 16:59:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:50.000 16:59:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:50.000 16:59:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:50.000 16:59:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:50.000 16:59:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:50.000 16:59:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:50.000 16:59:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:50.000 16:59:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:50.000 16:59:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:50.000 16:59:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:50.000 16:59:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:50.000 16:59:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:50.000 16:59:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:50.000 16:59:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:50.000 16:59:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:50.000 16:59:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:50.000 16:59:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:50.000 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:50.000 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:16:50.000 00:16:50.000 --- 10.0.0.2 ping statistics --- 00:16:50.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:50.000 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:16:50.000 16:59:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:50.000 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:50.000 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:16:50.000 00:16:50.000 --- 10.0.0.1 ping statistics --- 00:16:50.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:50.000 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:16:50.000 16:59:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:50.000 16:59:01 -- nvmf/common.sh@410 -- # return 0 00:16:50.000 16:59:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:50.000 16:59:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:50.000 16:59:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:50.000 16:59:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:50.000 16:59:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:50.000 16:59:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:50.000 16:59:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:50.000 16:59:01 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:50.000 16:59:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:50.000 16:59:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:50.000 16:59:01 -- common/autotest_common.sh@10 -- # set +x 00:16:50.000 16:59:01 -- nvmf/common.sh@469 -- # nvmfpid=210620 00:16:50.000 16:59:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:50.000 16:59:01 -- nvmf/common.sh@470 -- # waitforlisten 210620 00:16:50.000 16:59:01 -- common/autotest_common.sh@829 -- # '[' -z 210620 ']' 00:16:50.000 16:59:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:50.000 16:59:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:50.000 16:59:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:50.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:50.000 16:59:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:50.000 16:59:01 -- common/autotest_common.sh@10 -- # set +x 00:16:50.000 [2024-11-29 16:59:01.095413] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:50.001 [2024-11-29 16:59:01.095480] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:50.001 EAL: No free 2048 kB hugepages reported on node 1 00:16:50.001 [2024-11-29 16:59:01.159403] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:50.001 [2024-11-29 16:59:01.275565] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:50.001 [2024-11-29 16:59:01.275730] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:50.001 [2024-11-29 16:59:01.275752] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:50.001 [2024-11-29 16:59:01.275768] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:50.001 [2024-11-29 16:59:01.275869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:50.001 [2024-11-29 16:59:01.275915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:50.001 [2024-11-29 16:59:01.275979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:50.001 [2024-11-29 16:59:01.275983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:50.941 16:59:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:50.941 16:59:02 -- common/autotest_common.sh@862 -- # return 0 00:16:50.941 16:59:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:50.941 16:59:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:50.941 16:59:02 -- common/autotest_common.sh@10 -- # set +x 00:16:50.941 16:59:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:50.941 16:59:02 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:50.941 [2024-11-29 16:59:02.343449] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:50.941 16:59:02 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:51.200 16:59:02 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:51.458 16:59:02 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:51.717 16:59:02 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:51.717 16:59:02 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:51.976 16:59:03 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:51.976 16:59:03 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:52.235 16:59:03 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:52.235 16:59:03 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:52.493 16:59:03 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:52.752 16:59:03 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:52.752 16:59:03 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:53.011 16:59:04 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:53.011 16:59:04 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:53.270 16:59:04 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:53.270 16:59:04 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:53.529 16:59:04 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:53.787 16:59:04 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:53.787 16:59:04 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:54.045 16:59:05 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:54.045 16:59:05 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:54.302 16:59:05 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:54.302 [2024-11-29 16:59:05.711113] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:54.302 16:59:05 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:54.560 16:59:05 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:54.817 16:59:06 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:55.384 16:59:06 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:55.384 16:59:06 -- common/autotest_common.sh@1187 -- # local i=0 00:16:55.384 16:59:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:55.384 16:59:06 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:55.384 16:59:06 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:55.384 16:59:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:57.915 16:59:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:57.915 16:59:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:57.915 16:59:08 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:57.915 16:59:08 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:57.915 16:59:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:57.915 16:59:08 -- common/autotest_common.sh@1197 -- # return 0 00:16:57.915 16:59:08 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:57.915 [global] 00:16:57.915 thread=1 00:16:57.915 invalidate=1 00:16:57.915 rw=write 00:16:57.915 time_based=1 00:16:57.915 runtime=1 00:16:57.915 ioengine=libaio 00:16:57.915 direct=1 00:16:57.915 bs=4096 00:16:57.915 iodepth=1 00:16:57.915 norandommap=0 00:16:57.915 numjobs=1 00:16:57.915 00:16:57.915 verify_dump=1 00:16:57.915 verify_backlog=512 00:16:57.915 verify_state_save=0 00:16:57.915 do_verify=1 00:16:57.915 verify=crc32c-intel 00:16:57.915 [job0] 00:16:57.915 filename=/dev/nvme0n1 00:16:57.915 [job1] 00:16:57.915 filename=/dev/nvme0n2 00:16:57.915 [job2] 00:16:57.915 filename=/dev/nvme0n3 00:16:57.915 [job3] 00:16:57.915 filename=/dev/nvme0n4 00:16:57.915 Could not set queue depth (nvme0n1) 00:16:57.915 Could not set queue depth (nvme0n2) 00:16:57.915 Could not set queue depth (nvme0n3) 00:16:57.915 Could not set queue depth (nvme0n4) 00:16:57.915 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.915 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.915 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.915 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.915 fio-3.35 00:16:57.915 Starting 4 threads 00:16:59.294 00:16:59.294 job0: (groupid=0, jobs=1): err= 0: pid=211720: Fri Nov 29 16:59:10 2024 00:16:59.294 read: IOPS=513, BW=2054KiB/s (2103kB/s)(2064KiB/1005msec) 00:16:59.294 slat (nsec): min=4924, max=40739, avg=11524.17, stdev=6571.27 00:16:59.294 clat (usec): min=198, max=42101, avg=1522.57, stdev=7154.96 00:16:59.294 lat (usec): min=205, max=42116, avg=1534.10, stdev=7155.85 00:16:59.294 clat percentiles (usec): 00:16:59.294 | 1.00th=[ 202], 5.00th=[ 215], 10.00th=[ 219], 20.00th=[ 225], 00:16:59.294 | 30.00th=[ 233], 40.00th=[ 237], 50.00th=[ 243], 60.00th=[ 247], 00:16:59.294 | 70.00th=[ 251], 80.00th=[ 258], 90.00th=[ 277], 95.00th=[ 338], 00:16:59.294 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:59.294 | 99.99th=[42206] 00:16:59.294 write: IOPS=1018, BW=4076KiB/s (4173kB/s)(4096KiB/1005msec); 0 zone resets 00:16:59.294 slat (nsec): min=7711, max=61614, avg=18643.98, stdev=6530.49 00:16:59.294 clat (usec): min=134, max=362, avg=183.63, stdev=22.51 00:16:59.294 lat (usec): min=142, max=407, avg=202.28, stdev=23.61 00:16:59.294 clat percentiles (usec): 00:16:59.294 | 1.00th=[ 145], 5.00th=[ 151], 10.00th=[ 157], 20.00th=[ 165], 00:16:59.294 | 30.00th=[ 174], 40.00th=[ 178], 50.00th=[ 184], 60.00th=[ 188], 00:16:59.294 | 70.00th=[ 194], 80.00th=[ 200], 90.00th=[ 210], 95.00th=[ 219], 00:16:59.294 | 99.00th=[ 243], 99.50th=[ 262], 99.90th=[ 326], 99.95th=[ 363], 00:16:59.294 | 99.99th=[ 363] 00:16:59.294 bw ( KiB/s): min= 4096, max= 4096, per=21.94%, avg=4096.00, stdev= 0.00, samples=2 00:16:59.294 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:16:59.294 lat (usec) : 250=89.09%, 500=9.87% 00:16:59.294 lat (msec) : 50=1.04% 00:16:59.294 cpu : usr=1.99%, sys=2.09%, ctx=1541, majf=0, minf=1 00:16:59.294 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.294 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.294 issued rwts: total=516,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:59.294 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:59.294 job1: (groupid=0, jobs=1): err= 0: pid=211726: Fri Nov 29 16:59:10 2024 00:16:59.294 read: IOPS=1664, BW=6656KiB/s (6816kB/s)(6836KiB/1027msec) 00:16:59.294 slat (nsec): min=5219, max=53310, avg=9292.53, stdev=5781.51 00:16:59.294 clat (usec): min=159, max=42011, avg=379.10, stdev=2441.18 00:16:59.294 lat (usec): min=165, max=42028, avg=388.40, stdev=2442.21 00:16:59.294 clat percentiles (usec): 00:16:59.294 | 1.00th=[ 169], 5.00th=[ 178], 10.00th=[ 184], 20.00th=[ 196], 00:16:59.294 | 30.00th=[ 210], 40.00th=[ 231], 50.00th=[ 241], 60.00th=[ 247], 00:16:59.294 | 70.00th=[ 251], 80.00th=[ 258], 90.00th=[ 269], 95.00th=[ 281], 00:16:59.294 | 99.00th=[ 404], 99.50th=[ 725], 99.90th=[42206], 99.95th=[42206], 00:16:59.294 | 99.99th=[42206] 00:16:59.294 write: IOPS=1994, BW=7977KiB/s (8168kB/s)(8192KiB/1027msec); 0 zone resets 00:16:59.294 slat (nsec): min=6613, max=50000, avg=11179.41, stdev=6470.66 00:16:59.294 clat (usec): min=116, max=1184, avg=160.66, stdev=38.48 00:16:59.294 lat (usec): min=123, max=1192, avg=171.83, stdev=42.06 00:16:59.294 clat percentiles (usec): 00:16:59.294 | 1.00th=[ 121], 5.00th=[ 125], 10.00th=[ 128], 20.00th=[ 135], 00:16:59.294 | 30.00th=[ 141], 40.00th=[ 145], 50.00th=[ 151], 60.00th=[ 157], 00:16:59.294 | 70.00th=[ 167], 80.00th=[ 192], 90.00th=[ 208], 95.00th=[ 221], 00:16:59.294 | 99.00th=[ 245], 99.50th=[ 253], 99.90th=[ 289], 99.95th=[ 314], 00:16:59.294 | 99.99th=[ 1188] 00:16:59.294 bw ( KiB/s): min= 5696, max=10688, per=43.88%, avg=8192.00, stdev=3529.88, samples=2 00:16:59.294 iops : min= 1424, max= 2672, avg=2048.00, stdev=882.47, samples=2 00:16:59.294 lat (usec) : 250=84.96%, 500=14.61%, 750=0.19%, 1000=0.05% 00:16:59.294 lat (msec) : 2=0.03%, 50=0.16% 00:16:59.294 cpu : usr=2.34%, sys=5.65%, ctx=3757, majf=0, minf=2 00:16:59.294 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.294 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.294 issued rwts: total=1709,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:59.294 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:59.294 job2: (groupid=0, jobs=1): err= 0: pid=211728: Fri Nov 29 16:59:10 2024 00:16:59.294 read: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec) 00:16:59.294 slat (nsec): min=8198, max=52926, avg=16219.78, stdev=5278.61 00:16:59.294 clat (usec): min=190, max=41994, avg=1596.36, stdev=7220.87 00:16:59.294 lat (usec): min=223, max=42008, avg=1612.58, stdev=7220.72 00:16:59.294 clat percentiles (usec): 00:16:59.294 | 1.00th=[ 219], 5.00th=[ 225], 10.00th=[ 229], 20.00th=[ 233], 00:16:59.294 | 30.00th=[ 239], 40.00th=[ 243], 50.00th=[ 249], 60.00th=[ 258], 00:16:59.294 | 70.00th=[ 289], 80.00th=[ 310], 90.00th=[ 330], 95.00th=[ 494], 00:16:59.294 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:59.294 | 99.99th=[42206] 00:16:59.294 write: IOPS=762, BW=3049KiB/s (3122kB/s)(3052KiB/1001msec); 0 zone resets 00:16:59.294 slat (nsec): min=9096, max=56525, avg=21128.72, stdev=7127.63 00:16:59.294 clat (usec): min=160, max=401, avg=198.84, stdev=23.88 00:16:59.294 lat (usec): min=177, max=424, avg=219.97, stdev=25.03 00:16:59.294 clat percentiles (usec): 00:16:59.294 | 1.00th=[ 165], 5.00th=[ 169], 10.00th=[ 174], 20.00th=[ 180], 00:16:59.294 | 30.00th=[ 186], 40.00th=[ 194], 50.00th=[ 198], 60.00th=[ 202], 00:16:59.294 | 70.00th=[ 208], 80.00th=[ 212], 90.00th=[ 223], 95.00th=[ 233], 00:16:59.294 | 99.00th=[ 302], 99.50th=[ 338], 99.90th=[ 404], 99.95th=[ 404], 00:16:59.294 | 99.99th=[ 404] 00:16:59.294 bw ( KiB/s): min= 4096, max= 4096, per=21.94%, avg=4096.00, stdev= 0.00, samples=1 00:16:59.294 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:59.294 lat (usec) : 250=80.16%, 500=17.96%, 750=0.55% 00:16:59.294 lat (msec) : 50=1.33% 00:16:59.294 cpu : usr=1.70%, sys=3.10%, ctx=1276, majf=0, minf=1 00:16:59.294 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.294 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.294 issued rwts: total=512,763,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:59.294 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:59.294 job3: (groupid=0, jobs=1): err= 0: pid=211729: Fri Nov 29 16:59:10 2024 00:16:59.294 read: IOPS=895, BW=3581KiB/s (3667kB/s)(3728KiB/1041msec) 00:16:59.294 slat (nsec): min=4598, max=64123, avg=12439.08, stdev=9655.12 00:16:59.294 clat (usec): min=183, max=42285, avg=892.53, stdev=5042.83 00:16:59.294 lat (usec): min=193, max=42302, avg=904.97, stdev=5043.38 00:16:59.294 clat percentiles (usec): 00:16:59.294 | 1.00th=[ 192], 5.00th=[ 200], 10.00th=[ 206], 20.00th=[ 212], 00:16:59.294 | 30.00th=[ 219], 40.00th=[ 227], 50.00th=[ 235], 60.00th=[ 247], 00:16:59.294 | 70.00th=[ 265], 80.00th=[ 289], 90.00th=[ 465], 95.00th=[ 490], 00:16:59.294 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:59.294 | 99.99th=[42206] 00:16:59.294 write: IOPS=983, BW=3935KiB/s (4029kB/s)(4096KiB/1041msec); 0 zone resets 00:16:59.294 slat (nsec): min=5823, max=45868, avg=11507.77, stdev=6403.71 00:16:59.294 clat (usec): min=127, max=338, avg=174.37, stdev=28.44 00:16:59.294 lat (usec): min=134, max=367, avg=185.88, stdev=32.53 00:16:59.294 clat percentiles (usec): 00:16:59.294 | 1.00th=[ 131], 5.00th=[ 139], 10.00th=[ 141], 20.00th=[ 147], 00:16:59.294 | 30.00th=[ 151], 40.00th=[ 157], 50.00th=[ 174], 60.00th=[ 186], 00:16:59.294 | 70.00th=[ 194], 80.00th=[ 202], 90.00th=[ 212], 95.00th=[ 219], 00:16:59.294 | 99.00th=[ 237], 99.50th=[ 247], 99.90th=[ 260], 99.95th=[ 338], 00:16:59.294 | 99.99th=[ 338] 00:16:59.294 bw ( KiB/s): min= 8192, max= 8192, per=43.88%, avg=8192.00, stdev= 0.00, samples=1 00:16:59.294 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:59.294 lat (usec) : 250=81.65%, 500=16.72%, 750=0.87%, 1000=0.05% 00:16:59.294 lat (msec) : 50=0.72% 00:16:59.294 cpu : usr=1.15%, sys=2.60%, ctx=1958, majf=0, minf=1 00:16:59.294 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.294 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.294 issued rwts: total=932,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:59.294 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:59.294 00:16:59.294 Run status group 0 (all jobs): 00:16:59.294 READ: bw=13.8MiB/s (14.4MB/s), 2046KiB/s-6656KiB/s (2095kB/s-6816kB/s), io=14.3MiB (15.0MB), run=1001-1041msec 00:16:59.294 WRITE: bw=18.2MiB/s (19.1MB/s), 3049KiB/s-7977KiB/s (3122kB/s-8168kB/s), io=19.0MiB (19.9MB), run=1001-1041msec 00:16:59.294 00:16:59.294 Disk stats (read/write): 00:16:59.294 nvme0n1: ios=534/1024, merge=0/0, ticks=1450/178, in_queue=1628, util=85.27% 00:16:59.294 nvme0n2: ios=1754/2048, merge=0/0, ticks=476/312, in_queue=788, util=90.43% 00:16:59.294 nvme0n3: ios=203/512, merge=0/0, ticks=1374/95, in_queue=1469, util=93.39% 00:16:59.294 nvme0n4: ios=941/1024, merge=0/0, ticks=880/169, in_queue=1049, util=94.40% 00:16:59.294 16:59:10 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:59.294 [global] 00:16:59.294 thread=1 00:16:59.294 invalidate=1 00:16:59.294 rw=randwrite 00:16:59.294 time_based=1 00:16:59.294 runtime=1 00:16:59.294 ioengine=libaio 00:16:59.294 direct=1 00:16:59.294 bs=4096 00:16:59.294 iodepth=1 00:16:59.294 norandommap=0 00:16:59.294 numjobs=1 00:16:59.294 00:16:59.294 verify_dump=1 00:16:59.294 verify_backlog=512 00:16:59.294 verify_state_save=0 00:16:59.294 do_verify=1 00:16:59.294 verify=crc32c-intel 00:16:59.294 [job0] 00:16:59.294 filename=/dev/nvme0n1 00:16:59.294 [job1] 00:16:59.294 filename=/dev/nvme0n2 00:16:59.294 [job2] 00:16:59.294 filename=/dev/nvme0n3 00:16:59.294 [job3] 00:16:59.294 filename=/dev/nvme0n4 00:16:59.294 Could not set queue depth (nvme0n1) 00:16:59.295 Could not set queue depth (nvme0n2) 00:16:59.295 Could not set queue depth (nvme0n3) 00:16:59.295 Could not set queue depth (nvme0n4) 00:16:59.295 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:59.295 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:59.295 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:59.295 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:59.295 fio-3.35 00:16:59.295 Starting 4 threads 00:17:00.677 00:17:00.677 job0: (groupid=0, jobs=1): err= 0: pid=211959: Fri Nov 29 16:59:11 2024 00:17:00.677 read: IOPS=69, BW=276KiB/s (283kB/s)(280KiB/1013msec) 00:17:00.677 slat (nsec): min=7104, max=68727, avg=22884.90, stdev=11281.81 00:17:00.677 clat (usec): min=258, max=42012, avg=12659.50, stdev=18865.95 00:17:00.677 lat (usec): min=266, max=42027, avg=12682.38, stdev=18864.88 00:17:00.677 clat percentiles (usec): 00:17:00.677 | 1.00th=[ 260], 5.00th=[ 289], 10.00th=[ 302], 20.00th=[ 355], 00:17:00.677 | 30.00th=[ 375], 40.00th=[ 392], 50.00th=[ 461], 60.00th=[ 490], 00:17:00.677 | 70.00th=[ 570], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:17:00.677 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:00.677 | 99.99th=[42206] 00:17:00.677 write: IOPS=505, BW=2022KiB/s (2070kB/s)(2048KiB/1013msec); 0 zone resets 00:17:00.677 slat (nsec): min=7870, max=73513, avg=16206.60, stdev=9204.74 00:17:00.677 clat (usec): min=153, max=447, avg=222.86, stdev=50.50 00:17:00.678 lat (usec): min=162, max=467, avg=239.07, stdev=52.79 00:17:00.678 clat percentiles (usec): 00:17:00.678 | 1.00th=[ 157], 5.00th=[ 165], 10.00th=[ 174], 20.00th=[ 184], 00:17:00.678 | 30.00th=[ 194], 40.00th=[ 202], 50.00th=[ 208], 60.00th=[ 221], 00:17:00.678 | 70.00th=[ 235], 80.00th=[ 249], 90.00th=[ 289], 95.00th=[ 318], 00:17:00.678 | 99.00th=[ 396], 99.50th=[ 408], 99.90th=[ 449], 99.95th=[ 449], 00:17:00.678 | 99.99th=[ 449] 00:17:00.678 bw ( KiB/s): min= 4096, max= 4096, per=50.95%, avg=4096.00, stdev= 0.00, samples=1 00:17:00.678 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:00.678 lat (usec) : 250=70.45%, 500=25.09%, 750=0.86% 00:17:00.678 lat (msec) : 50=3.61% 00:17:00.678 cpu : usr=0.49%, sys=0.99%, ctx=584, majf=0, minf=1 00:17:00.678 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.678 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.678 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.678 issued rwts: total=70,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.678 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.678 job1: (groupid=0, jobs=1): err= 0: pid=211960: Fri Nov 29 16:59:11 2024 00:17:00.678 read: IOPS=105, BW=420KiB/s (430kB/s)(428KiB/1019msec) 00:17:00.678 slat (nsec): min=7852, max=36780, avg=19410.39, stdev=6271.44 00:17:00.678 clat (usec): min=216, max=42112, avg=8250.38, stdev=16261.09 00:17:00.678 lat (usec): min=224, max=42129, avg=8269.79, stdev=16258.77 00:17:00.678 clat percentiles (usec): 00:17:00.678 | 1.00th=[ 217], 5.00th=[ 223], 10.00th=[ 225], 20.00th=[ 227], 00:17:00.678 | 30.00th=[ 233], 40.00th=[ 239], 50.00th=[ 245], 60.00th=[ 253], 00:17:00.678 | 70.00th=[ 306], 80.00th=[ 404], 90.00th=[41157], 95.00th=[41157], 00:17:00.678 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:00.678 | 99.99th=[42206] 00:17:00.678 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:17:00.678 slat (nsec): min=7602, max=73898, avg=16773.09, stdev=8608.74 00:17:00.678 clat (usec): min=139, max=409, avg=239.14, stdev=51.09 00:17:00.678 lat (usec): min=148, max=438, avg=255.92, stdev=52.95 00:17:00.678 clat percentiles (usec): 00:17:00.678 | 1.00th=[ 149], 5.00th=[ 163], 10.00th=[ 180], 20.00th=[ 196], 00:17:00.678 | 30.00th=[ 210], 40.00th=[ 223], 50.00th=[ 233], 60.00th=[ 241], 00:17:00.678 | 70.00th=[ 258], 80.00th=[ 289], 90.00th=[ 310], 95.00th=[ 330], 00:17:00.678 | 99.00th=[ 379], 99.50th=[ 400], 99.90th=[ 408], 99.95th=[ 408], 00:17:00.678 | 99.99th=[ 408] 00:17:00.678 bw ( KiB/s): min= 4096, max= 4096, per=50.95%, avg=4096.00, stdev= 0.00, samples=1 00:17:00.678 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:00.678 lat (usec) : 250=65.11%, 500=31.50% 00:17:00.678 lat (msec) : 50=3.39% 00:17:00.678 cpu : usr=0.98%, sys=0.88%, ctx=620, majf=0, minf=1 00:17:00.678 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.678 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.678 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.678 issued rwts: total=107,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.678 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.678 job2: (groupid=0, jobs=1): err= 0: pid=211961: Fri Nov 29 16:59:11 2024 00:17:00.678 read: IOPS=21, BW=87.0KiB/s (89.0kB/s)(88.0KiB/1012msec) 00:17:00.678 slat (nsec): min=7971, max=34685, avg=18942.95, stdev=8883.86 00:17:00.678 clat (usec): min=40835, max=41045, avg=40970.11, stdev=39.36 00:17:00.678 lat (usec): min=40851, max=41064, avg=40989.05, stdev=39.05 00:17:00.678 clat percentiles (usec): 00:17:00.678 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:17:00.678 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:17:00.678 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:17:00.678 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:17:00.678 | 99.99th=[41157] 00:17:00.678 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:17:00.678 slat (nsec): min=7269, max=55668, avg=13527.32, stdev=8251.85 00:17:00.678 clat (usec): min=143, max=598, avg=197.81, stdev=53.19 00:17:00.678 lat (usec): min=152, max=612, avg=211.34, stdev=57.07 00:17:00.678 clat percentiles (usec): 00:17:00.678 | 1.00th=[ 149], 5.00th=[ 157], 10.00th=[ 161], 20.00th=[ 165], 00:17:00.678 | 30.00th=[ 169], 40.00th=[ 176], 50.00th=[ 182], 60.00th=[ 188], 00:17:00.678 | 70.00th=[ 198], 80.00th=[ 217], 90.00th=[ 249], 95.00th=[ 322], 00:17:00.678 | 99.00th=[ 400], 99.50th=[ 424], 99.90th=[ 603], 99.95th=[ 603], 00:17:00.678 | 99.99th=[ 603] 00:17:00.678 bw ( KiB/s): min= 4096, max= 4096, per=50.95%, avg=4096.00, stdev= 0.00, samples=1 00:17:00.678 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:00.678 lat (usec) : 250=86.33%, 500=9.36%, 750=0.19% 00:17:00.678 lat (msec) : 50=4.12% 00:17:00.678 cpu : usr=0.40%, sys=0.59%, ctx=535, majf=0, minf=1 00:17:00.678 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.678 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.678 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.678 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.678 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.678 job3: (groupid=0, jobs=1): err= 0: pid=211962: Fri Nov 29 16:59:11 2024 00:17:00.678 read: IOPS=20, BW=83.4KiB/s (85.4kB/s)(84.0KiB/1007msec) 00:17:00.678 slat (nsec): min=8023, max=34361, avg=20342.76, stdev=10175.75 00:17:00.678 clat (usec): min=40875, max=41947, avg=41163.59, stdev=379.59 00:17:00.678 lat (usec): min=40909, max=41965, avg=41183.94, stdev=381.91 00:17:00.678 clat percentiles (usec): 00:17:00.678 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:17:00.678 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:17:00.678 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[41681], 00:17:00.678 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:00.678 | 99.99th=[42206] 00:17:00.678 write: IOPS=508, BW=2034KiB/s (2083kB/s)(2048KiB/1007msec); 0 zone resets 00:17:00.678 slat (nsec): min=7059, max=64017, avg=17857.04, stdev=9376.39 00:17:00.678 clat (usec): min=138, max=456, avg=254.72, stdev=69.32 00:17:00.678 lat (usec): min=149, max=470, avg=272.58, stdev=71.62 00:17:00.678 clat percentiles (usec): 00:17:00.678 | 1.00th=[ 149], 5.00th=[ 163], 10.00th=[ 176], 20.00th=[ 196], 00:17:00.678 | 30.00th=[ 210], 40.00th=[ 221], 50.00th=[ 235], 60.00th=[ 265], 00:17:00.678 | 70.00th=[ 289], 80.00th=[ 322], 90.00th=[ 355], 95.00th=[ 388], 00:17:00.678 | 99.00th=[ 433], 99.50th=[ 441], 99.90th=[ 457], 99.95th=[ 457], 00:17:00.678 | 99.99th=[ 457] 00:17:00.678 bw ( KiB/s): min= 4096, max= 4096, per=50.95%, avg=4096.00, stdev= 0.00, samples=1 00:17:00.678 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:00.678 lat (usec) : 250=55.16%, 500=40.90% 00:17:00.678 lat (msec) : 50=3.94% 00:17:00.678 cpu : usr=0.40%, sys=0.99%, ctx=533, majf=0, minf=2 00:17:00.678 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.678 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.678 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.678 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.678 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.678 00:17:00.678 Run status group 0 (all jobs): 00:17:00.678 READ: bw=864KiB/s (884kB/s), 83.4KiB/s-420KiB/s (85.4kB/s-430kB/s), io=880KiB (901kB), run=1007-1019msec 00:17:00.678 WRITE: bw=8039KiB/s (8232kB/s), 2010KiB/s-2034KiB/s (2058kB/s-2083kB/s), io=8192KiB (8389kB), run=1007-1019msec 00:17:00.678 00:17:00.678 Disk stats (read/write): 00:17:00.678 nvme0n1: ios=115/512, merge=0/0, ticks=750/108, in_queue=858, util=85.17% 00:17:00.679 nvme0n2: ios=124/512, merge=0/0, ticks=838/118, in_queue=956, util=89.22% 00:17:00.679 nvme0n3: ios=77/512, merge=0/0, ticks=1106/106, in_queue=1212, util=93.51% 00:17:00.679 nvme0n4: ios=74/512, merge=0/0, ticks=762/124, in_queue=886, util=95.35% 00:17:00.679 16:59:11 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:17:00.679 [global] 00:17:00.679 thread=1 00:17:00.679 invalidate=1 00:17:00.679 rw=write 00:17:00.679 time_based=1 00:17:00.679 runtime=1 00:17:00.679 ioengine=libaio 00:17:00.679 direct=1 00:17:00.679 bs=4096 00:17:00.679 iodepth=128 00:17:00.679 norandommap=0 00:17:00.679 numjobs=1 00:17:00.679 00:17:00.679 verify_dump=1 00:17:00.679 verify_backlog=512 00:17:00.679 verify_state_save=0 00:17:00.679 do_verify=1 00:17:00.679 verify=crc32c-intel 00:17:00.679 [job0] 00:17:00.679 filename=/dev/nvme0n1 00:17:00.679 [job1] 00:17:00.679 filename=/dev/nvme0n2 00:17:00.679 [job2] 00:17:00.679 filename=/dev/nvme0n3 00:17:00.679 [job3] 00:17:00.679 filename=/dev/nvme0n4 00:17:00.679 Could not set queue depth (nvme0n1) 00:17:00.679 Could not set queue depth (nvme0n2) 00:17:00.679 Could not set queue depth (nvme0n3) 00:17:00.679 Could not set queue depth (nvme0n4) 00:17:00.679 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:00.679 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:00.679 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:00.679 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:00.679 fio-3.35 00:17:00.679 Starting 4 threads 00:17:02.054 00:17:02.055 job0: (groupid=0, jobs=1): err= 0: pid=212246: Fri Nov 29 16:59:13 2024 00:17:02.055 read: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec) 00:17:02.055 slat (usec): min=2, max=13545, avg=88.03, stdev=526.99 00:17:02.055 clat (usec): min=5615, max=24308, avg=11583.80, stdev=2258.39 00:17:02.055 lat (usec): min=5626, max=24344, avg=11671.83, stdev=2281.01 00:17:02.055 clat percentiles (usec): 00:17:02.055 | 1.00th=[ 7963], 5.00th=[ 8455], 10.00th=[ 9110], 20.00th=[ 9896], 00:17:02.055 | 30.00th=[10945], 40.00th=[11469], 50.00th=[11731], 60.00th=[11994], 00:17:02.055 | 70.00th=[12125], 80.00th=[12387], 90.00th=[12649], 95.00th=[14222], 00:17:02.055 | 99.00th=[21890], 99.50th=[23987], 99.90th=[24249], 99.95th=[24249], 00:17:02.055 | 99.99th=[24249] 00:17:02.055 write: IOPS=5314, BW=20.8MiB/s (21.8MB/s)(20.8MiB/1003msec); 0 zone resets 00:17:02.055 slat (usec): min=3, max=33471, avg=90.70, stdev=673.60 00:17:02.055 clat (msec): min=2, max=103, avg=12.63, stdev= 7.36 00:17:02.055 lat (msec): min=2, max=103, avg=12.72, stdev= 7.37 00:17:02.055 clat percentiles (msec): 00:17:02.055 | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], 00:17:02.055 | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 13], 00:17:02.055 | 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 14], 95.00th=[ 17], 00:17:02.055 | 99.00th=[ 44], 99.50th=[ 62], 99.90th=[ 95], 99.95th=[ 96], 00:17:02.055 | 99.99th=[ 104] 00:17:02.055 bw ( KiB/s): min=20480, max=21144, per=26.56%, avg=20812.00, stdev=469.52, samples=2 00:17:02.055 iops : min= 5120, max= 5286, avg=5203.00, stdev=117.38, samples=2 00:17:02.055 lat (msec) : 4=0.23%, 10=22.46%, 20=74.44%, 50=2.48%, 100=0.38% 00:17:02.055 lat (msec) : 250=0.01% 00:17:02.055 cpu : usr=7.19%, sys=13.27%, ctx=412, majf=0, minf=1 00:17:02.055 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:17:02.055 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:02.055 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:02.055 issued rwts: total=5120,5330,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:02.055 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:02.055 job1: (groupid=0, jobs=1): err= 0: pid=212265: Fri Nov 29 16:59:13 2024 00:17:02.055 read: IOPS=5210, BW=20.4MiB/s (21.3MB/s)(20.5MiB/1007msec) 00:17:02.055 slat (usec): min=3, max=9421, avg=89.44, stdev=541.10 00:17:02.055 clat (usec): min=2764, max=25761, avg=12084.17, stdev=2611.76 00:17:02.055 lat (usec): min=5171, max=25797, avg=12173.61, stdev=2628.89 00:17:02.055 clat percentiles (usec): 00:17:02.055 | 1.00th=[ 6128], 5.00th=[ 8717], 10.00th=[ 9372], 20.00th=[10290], 00:17:02.055 | 30.00th=[10683], 40.00th=[11207], 50.00th=[11994], 60.00th=[12649], 00:17:02.055 | 70.00th=[13042], 80.00th=[13566], 90.00th=[14222], 95.00th=[16450], 00:17:02.055 | 99.00th=[19792], 99.50th=[23987], 99.90th=[25035], 99.95th=[25822], 00:17:02.055 | 99.99th=[25822] 00:17:02.055 write: IOPS=5592, BW=21.8MiB/s (22.9MB/s)(22.0MiB/1007msec); 0 zone resets 00:17:02.055 slat (usec): min=4, max=12793, avg=81.40, stdev=545.94 00:17:02.055 clat (usec): min=457, max=51643, avg=11423.60, stdev=4482.74 00:17:02.055 lat (usec): min=481, max=51662, avg=11505.00, stdev=4503.18 00:17:02.055 clat percentiles (usec): 00:17:02.055 | 1.00th=[ 2073], 5.00th=[ 6128], 10.00th=[ 6980], 20.00th=[ 9372], 00:17:02.055 | 30.00th=[10159], 40.00th=[10552], 50.00th=[11076], 60.00th=[11600], 00:17:02.055 | 70.00th=[12518], 80.00th=[13566], 90.00th=[14353], 95.00th=[16188], 00:17:02.055 | 99.00th=[32113], 99.50th=[43779], 99.90th=[51643], 99.95th=[51643], 00:17:02.055 | 99.99th=[51643] 00:17:02.055 bw ( KiB/s): min=20472, max=24576, per=28.74%, avg=22524.00, stdev=2901.97, samples=2 00:17:02.055 iops : min= 5118, max= 6144, avg=5631.00, stdev=725.49, samples=2 00:17:02.055 lat (usec) : 500=0.02%, 750=0.06%, 1000=0.05% 00:17:02.055 lat (msec) : 2=0.28%, 4=0.89%, 10=20.22%, 20=77.20%, 50=1.15% 00:17:02.055 lat (msec) : 100=0.13% 00:17:02.055 cpu : usr=8.15%, sys=13.92%, ctx=354, majf=0, minf=1 00:17:02.055 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:17:02.055 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:02.055 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:02.055 issued rwts: total=5247,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:02.055 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:02.055 job2: (groupid=0, jobs=1): err= 0: pid=212297: Fri Nov 29 16:59:13 2024 00:17:02.055 read: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec) 00:17:02.055 slat (usec): min=2, max=29157, avg=112.44, stdev=787.51 00:17:02.055 clat (usec): min=6524, max=78021, avg=14994.98, stdev=8965.16 00:17:02.055 lat (usec): min=6536, max=78035, avg=15107.42, stdev=8977.86 00:17:02.055 clat percentiles (usec): 00:17:02.055 | 1.00th=[ 8848], 5.00th=[ 9372], 10.00th=[11207], 20.00th=[12256], 00:17:02.055 | 30.00th=[12518], 40.00th=[12780], 50.00th=[13042], 60.00th=[13435], 00:17:02.055 | 70.00th=[14484], 80.00th=[16188], 90.00th=[16909], 95.00th=[20579], 00:17:02.055 | 99.00th=[74974], 99.50th=[78119], 99.90th=[78119], 99.95th=[78119], 00:17:02.055 | 99.99th=[78119] 00:17:02.055 write: IOPS=3885, BW=15.2MiB/s (15.9MB/s)(15.3MiB/1006msec); 0 zone resets 00:17:02.055 slat (usec): min=3, max=71752, avg=142.17, stdev=1508.22 00:17:02.055 clat (usec): min=278, max=79868, avg=15327.10, stdev=8815.02 00:17:02.055 lat (msec): min=4, max=115, avg=15.47, stdev= 8.99 00:17:02.055 clat percentiles (usec): 00:17:02.055 | 1.00th=[ 5342], 5.00th=[ 8586], 10.00th=[ 8848], 20.00th=[12125], 00:17:02.055 | 30.00th=[13042], 40.00th=[13435], 50.00th=[13566], 60.00th=[13698], 00:17:02.055 | 70.00th=[13960], 80.00th=[15401], 90.00th=[18220], 95.00th=[40109], 00:17:02.055 | 99.00th=[58459], 99.50th=[66323], 99.90th=[69731], 99.95th=[69731], 00:17:02.055 | 99.99th=[80217] 00:17:02.055 bw ( KiB/s): min=12288, max=17960, per=19.30%, avg=15124.00, stdev=4010.71, samples=2 00:17:02.055 iops : min= 3072, max= 4490, avg=3781.00, stdev=1002.68, samples=2 00:17:02.055 lat (usec) : 500=0.01% 00:17:02.055 lat (msec) : 10=10.42%, 20=83.10%, 50=4.96%, 100=1.49% 00:17:02.055 cpu : usr=6.27%, sys=9.55%, ctx=335, majf=0, minf=1 00:17:02.055 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:17:02.055 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:02.055 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:02.055 issued rwts: total=3584,3909,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:02.055 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:02.055 job3: (groupid=0, jobs=1): err= 0: pid=212309: Fri Nov 29 16:59:13 2024 00:17:02.055 read: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec) 00:17:02.055 slat (usec): min=3, max=7159, avg=97.93, stdev=533.74 00:17:02.055 clat (usec): min=7981, max=34541, avg=12917.97, stdev=1902.93 00:17:02.055 lat (usec): min=7988, max=34546, avg=13015.90, stdev=1945.47 00:17:02.055 clat percentiles (usec): 00:17:02.055 | 1.00th=[ 9110], 5.00th=[10552], 10.00th=[11338], 20.00th=[11863], 00:17:02.055 | 30.00th=[12387], 40.00th=[12649], 50.00th=[12780], 60.00th=[12911], 00:17:02.055 | 70.00th=[13173], 80.00th=[13435], 90.00th=[14484], 95.00th=[15664], 00:17:02.055 | 99.00th=[19006], 99.50th=[22152], 99.90th=[34341], 99.95th=[34341], 00:17:02.055 | 99.99th=[34341] 00:17:02.055 write: IOPS=4848, BW=18.9MiB/s (19.9MB/s)(19.0MiB/1002msec); 0 zone resets 00:17:02.055 slat (usec): min=4, max=16969, avg=101.56, stdev=544.58 00:17:02.055 clat (usec): min=480, max=30309, avg=13392.47, stdev=2482.13 00:17:02.055 lat (usec): min=4336, max=30322, avg=13494.04, stdev=2491.53 00:17:02.055 clat percentiles (usec): 00:17:02.055 | 1.00th=[ 8356], 5.00th=[10290], 10.00th=[10814], 20.00th=[11731], 00:17:02.055 | 30.00th=[12649], 40.00th=[13173], 50.00th=[13435], 60.00th=[13698], 00:17:02.055 | 70.00th=[14091], 80.00th=[14353], 90.00th=[14877], 95.00th=[17695], 00:17:02.055 | 99.00th=[23987], 99.50th=[24511], 99.90th=[27132], 99.95th=[27132], 00:17:02.055 | 99.99th=[30278] 00:17:02.055 bw ( KiB/s): min=18408, max=19470, per=24.17%, avg=18939.00, stdev=750.95, samples=2 00:17:02.055 iops : min= 4602, max= 4867, avg=4734.50, stdev=187.38, samples=2 00:17:02.055 lat (usec) : 500=0.01% 00:17:02.055 lat (msec) : 10=3.07%, 20=95.37%, 50=1.54% 00:17:02.055 cpu : usr=6.39%, sys=12.49%, ctx=406, majf=0, minf=1 00:17:02.055 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:17:02.055 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:02.055 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:02.055 issued rwts: total=4608,4858,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:02.055 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:02.055 00:17:02.055 Run status group 0 (all jobs): 00:17:02.055 READ: bw=72.0MiB/s (75.5MB/s), 13.9MiB/s-20.4MiB/s (14.6MB/s-21.3MB/s), io=72.5MiB (76.0MB), run=1002-1007msec 00:17:02.055 WRITE: bw=76.5MiB/s (80.2MB/s), 15.2MiB/s-21.8MiB/s (15.9MB/s-22.9MB/s), io=77.1MiB (80.8MB), run=1002-1007msec 00:17:02.055 00:17:02.055 Disk stats (read/write): 00:17:02.055 nvme0n1: ios=4164/4608, merge=0/0, ticks=22874/27104, in_queue=49978, util=96.79% 00:17:02.055 nvme0n2: ios=4628/4667, merge=0/0, ticks=35132/33440, in_queue=68572, util=90.65% 00:17:02.055 nvme0n3: ios=3094/3259, merge=0/0, ticks=22531/21060, in_queue=43591, util=93.41% 00:17:02.055 nvme0n4: ios=3864/4096, merge=0/0, ticks=17848/19268, in_queue=37116, util=100.00% 00:17:02.055 16:59:13 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:17:02.055 [global] 00:17:02.055 thread=1 00:17:02.055 invalidate=1 00:17:02.055 rw=randwrite 00:17:02.055 time_based=1 00:17:02.055 runtime=1 00:17:02.055 ioengine=libaio 00:17:02.055 direct=1 00:17:02.055 bs=4096 00:17:02.055 iodepth=128 00:17:02.055 norandommap=0 00:17:02.055 numjobs=1 00:17:02.055 00:17:02.055 verify_dump=1 00:17:02.055 verify_backlog=512 00:17:02.055 verify_state_save=0 00:17:02.055 do_verify=1 00:17:02.055 verify=crc32c-intel 00:17:02.055 [job0] 00:17:02.055 filename=/dev/nvme0n1 00:17:02.055 [job1] 00:17:02.055 filename=/dev/nvme0n2 00:17:02.055 [job2] 00:17:02.055 filename=/dev/nvme0n3 00:17:02.055 [job3] 00:17:02.055 filename=/dev/nvme0n4 00:17:02.055 Could not set queue depth (nvme0n1) 00:17:02.055 Could not set queue depth (nvme0n2) 00:17:02.055 Could not set queue depth (nvme0n3) 00:17:02.055 Could not set queue depth (nvme0n4) 00:17:02.314 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:02.314 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:02.314 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:02.314 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:02.314 fio-3.35 00:17:02.314 Starting 4 threads 00:17:03.688 00:17:03.688 job0: (groupid=0, jobs=1): err= 0: pid=212556: Fri Nov 29 16:59:14 2024 00:17:03.688 read: IOPS=5073, BW=19.8MiB/s (20.8MB/s)(19.9MiB/1003msec) 00:17:03.688 slat (usec): min=2, max=18953, avg=90.03, stdev=595.64 00:17:03.688 clat (usec): min=975, max=25558, avg=11867.14, stdev=3166.93 00:17:03.688 lat (usec): min=990, max=30066, avg=11957.16, stdev=3202.59 00:17:03.688 clat percentiles (usec): 00:17:03.688 | 1.00th=[ 4359], 5.00th=[ 7242], 10.00th=[ 8717], 20.00th=[ 9896], 00:17:03.688 | 30.00th=[10421], 40.00th=[10814], 50.00th=[10945], 60.00th=[11863], 00:17:03.688 | 70.00th=[12780], 80.00th=[14484], 90.00th=[16188], 95.00th=[18220], 00:17:03.688 | 99.00th=[20841], 99.50th=[20841], 99.90th=[21365], 99.95th=[21365], 00:17:03.688 | 99.99th=[25560] 00:17:03.688 write: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec); 0 zone resets 00:17:03.688 slat (usec): min=3, max=17456, avg=97.21, stdev=656.28 00:17:03.688 clat (usec): min=1181, max=28991, avg=12940.27, stdev=4516.86 00:17:03.688 lat (usec): min=1195, max=28999, avg=13037.48, stdev=4559.67 00:17:03.688 clat percentiles (usec): 00:17:03.688 | 1.00th=[ 8225], 5.00th=[ 9503], 10.00th=[10028], 20.00th=[10290], 00:17:03.688 | 30.00th=[10683], 40.00th=[11076], 50.00th=[11207], 60.00th=[11731], 00:17:03.688 | 70.00th=[12518], 80.00th=[13566], 90.00th=[18220], 95.00th=[25297], 00:17:03.688 | 99.00th=[28967], 99.50th=[28967], 99.90th=[28967], 99.95th=[28967], 00:17:03.688 | 99.99th=[28967] 00:17:03.689 bw ( KiB/s): min=18088, max=22872, per=30.16%, avg=20480.00, stdev=3382.80, samples=2 00:17:03.689 iops : min= 4522, max= 5718, avg=5120.00, stdev=845.70, samples=2 00:17:03.689 lat (usec) : 1000=0.01% 00:17:03.689 lat (msec) : 2=0.05%, 4=0.01%, 10=15.29%, 20=78.89%, 50=5.75% 00:17:03.689 cpu : usr=3.79%, sys=7.19%, ctx=354, majf=0, minf=1 00:17:03.689 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:17:03.689 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:03.689 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:03.689 issued rwts: total=5089,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:03.689 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:03.689 job1: (groupid=0, jobs=1): err= 0: pid=212557: Fri Nov 29 16:59:14 2024 00:17:03.689 read: IOPS=3793, BW=14.8MiB/s (15.5MB/s)(14.9MiB/1004msec) 00:17:03.689 slat (usec): min=2, max=17846, avg=144.19, stdev=862.01 00:17:03.689 clat (usec): min=1709, max=58691, avg=18197.18, stdev=11217.81 00:17:03.689 lat (usec): min=6259, max=58731, avg=18341.36, stdev=11276.68 00:17:03.689 clat percentiles (usec): 00:17:03.689 | 1.00th=[ 7963], 5.00th=[ 9372], 10.00th=[ 9896], 20.00th=[10683], 00:17:03.689 | 30.00th=[11076], 40.00th=[11731], 50.00th=[12387], 60.00th=[14484], 00:17:03.689 | 70.00th=[18220], 80.00th=[28181], 90.00th=[36963], 95.00th=[43779], 00:17:03.689 | 99.00th=[53740], 99.50th=[53740], 99.90th=[54264], 99.95th=[54264], 00:17:03.689 | 99.99th=[58459] 00:17:03.689 write: IOPS=4079, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1004msec); 0 zone resets 00:17:03.689 slat (usec): min=4, max=8961, avg=101.94, stdev=570.16 00:17:03.689 clat (usec): min=6554, max=41483, avg=14004.09, stdev=5221.98 00:17:03.689 lat (usec): min=8308, max=41494, avg=14106.03, stdev=5233.29 00:17:03.689 clat percentiles (usec): 00:17:03.689 | 1.00th=[ 8586], 5.00th=[ 9241], 10.00th=[ 9634], 20.00th=[10814], 00:17:03.689 | 30.00th=[11338], 40.00th=[11863], 50.00th=[12256], 60.00th=[12911], 00:17:03.689 | 70.00th=[13698], 80.00th=[16057], 90.00th=[21365], 95.00th=[24773], 00:17:03.689 | 99.00th=[34341], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:17:03.689 | 99.99th=[41681] 00:17:03.689 bw ( KiB/s): min=14712, max=18056, per=24.13%, avg=16384.00, stdev=2364.57, samples=2 00:17:03.689 iops : min= 3678, max= 4514, avg=4096.00, stdev=591.14, samples=2 00:17:03.689 lat (msec) : 2=0.01%, 10=11.49%, 20=68.75%, 50=19.19%, 100=0.56% 00:17:03.689 cpu : usr=4.39%, sys=6.48%, ctx=360, majf=0, minf=1 00:17:03.689 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:17:03.689 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:03.689 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:03.689 issued rwts: total=3809,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:03.689 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:03.689 job2: (groupid=0, jobs=1): err= 0: pid=212558: Fri Nov 29 16:59:14 2024 00:17:03.689 read: IOPS=3657, BW=14.3MiB/s (15.0MB/s)(14.3MiB/1003msec) 00:17:03.689 slat (usec): min=2, max=14915, avg=124.65, stdev=744.23 00:17:03.689 clat (usec): min=347, max=34014, avg=16046.29, stdev=5180.95 00:17:03.689 lat (usec): min=5155, max=34033, avg=16170.94, stdev=5232.68 00:17:03.689 clat percentiles (usec): 00:17:03.689 | 1.00th=[ 5735], 5.00th=[ 8455], 10.00th=[10945], 20.00th=[11994], 00:17:03.689 | 30.00th=[12911], 40.00th=[13698], 50.00th=[15008], 60.00th=[16319], 00:17:03.689 | 70.00th=[17957], 80.00th=[19792], 90.00th=[25035], 95.00th=[25822], 00:17:03.689 | 99.00th=[28181], 99.50th=[29492], 99.90th=[31851], 99.95th=[32375], 00:17:03.689 | 99.99th=[33817] 00:17:03.689 write: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec); 0 zone resets 00:17:03.689 slat (usec): min=3, max=18499, avg=111.03, stdev=647.34 00:17:03.689 clat (usec): min=3152, max=66962, avg=16686.76, stdev=8429.55 00:17:03.689 lat (usec): min=3159, max=66976, avg=16797.78, stdev=8465.53 00:17:03.689 clat percentiles (usec): 00:17:03.689 | 1.00th=[ 4817], 5.00th=[ 6259], 10.00th=[10945], 20.00th=[11994], 00:17:03.689 | 30.00th=[12780], 40.00th=[13566], 50.00th=[13960], 60.00th=[14484], 00:17:03.689 | 70.00th=[17695], 80.00th=[20841], 90.00th=[25297], 95.00th=[32637], 00:17:03.689 | 99.00th=[52691], 99.50th=[63177], 99.90th=[66847], 99.95th=[66847], 00:17:03.689 | 99.99th=[66847] 00:17:03.689 bw ( KiB/s): min=15952, max=16431, per=23.85%, avg=16191.50, stdev=338.70, samples=2 00:17:03.689 iops : min= 3988, max= 4107, avg=4047.50, stdev=84.15, samples=2 00:17:03.689 lat (usec) : 500=0.01% 00:17:03.689 lat (msec) : 4=0.52%, 10=7.51%, 20=68.92%, 50=22.39%, 100=0.66% 00:17:03.689 cpu : usr=4.29%, sys=8.48%, ctx=379, majf=0, minf=1 00:17:03.689 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:17:03.689 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:03.689 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:03.689 issued rwts: total=3668,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:03.689 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:03.689 job3: (groupid=0, jobs=1): err= 0: pid=212559: Fri Nov 29 16:59:14 2024 00:17:03.689 read: IOPS=3576, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1002msec) 00:17:03.689 slat (usec): min=3, max=12461, avg=140.90, stdev=756.98 00:17:03.689 clat (usec): min=4780, max=49474, avg=18922.00, stdev=8678.60 00:17:03.689 lat (usec): min=4790, max=49481, avg=19062.91, stdev=8720.44 00:17:03.689 clat percentiles (usec): 00:17:03.689 | 1.00th=[ 7898], 5.00th=[10945], 10.00th=[11731], 20.00th=[11994], 00:17:03.689 | 30.00th=[12649], 40.00th=[13173], 50.00th=[14877], 60.00th=[19006], 00:17:03.689 | 70.00th=[21103], 80.00th=[26870], 90.00th=[33817], 95.00th=[35914], 00:17:03.689 | 99.00th=[39584], 99.50th=[43254], 99.90th=[49546], 99.95th=[49546], 00:17:03.689 | 99.99th=[49546] 00:17:03.689 write: IOPS=3723, BW=14.5MiB/s (15.3MB/s)(14.6MiB/1002msec); 0 zone resets 00:17:03.689 slat (usec): min=4, max=14553, avg=118.03, stdev=739.99 00:17:03.689 clat (usec): min=1684, max=41531, avg=15897.99, stdev=5006.05 00:17:03.689 lat (usec): min=5161, max=41549, avg=16016.02, stdev=5037.00 00:17:03.689 clat percentiles (usec): 00:17:03.689 | 1.00th=[ 8455], 5.00th=[10290], 10.00th=[10945], 20.00th=[12256], 00:17:03.689 | 30.00th=[12780], 40.00th=[13829], 50.00th=[14615], 60.00th=[15795], 00:17:03.689 | 70.00th=[16909], 80.00th=[19268], 90.00th=[23200], 95.00th=[26870], 00:17:03.689 | 99.00th=[32113], 99.50th=[34341], 99.90th=[36439], 99.95th=[38011], 00:17:03.689 | 99.99th=[41681] 00:17:03.689 bw ( KiB/s): min=10152, max=18680, per=21.23%, avg=14416.00, stdev=6030.21, samples=2 00:17:03.689 iops : min= 2538, max= 4670, avg=3604.00, stdev=1507.55, samples=2 00:17:03.689 lat (msec) : 2=0.01%, 10=3.64%, 20=69.04%, 50=27.31% 00:17:03.689 cpu : usr=4.50%, sys=9.19%, ctx=317, majf=0, minf=1 00:17:03.689 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:17:03.689 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:03.689 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:03.689 issued rwts: total=3584,3731,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:03.689 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:03.689 00:17:03.689 Run status group 0 (all jobs): 00:17:03.689 READ: bw=62.8MiB/s (65.9MB/s), 14.0MiB/s-19.8MiB/s (14.7MB/s-20.8MB/s), io=63.1MiB (66.1MB), run=1002-1004msec 00:17:03.689 WRITE: bw=66.3MiB/s (69.5MB/s), 14.5MiB/s-19.9MiB/s (15.3MB/s-20.9MB/s), io=66.6MiB (69.8MB), run=1002-1004msec 00:17:03.689 00:17:03.689 Disk stats (read/write): 00:17:03.689 nvme0n1: ios=4478/4608, merge=0/0, ticks=32075/26542, in_queue=58617, util=85.97% 00:17:03.689 nvme0n2: ios=3369/3584, merge=0/0, ticks=17543/13750, in_queue=31293, util=89.64% 00:17:03.689 nvme0n3: ios=3338/3584, merge=0/0, ticks=32112/33998, in_queue=66110, util=92.52% 00:17:03.689 nvme0n4: ios=3129/3247, merge=0/0, ticks=19523/19118, in_queue=38641, util=93.93% 00:17:03.689 16:59:14 -- target/fio.sh@55 -- # sync 00:17:03.689 16:59:14 -- target/fio.sh@59 -- # fio_pid=212701 00:17:03.689 16:59:14 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:17:03.689 16:59:14 -- target/fio.sh@61 -- # sleep 3 00:17:03.689 [global] 00:17:03.689 thread=1 00:17:03.689 invalidate=1 00:17:03.689 rw=read 00:17:03.689 time_based=1 00:17:03.689 runtime=10 00:17:03.689 ioengine=libaio 00:17:03.689 direct=1 00:17:03.689 bs=4096 00:17:03.689 iodepth=1 00:17:03.689 norandommap=1 00:17:03.689 numjobs=1 00:17:03.689 00:17:03.689 [job0] 00:17:03.689 filename=/dev/nvme0n1 00:17:03.689 [job1] 00:17:03.689 filename=/dev/nvme0n2 00:17:03.689 [job2] 00:17:03.689 filename=/dev/nvme0n3 00:17:03.689 [job3] 00:17:03.689 filename=/dev/nvme0n4 00:17:03.689 Could not set queue depth (nvme0n1) 00:17:03.689 Could not set queue depth (nvme0n2) 00:17:03.689 Could not set queue depth (nvme0n3) 00:17:03.689 Could not set queue depth (nvme0n4) 00:17:03.689 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:03.690 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:03.690 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:03.690 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:03.690 fio-3.35 00:17:03.690 Starting 4 threads 00:17:06.970 16:59:17 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:17:06.970 16:59:17 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:17:06.970 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=331776, buflen=4096 00:17:06.970 fio: pid=212792, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:06.970 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=51425280, buflen=4096 00:17:06.970 fio: pid=212791, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:06.970 16:59:18 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:06.970 16:59:18 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:17:07.228 16:59:18 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:07.228 16:59:18 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:17:07.228 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=344064, buflen=4096 00:17:07.228 fio: pid=212789, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:07.487 16:59:18 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:07.487 16:59:18 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:17:07.487 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=1232896, buflen=4096 00:17:07.487 fio: pid=212790, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:07.487 00:17:07.487 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212789: Fri Nov 29 16:59:18 2024 00:17:07.487 read: IOPS=24, BW=96.9KiB/s (99.2kB/s)(336KiB/3469msec) 00:17:07.487 slat (usec): min=12, max=4950, avg=75.95, stdev=535.00 00:17:07.487 clat (usec): min=334, max=42102, avg=40933.84, stdev=4511.65 00:17:07.487 lat (usec): min=366, max=46974, avg=41010.51, stdev=4556.43 00:17:07.487 clat percentiles (usec): 00:17:07.487 | 1.00th=[ 334], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:17:07.487 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:17:07.487 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:17:07.487 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:07.487 | 99.99th=[42206] 00:17:07.487 bw ( KiB/s): min= 96, max= 104, per=0.70%, avg=97.33, stdev= 3.27, samples=6 00:17:07.487 iops : min= 24, max= 26, avg=24.33, stdev= 0.82, samples=6 00:17:07.487 lat (usec) : 500=1.18% 00:17:07.487 lat (msec) : 50=97.65% 00:17:07.487 cpu : usr=0.09%, sys=0.00%, ctx=87, majf=0, minf=2 00:17:07.487 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:07.487 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.487 complete : 0=1.2%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.487 issued rwts: total=85,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:07.488 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:07.488 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212790: Fri Nov 29 16:59:18 2024 00:17:07.488 read: IOPS=80, BW=321KiB/s (328kB/s)(1204KiB/3754msec) 00:17:07.488 slat (usec): min=5, max=1949, avg=17.91, stdev=111.80 00:17:07.488 clat (usec): min=178, max=43081, avg=12372.32, stdev=18793.37 00:17:07.488 lat (usec): min=184, max=43097, avg=12390.23, stdev=18808.27 00:17:07.488 clat percentiles (usec): 00:17:07.488 | 1.00th=[ 184], 5.00th=[ 190], 10.00th=[ 194], 20.00th=[ 198], 00:17:07.488 | 30.00th=[ 202], 40.00th=[ 208], 50.00th=[ 215], 60.00th=[ 247], 00:17:07.488 | 70.00th=[ 367], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:17:07.488 | 99.00th=[42206], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254], 00:17:07.488 | 99.99th=[43254] 00:17:07.488 bw ( KiB/s): min= 93, max= 1776, per=2.42%, avg=336.71, stdev=634.67, samples=7 00:17:07.488 iops : min= 23, max= 444, avg=84.14, stdev=158.68, samples=7 00:17:07.488 lat (usec) : 250=60.26%, 500=9.93% 00:17:07.488 lat (msec) : 50=29.47% 00:17:07.488 cpu : usr=0.03%, sys=0.11%, ctx=308, majf=0, minf=1 00:17:07.488 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:07.488 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.488 complete : 0=0.3%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.488 issued rwts: total=302,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:07.488 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:07.488 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212791: Fri Nov 29 16:59:18 2024 00:17:07.488 read: IOPS=4002, BW=15.6MiB/s (16.4MB/s)(49.0MiB/3137msec) 00:17:07.488 slat (usec): min=4, max=15738, avg=11.16, stdev=154.30 00:17:07.488 clat (usec): min=170, max=41044, avg=235.49, stdev=675.69 00:17:07.488 lat (usec): min=174, max=41059, avg=246.65, stdev=693.54 00:17:07.488 clat percentiles (usec): 00:17:07.488 | 1.00th=[ 178], 5.00th=[ 184], 10.00th=[ 190], 20.00th=[ 196], 00:17:07.488 | 30.00th=[ 202], 40.00th=[ 210], 50.00th=[ 223], 60.00th=[ 235], 00:17:07.488 | 70.00th=[ 243], 80.00th=[ 249], 90.00th=[ 255], 95.00th=[ 262], 00:17:07.488 | 99.00th=[ 293], 99.50th=[ 338], 99.90th=[ 529], 99.95th=[ 1020], 00:17:07.488 | 99.99th=[41157] 00:17:07.488 bw ( KiB/s): min=10696, max=19360, per=100.00%, avg=15942.67, stdev=2942.95, samples=6 00:17:07.488 iops : min= 2674, max= 4840, avg=3985.67, stdev=735.74, samples=6 00:17:07.488 lat (usec) : 250=83.03%, 500=16.84%, 750=0.05%, 1000=0.02% 00:17:07.488 lat (msec) : 2=0.02%, 4=0.01%, 50=0.03% 00:17:07.488 cpu : usr=2.46%, sys=5.07%, ctx=12558, majf=0, minf=2 00:17:07.488 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:07.488 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.488 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.488 issued rwts: total=12556,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:07.488 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:07.488 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212792: Fri Nov 29 16:59:18 2024 00:17:07.488 read: IOPS=28, BW=112KiB/s (115kB/s)(324KiB/2891msec) 00:17:07.488 slat (nsec): min=8198, max=42803, avg=18639.44, stdev=7083.77 00:17:07.488 clat (usec): min=196, max=42047, avg=35308.78, stdev=14697.90 00:17:07.488 lat (usec): min=214, max=42066, avg=35327.42, stdev=14699.36 00:17:07.488 clat percentiles (usec): 00:17:07.488 | 1.00th=[ 198], 5.00th=[ 289], 10.00th=[ 322], 20.00th=[41157], 00:17:07.488 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:17:07.488 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:17:07.488 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:07.488 | 99.99th=[42206] 00:17:07.488 bw ( KiB/s): min= 96, max= 184, per=0.83%, avg=115.20, stdev=38.62, samples=5 00:17:07.488 iops : min= 24, max= 46, avg=28.80, stdev= 9.65, samples=5 00:17:07.488 lat (usec) : 250=3.66%, 500=10.98% 00:17:07.488 lat (msec) : 50=84.15% 00:17:07.488 cpu : usr=0.10%, sys=0.00%, ctx=84, majf=0, minf=1 00:17:07.488 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:07.488 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.488 complete : 0=1.2%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.488 issued rwts: total=82,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:07.488 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:07.488 00:17:07.488 Run status group 0 (all jobs): 00:17:07.488 READ: bw=13.5MiB/s (14.2MB/s), 96.9KiB/s-15.6MiB/s (99.2kB/s-16.4MB/s), io=50.9MiB (53.3MB), run=2891-3754msec 00:17:07.488 00:17:07.488 Disk stats (read/write): 00:17:07.488 nvme0n1: ios=81/0, merge=0/0, ticks=3317/0, in_queue=3317, util=95.88% 00:17:07.488 nvme0n2: ios=343/0, merge=0/0, ticks=4745/0, in_queue=4745, util=99.60% 00:17:07.488 nvme0n3: ios=12446/0, merge=0/0, ticks=2824/0, in_queue=2824, util=96.10% 00:17:07.488 nvme0n4: ios=125/0, merge=0/0, ticks=3298/0, in_queue=3298, util=99.59% 00:17:07.746 16:59:19 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:07.746 16:59:19 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:17:08.005 16:59:19 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:08.005 16:59:19 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:17:08.263 16:59:19 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:08.264 16:59:19 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:17:08.522 16:59:19 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:08.522 16:59:19 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:17:08.780 16:59:20 -- target/fio.sh@69 -- # fio_status=0 00:17:08.780 16:59:20 -- target/fio.sh@70 -- # wait 212701 00:17:08.780 16:59:20 -- target/fio.sh@70 -- # fio_status=4 00:17:08.780 16:59:20 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:09.038 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:09.038 16:59:20 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:09.038 16:59:20 -- common/autotest_common.sh@1208 -- # local i=0 00:17:09.038 16:59:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:17:09.038 16:59:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:09.038 16:59:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:17:09.038 16:59:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:09.038 16:59:20 -- common/autotest_common.sh@1220 -- # return 0 00:17:09.038 16:59:20 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:17:09.038 16:59:20 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:17:09.038 nvmf hotplug test: fio failed as expected 00:17:09.038 16:59:20 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:09.297 16:59:20 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:17:09.297 16:59:20 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:17:09.297 16:59:20 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:17:09.297 16:59:20 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:17:09.297 16:59:20 -- target/fio.sh@91 -- # nvmftestfini 00:17:09.297 16:59:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:09.297 16:59:20 -- nvmf/common.sh@116 -- # sync 00:17:09.297 16:59:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:09.297 16:59:20 -- nvmf/common.sh@119 -- # set +e 00:17:09.297 16:59:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:09.297 16:59:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:09.297 rmmod nvme_tcp 00:17:09.297 rmmod nvme_fabrics 00:17:09.297 rmmod nvme_keyring 00:17:09.297 16:59:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:09.297 16:59:20 -- nvmf/common.sh@123 -- # set -e 00:17:09.297 16:59:20 -- nvmf/common.sh@124 -- # return 0 00:17:09.297 16:59:20 -- nvmf/common.sh@477 -- # '[' -n 210620 ']' 00:17:09.297 16:59:20 -- nvmf/common.sh@478 -- # killprocess 210620 00:17:09.297 16:59:20 -- common/autotest_common.sh@936 -- # '[' -z 210620 ']' 00:17:09.297 16:59:20 -- common/autotest_common.sh@940 -- # kill -0 210620 00:17:09.297 16:59:20 -- common/autotest_common.sh@941 -- # uname 00:17:09.297 16:59:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:09.297 16:59:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 210620 00:17:09.297 16:59:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:09.297 16:59:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:09.297 16:59:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 210620' 00:17:09.297 killing process with pid 210620 00:17:09.297 16:59:20 -- common/autotest_common.sh@955 -- # kill 210620 00:17:09.297 16:59:20 -- common/autotest_common.sh@960 -- # wait 210620 00:17:09.556 16:59:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:09.557 16:59:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:09.557 16:59:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:09.557 16:59:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:09.557 16:59:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:09.557 16:59:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:09.557 16:59:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:09.557 16:59:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:12.099 16:59:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:12.099 00:17:12.099 real 0m24.336s 00:17:12.099 user 1m25.795s 00:17:12.099 sys 0m6.592s 00:17:12.099 16:59:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:12.099 16:59:22 -- common/autotest_common.sh@10 -- # set +x 00:17:12.099 ************************************ 00:17:12.099 END TEST nvmf_fio_target 00:17:12.099 ************************************ 00:17:12.099 16:59:23 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:12.099 16:59:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:12.099 16:59:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:12.099 16:59:23 -- common/autotest_common.sh@10 -- # set +x 00:17:12.099 ************************************ 00:17:12.099 START TEST nvmf_bdevio 00:17:12.099 ************************************ 00:17:12.099 16:59:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:12.099 * Looking for test storage... 00:17:12.099 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:12.099 16:59:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:12.099 16:59:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:12.099 16:59:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:12.099 16:59:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:12.099 16:59:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:12.099 16:59:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:12.099 16:59:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:12.099 16:59:23 -- scripts/common.sh@335 -- # IFS=.-: 00:17:12.099 16:59:23 -- scripts/common.sh@335 -- # read -ra ver1 00:17:12.099 16:59:23 -- scripts/common.sh@336 -- # IFS=.-: 00:17:12.099 16:59:23 -- scripts/common.sh@336 -- # read -ra ver2 00:17:12.099 16:59:23 -- scripts/common.sh@337 -- # local 'op=<' 00:17:12.099 16:59:23 -- scripts/common.sh@339 -- # ver1_l=2 00:17:12.099 16:59:23 -- scripts/common.sh@340 -- # ver2_l=1 00:17:12.099 16:59:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:12.099 16:59:23 -- scripts/common.sh@343 -- # case "$op" in 00:17:12.099 16:59:23 -- scripts/common.sh@344 -- # : 1 00:17:12.099 16:59:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:12.099 16:59:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:12.099 16:59:23 -- scripts/common.sh@364 -- # decimal 1 00:17:12.099 16:59:23 -- scripts/common.sh@352 -- # local d=1 00:17:12.099 16:59:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:12.099 16:59:23 -- scripts/common.sh@354 -- # echo 1 00:17:12.099 16:59:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:12.099 16:59:23 -- scripts/common.sh@365 -- # decimal 2 00:17:12.099 16:59:23 -- scripts/common.sh@352 -- # local d=2 00:17:12.099 16:59:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:12.099 16:59:23 -- scripts/common.sh@354 -- # echo 2 00:17:12.099 16:59:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:12.099 16:59:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:12.099 16:59:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:12.099 16:59:23 -- scripts/common.sh@367 -- # return 0 00:17:12.099 16:59:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:12.099 16:59:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:12.099 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.099 --rc genhtml_branch_coverage=1 00:17:12.099 --rc genhtml_function_coverage=1 00:17:12.099 --rc genhtml_legend=1 00:17:12.099 --rc geninfo_all_blocks=1 00:17:12.099 --rc geninfo_unexecuted_blocks=1 00:17:12.099 00:17:12.099 ' 00:17:12.099 16:59:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:12.099 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.099 --rc genhtml_branch_coverage=1 00:17:12.099 --rc genhtml_function_coverage=1 00:17:12.099 --rc genhtml_legend=1 00:17:12.099 --rc geninfo_all_blocks=1 00:17:12.099 --rc geninfo_unexecuted_blocks=1 00:17:12.099 00:17:12.099 ' 00:17:12.099 16:59:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:12.099 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.099 --rc genhtml_branch_coverage=1 00:17:12.099 --rc genhtml_function_coverage=1 00:17:12.099 --rc genhtml_legend=1 00:17:12.099 --rc geninfo_all_blocks=1 00:17:12.099 --rc geninfo_unexecuted_blocks=1 00:17:12.099 00:17:12.099 ' 00:17:12.099 16:59:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:12.099 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.099 --rc genhtml_branch_coverage=1 00:17:12.099 --rc genhtml_function_coverage=1 00:17:12.099 --rc genhtml_legend=1 00:17:12.099 --rc geninfo_all_blocks=1 00:17:12.099 --rc geninfo_unexecuted_blocks=1 00:17:12.099 00:17:12.099 ' 00:17:12.099 16:59:23 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:12.099 16:59:23 -- nvmf/common.sh@7 -- # uname -s 00:17:12.099 16:59:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:12.099 16:59:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:12.099 16:59:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:12.099 16:59:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:12.099 16:59:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:12.099 16:59:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:12.099 16:59:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:12.099 16:59:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:12.099 16:59:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:12.099 16:59:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:12.099 16:59:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:12.099 16:59:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:12.099 16:59:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:12.099 16:59:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:12.099 16:59:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:12.099 16:59:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:12.099 16:59:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:12.099 16:59:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:12.099 16:59:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:12.099 16:59:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.100 16:59:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.100 16:59:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.100 16:59:23 -- paths/export.sh@5 -- # export PATH 00:17:12.100 16:59:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.100 16:59:23 -- nvmf/common.sh@46 -- # : 0 00:17:12.100 16:59:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:12.100 16:59:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:12.100 16:59:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:12.100 16:59:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:12.100 16:59:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:12.100 16:59:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:12.100 16:59:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:12.100 16:59:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:12.100 16:59:23 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:12.100 16:59:23 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:12.100 16:59:23 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:12.100 16:59:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:12.100 16:59:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:12.100 16:59:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:12.100 16:59:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:12.100 16:59:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:12.100 16:59:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:12.100 16:59:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:12.100 16:59:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:12.100 16:59:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:12.100 16:59:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:12.100 16:59:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:12.100 16:59:23 -- common/autotest_common.sh@10 -- # set +x 00:17:14.004 16:59:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:14.004 16:59:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:14.004 16:59:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:14.004 16:59:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:14.004 16:59:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:14.004 16:59:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:14.004 16:59:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:14.004 16:59:25 -- nvmf/common.sh@294 -- # net_devs=() 00:17:14.004 16:59:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:14.004 16:59:25 -- nvmf/common.sh@295 -- # e810=() 00:17:14.004 16:59:25 -- nvmf/common.sh@295 -- # local -ga e810 00:17:14.004 16:59:25 -- nvmf/common.sh@296 -- # x722=() 00:17:14.004 16:59:25 -- nvmf/common.sh@296 -- # local -ga x722 00:17:14.004 16:59:25 -- nvmf/common.sh@297 -- # mlx=() 00:17:14.004 16:59:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:14.004 16:59:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:14.004 16:59:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:14.004 16:59:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:14.004 16:59:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:14.004 16:59:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:14.004 16:59:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:14.004 16:59:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:14.004 16:59:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.004 16:59:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:14.004 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:14.005 16:59:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.005 16:59:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:14.005 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:14.005 16:59:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:14.005 16:59:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.005 16:59:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.005 16:59:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.005 16:59:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.005 16:59:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:14.005 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:14.005 16:59:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.005 16:59:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.005 16:59:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.005 16:59:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.005 16:59:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.005 16:59:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:14.005 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:14.005 16:59:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.005 16:59:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:14.005 16:59:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:14.005 16:59:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:14.005 16:59:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:14.005 16:59:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:14.005 16:59:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:14.005 16:59:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:14.005 16:59:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:14.005 16:59:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:14.005 16:59:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:14.005 16:59:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:14.005 16:59:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:14.005 16:59:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:14.005 16:59:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:14.005 16:59:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:14.005 16:59:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:14.005 16:59:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:14.005 16:59:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:14.005 16:59:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:14.005 16:59:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:14.005 16:59:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:14.005 16:59:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:14.005 16:59:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:14.005 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:14.005 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:17:14.005 00:17:14.005 --- 10.0.0.2 ping statistics --- 00:17:14.005 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.005 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:17:14.005 16:59:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:14.005 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:14.005 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:17:14.005 00:17:14.005 --- 10.0.0.1 ping statistics --- 00:17:14.005 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.005 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:17:14.005 16:59:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:14.005 16:59:25 -- nvmf/common.sh@410 -- # return 0 00:17:14.005 16:59:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:14.005 16:59:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:14.005 16:59:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:14.005 16:59:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:14.005 16:59:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:14.005 16:59:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:14.005 16:59:25 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:14.005 16:59:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:14.005 16:59:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:14.005 16:59:25 -- common/autotest_common.sh@10 -- # set +x 00:17:14.005 16:59:25 -- nvmf/common.sh@469 -- # nvmfpid=215453 00:17:14.005 16:59:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:14.005 16:59:25 -- nvmf/common.sh@470 -- # waitforlisten 215453 00:17:14.005 16:59:25 -- common/autotest_common.sh@829 -- # '[' -z 215453 ']' 00:17:14.005 16:59:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:14.005 16:59:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:14.005 16:59:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:14.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:14.005 16:59:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:14.005 16:59:25 -- common/autotest_common.sh@10 -- # set +x 00:17:14.005 [2024-11-29 16:59:25.352904] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:14.005 [2024-11-29 16:59:25.353003] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:14.005 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.005 [2024-11-29 16:59:25.422331] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:14.263 [2024-11-29 16:59:25.541785] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:14.263 [2024-11-29 16:59:25.541973] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:14.263 [2024-11-29 16:59:25.541996] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:14.263 [2024-11-29 16:59:25.542012] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:14.263 [2024-11-29 16:59:25.542120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:14.263 [2024-11-29 16:59:25.542166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:14.263 [2024-11-29 16:59:25.542223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:14.263 [2024-11-29 16:59:25.542226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:15.197 16:59:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:15.197 16:59:26 -- common/autotest_common.sh@862 -- # return 0 00:17:15.197 16:59:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:15.198 16:59:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:15.198 16:59:26 -- common/autotest_common.sh@10 -- # set +x 00:17:15.198 16:59:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:15.198 16:59:26 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:15.198 16:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.198 16:59:26 -- common/autotest_common.sh@10 -- # set +x 00:17:15.198 [2024-11-29 16:59:26.337472] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:15.198 16:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.198 16:59:26 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:15.198 16:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.198 16:59:26 -- common/autotest_common.sh@10 -- # set +x 00:17:15.198 Malloc0 00:17:15.198 16:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.198 16:59:26 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:15.198 16:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.198 16:59:26 -- common/autotest_common.sh@10 -- # set +x 00:17:15.198 16:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.198 16:59:26 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:15.198 16:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.198 16:59:26 -- common/autotest_common.sh@10 -- # set +x 00:17:15.198 16:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.198 16:59:26 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:15.198 16:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.198 16:59:26 -- common/autotest_common.sh@10 -- # set +x 00:17:15.198 [2024-11-29 16:59:26.388683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:15.198 16:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.198 16:59:26 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:15.198 16:59:26 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:15.198 16:59:26 -- nvmf/common.sh@520 -- # config=() 00:17:15.198 16:59:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:15.198 16:59:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:15.198 16:59:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:15.198 { 00:17:15.198 "params": { 00:17:15.198 "name": "Nvme$subsystem", 00:17:15.198 "trtype": "$TEST_TRANSPORT", 00:17:15.198 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:15.198 "adrfam": "ipv4", 00:17:15.198 "trsvcid": "$NVMF_PORT", 00:17:15.198 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:15.198 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:15.198 "hdgst": ${hdgst:-false}, 00:17:15.198 "ddgst": ${ddgst:-false} 00:17:15.198 }, 00:17:15.198 "method": "bdev_nvme_attach_controller" 00:17:15.198 } 00:17:15.198 EOF 00:17:15.198 )") 00:17:15.198 16:59:26 -- nvmf/common.sh@542 -- # cat 00:17:15.198 16:59:26 -- nvmf/common.sh@544 -- # jq . 00:17:15.198 16:59:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:15.198 16:59:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:15.198 "params": { 00:17:15.198 "name": "Nvme1", 00:17:15.198 "trtype": "tcp", 00:17:15.198 "traddr": "10.0.0.2", 00:17:15.198 "adrfam": "ipv4", 00:17:15.198 "trsvcid": "4420", 00:17:15.198 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:15.198 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:15.198 "hdgst": false, 00:17:15.198 "ddgst": false 00:17:15.198 }, 00:17:15.198 "method": "bdev_nvme_attach_controller" 00:17:15.198 }' 00:17:15.198 [2024-11-29 16:59:26.428009] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:15.198 [2024-11-29 16:59:26.428082] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid215616 ] 00:17:15.198 EAL: No free 2048 kB hugepages reported on node 1 00:17:15.198 [2024-11-29 16:59:26.487632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:15.198 [2024-11-29 16:59:26.596615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:15.198 [2024-11-29 16:59:26.596669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:15.198 [2024-11-29 16:59:26.596672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:15.765 [2024-11-29 16:59:26.890772] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:15.765 [2024-11-29 16:59:26.890818] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:15.765 I/O targets: 00:17:15.765 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:15.765 00:17:15.765 00:17:15.765 CUnit - A unit testing framework for C - Version 2.1-3 00:17:15.765 http://cunit.sourceforge.net/ 00:17:15.765 00:17:15.765 00:17:15.765 Suite: bdevio tests on: Nvme1n1 00:17:15.765 Test: blockdev write read block ...passed 00:17:15.765 Test: blockdev write zeroes read block ...passed 00:17:15.765 Test: blockdev write zeroes read no split ...passed 00:17:15.765 Test: blockdev write zeroes read split ...passed 00:17:15.765 Test: blockdev write zeroes read split partial ...passed 00:17:15.765 Test: blockdev reset ...[2024-11-29 16:59:27.045442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:15.765 [2024-11-29 16:59:27.045559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b9f20 (9): Bad file descriptor 00:17:15.765 [2024-11-29 16:59:27.100814] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:15.765 passed 00:17:15.765 Test: blockdev write read 8 blocks ...passed 00:17:15.765 Test: blockdev write read size > 128k ...passed 00:17:15.765 Test: blockdev write read invalid size ...passed 00:17:15.765 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:15.765 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:15.765 Test: blockdev write read max offset ...passed 00:17:16.024 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:16.024 Test: blockdev writev readv 8 blocks ...passed 00:17:16.024 Test: blockdev writev readv 30 x 1block ...passed 00:17:16.025 Test: blockdev writev readv block ...passed 00:17:16.025 Test: blockdev writev readv size > 128k ...passed 00:17:16.025 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:16.025 Test: blockdev comparev and writev ...[2024-11-29 16:59:27.353291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.025 [2024-11-29 16:59:27.353328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.353353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.025 [2024-11-29 16:59:27.353371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.353723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.025 [2024-11-29 16:59:27.353748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.353770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.025 [2024-11-29 16:59:27.353787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.354140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.025 [2024-11-29 16:59:27.354176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.354199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.025 [2024-11-29 16:59:27.354216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.354538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.025 [2024-11-29 16:59:27.354563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.354586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.025 [2024-11-29 16:59:27.354603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:16.025 passed 00:17:16.025 Test: blockdev nvme passthru rw ...passed 00:17:16.025 Test: blockdev nvme passthru vendor specific ...[2024-11-29 16:59:27.437234] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.025 [2024-11-29 16:59:27.437262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.437398] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.025 [2024-11-29 16:59:27.437423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.437561] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.025 [2024-11-29 16:59:27.437584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:16.025 [2024-11-29 16:59:27.437724] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.025 [2024-11-29 16:59:27.437746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:16.025 passed 00:17:16.283 Test: blockdev nvme admin passthru ...passed 00:17:16.283 Test: blockdev copy ...passed 00:17:16.283 00:17:16.283 Run Summary: Type Total Ran Passed Failed Inactive 00:17:16.283 suites 1 1 n/a 0 0 00:17:16.283 tests 23 23 23 0 0 00:17:16.283 asserts 152 152 152 0 n/a 00:17:16.283 00:17:16.283 Elapsed time = 1.213 seconds 00:17:16.542 16:59:27 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:16.542 16:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.542 16:59:27 -- common/autotest_common.sh@10 -- # set +x 00:17:16.542 16:59:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.542 16:59:27 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:16.542 16:59:27 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:16.542 16:59:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:16.542 16:59:27 -- nvmf/common.sh@116 -- # sync 00:17:16.542 16:59:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:16.542 16:59:27 -- nvmf/common.sh@119 -- # set +e 00:17:16.542 16:59:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:16.542 16:59:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:16.542 rmmod nvme_tcp 00:17:16.542 rmmod nvme_fabrics 00:17:16.542 rmmod nvme_keyring 00:17:16.542 16:59:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:16.542 16:59:27 -- nvmf/common.sh@123 -- # set -e 00:17:16.542 16:59:27 -- nvmf/common.sh@124 -- # return 0 00:17:16.542 16:59:27 -- nvmf/common.sh@477 -- # '[' -n 215453 ']' 00:17:16.542 16:59:27 -- nvmf/common.sh@478 -- # killprocess 215453 00:17:16.542 16:59:27 -- common/autotest_common.sh@936 -- # '[' -z 215453 ']' 00:17:16.542 16:59:27 -- common/autotest_common.sh@940 -- # kill -0 215453 00:17:16.542 16:59:27 -- common/autotest_common.sh@941 -- # uname 00:17:16.542 16:59:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:16.542 16:59:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 215453 00:17:16.542 16:59:27 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:16.542 16:59:27 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:16.542 16:59:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 215453' 00:17:16.542 killing process with pid 215453 00:17:16.542 16:59:27 -- common/autotest_common.sh@955 -- # kill 215453 00:17:16.542 16:59:27 -- common/autotest_common.sh@960 -- # wait 215453 00:17:16.800 16:59:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:16.800 16:59:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:16.800 16:59:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:16.800 16:59:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:16.800 16:59:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:16.800 16:59:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:16.800 16:59:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:16.800 16:59:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:19.340 16:59:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:19.340 00:17:19.340 real 0m7.142s 00:17:19.340 user 0m13.659s 00:17:19.340 sys 0m2.098s 00:17:19.340 16:59:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:19.340 16:59:30 -- common/autotest_common.sh@10 -- # set +x 00:17:19.340 ************************************ 00:17:19.340 END TEST nvmf_bdevio 00:17:19.340 ************************************ 00:17:19.340 16:59:30 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:19.340 16:59:30 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:19.340 16:59:30 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:19.340 16:59:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:19.340 16:59:30 -- common/autotest_common.sh@10 -- # set +x 00:17:19.340 ************************************ 00:17:19.340 START TEST nvmf_bdevio_no_huge 00:17:19.340 ************************************ 00:17:19.340 16:59:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:19.340 * Looking for test storage... 00:17:19.340 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:19.340 16:59:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:19.340 16:59:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:19.340 16:59:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:19.340 16:59:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:19.340 16:59:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:19.340 16:59:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:19.340 16:59:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:19.340 16:59:30 -- scripts/common.sh@335 -- # IFS=.-: 00:17:19.340 16:59:30 -- scripts/common.sh@335 -- # read -ra ver1 00:17:19.340 16:59:30 -- scripts/common.sh@336 -- # IFS=.-: 00:17:19.340 16:59:30 -- scripts/common.sh@336 -- # read -ra ver2 00:17:19.340 16:59:30 -- scripts/common.sh@337 -- # local 'op=<' 00:17:19.340 16:59:30 -- scripts/common.sh@339 -- # ver1_l=2 00:17:19.340 16:59:30 -- scripts/common.sh@340 -- # ver2_l=1 00:17:19.340 16:59:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:19.340 16:59:30 -- scripts/common.sh@343 -- # case "$op" in 00:17:19.340 16:59:30 -- scripts/common.sh@344 -- # : 1 00:17:19.340 16:59:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:19.340 16:59:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:19.340 16:59:30 -- scripts/common.sh@364 -- # decimal 1 00:17:19.340 16:59:30 -- scripts/common.sh@352 -- # local d=1 00:17:19.340 16:59:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:19.340 16:59:30 -- scripts/common.sh@354 -- # echo 1 00:17:19.340 16:59:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:19.340 16:59:30 -- scripts/common.sh@365 -- # decimal 2 00:17:19.340 16:59:30 -- scripts/common.sh@352 -- # local d=2 00:17:19.340 16:59:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:19.340 16:59:30 -- scripts/common.sh@354 -- # echo 2 00:17:19.340 16:59:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:19.340 16:59:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:19.340 16:59:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:19.340 16:59:30 -- scripts/common.sh@367 -- # return 0 00:17:19.340 16:59:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:19.340 16:59:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:19.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.340 --rc genhtml_branch_coverage=1 00:17:19.340 --rc genhtml_function_coverage=1 00:17:19.340 --rc genhtml_legend=1 00:17:19.340 --rc geninfo_all_blocks=1 00:17:19.340 --rc geninfo_unexecuted_blocks=1 00:17:19.340 00:17:19.340 ' 00:17:19.340 16:59:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:19.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.340 --rc genhtml_branch_coverage=1 00:17:19.340 --rc genhtml_function_coverage=1 00:17:19.340 --rc genhtml_legend=1 00:17:19.340 --rc geninfo_all_blocks=1 00:17:19.340 --rc geninfo_unexecuted_blocks=1 00:17:19.340 00:17:19.340 ' 00:17:19.340 16:59:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:19.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.340 --rc genhtml_branch_coverage=1 00:17:19.340 --rc genhtml_function_coverage=1 00:17:19.340 --rc genhtml_legend=1 00:17:19.341 --rc geninfo_all_blocks=1 00:17:19.341 --rc geninfo_unexecuted_blocks=1 00:17:19.341 00:17:19.341 ' 00:17:19.341 16:59:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:19.341 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.341 --rc genhtml_branch_coverage=1 00:17:19.341 --rc genhtml_function_coverage=1 00:17:19.341 --rc genhtml_legend=1 00:17:19.341 --rc geninfo_all_blocks=1 00:17:19.341 --rc geninfo_unexecuted_blocks=1 00:17:19.341 00:17:19.341 ' 00:17:19.341 16:59:30 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:19.341 16:59:30 -- nvmf/common.sh@7 -- # uname -s 00:17:19.341 16:59:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:19.341 16:59:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:19.341 16:59:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:19.341 16:59:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:19.341 16:59:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:19.341 16:59:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:19.341 16:59:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:19.341 16:59:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:19.341 16:59:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:19.341 16:59:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:19.341 16:59:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:19.341 16:59:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:19.341 16:59:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:19.341 16:59:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:19.341 16:59:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:19.341 16:59:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:19.341 16:59:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:19.341 16:59:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:19.341 16:59:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:19.341 16:59:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.341 16:59:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.341 16:59:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.341 16:59:30 -- paths/export.sh@5 -- # export PATH 00:17:19.341 16:59:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.341 16:59:30 -- nvmf/common.sh@46 -- # : 0 00:17:19.341 16:59:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:19.341 16:59:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:19.341 16:59:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:19.341 16:59:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:19.341 16:59:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:19.341 16:59:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:19.341 16:59:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:19.341 16:59:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:19.341 16:59:30 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:19.341 16:59:30 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:19.341 16:59:30 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:19.341 16:59:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:19.341 16:59:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:19.341 16:59:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:19.341 16:59:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:19.341 16:59:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:19.341 16:59:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:19.341 16:59:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:19.341 16:59:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:19.341 16:59:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:19.341 16:59:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:19.341 16:59:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:19.341 16:59:30 -- common/autotest_common.sh@10 -- # set +x 00:17:21.246 16:59:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:21.246 16:59:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:21.246 16:59:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:21.246 16:59:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:21.246 16:59:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:21.246 16:59:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:21.246 16:59:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:21.246 16:59:32 -- nvmf/common.sh@294 -- # net_devs=() 00:17:21.246 16:59:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:21.246 16:59:32 -- nvmf/common.sh@295 -- # e810=() 00:17:21.246 16:59:32 -- nvmf/common.sh@295 -- # local -ga e810 00:17:21.246 16:59:32 -- nvmf/common.sh@296 -- # x722=() 00:17:21.246 16:59:32 -- nvmf/common.sh@296 -- # local -ga x722 00:17:21.246 16:59:32 -- nvmf/common.sh@297 -- # mlx=() 00:17:21.246 16:59:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:21.246 16:59:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:21.246 16:59:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:21.246 16:59:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:21.246 16:59:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:21.246 16:59:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:21.246 16:59:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:21.246 16:59:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:21.246 16:59:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:21.246 16:59:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:21.246 16:59:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:21.247 16:59:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:21.247 16:59:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:21.247 16:59:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:21.247 16:59:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:21.247 16:59:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:21.247 16:59:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:21.247 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:21.247 16:59:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:21.247 16:59:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:21.247 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:21.247 16:59:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:21.247 16:59:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:21.247 16:59:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:21.247 16:59:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:21.247 16:59:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:21.247 16:59:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:21.247 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:21.247 16:59:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:21.247 16:59:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:21.247 16:59:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:21.247 16:59:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:21.247 16:59:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:21.247 16:59:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:21.247 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:21.247 16:59:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:21.247 16:59:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:21.247 16:59:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:21.247 16:59:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:21.247 16:59:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:21.247 16:59:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:21.247 16:59:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:21.247 16:59:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:21.247 16:59:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:21.247 16:59:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:21.247 16:59:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:21.247 16:59:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:21.247 16:59:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:21.247 16:59:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:21.247 16:59:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:21.247 16:59:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:21.247 16:59:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:21.247 16:59:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:21.247 16:59:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:21.247 16:59:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:21.247 16:59:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:21.247 16:59:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:21.247 16:59:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:21.247 16:59:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:21.247 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:21.247 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:17:21.247 00:17:21.247 --- 10.0.0.2 ping statistics --- 00:17:21.247 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:21.247 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:17:21.247 16:59:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:21.247 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:21.247 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:17:21.247 00:17:21.247 --- 10.0.0.1 ping statistics --- 00:17:21.247 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:21.247 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:17:21.247 16:59:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:21.247 16:59:32 -- nvmf/common.sh@410 -- # return 0 00:17:21.247 16:59:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:21.247 16:59:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:21.247 16:59:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:21.247 16:59:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:21.247 16:59:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:21.247 16:59:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:21.247 16:59:32 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:21.247 16:59:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:21.247 16:59:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:21.247 16:59:32 -- common/autotest_common.sh@10 -- # set +x 00:17:21.247 16:59:32 -- nvmf/common.sh@469 -- # nvmfpid=217788 00:17:21.247 16:59:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:21.247 16:59:32 -- nvmf/common.sh@470 -- # waitforlisten 217788 00:17:21.247 16:59:32 -- common/autotest_common.sh@829 -- # '[' -z 217788 ']' 00:17:21.247 16:59:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:21.247 16:59:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:21.247 16:59:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:21.247 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:21.247 16:59:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:21.247 16:59:32 -- common/autotest_common.sh@10 -- # set +x 00:17:21.247 [2024-11-29 16:59:32.536345] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:21.247 [2024-11-29 16:59:32.536421] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:21.247 [2024-11-29 16:59:32.608804] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:21.507 [2024-11-29 16:59:32.713526] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:21.507 [2024-11-29 16:59:32.713673] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:21.507 [2024-11-29 16:59:32.713701] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:21.507 [2024-11-29 16:59:32.713714] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:21.507 [2024-11-29 16:59:32.713787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:21.507 [2024-11-29 16:59:32.713876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:21.507 [2024-11-29 16:59:32.713918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:21.507 [2024-11-29 16:59:32.713921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:22.443 16:59:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:22.443 16:59:33 -- common/autotest_common.sh@862 -- # return 0 00:17:22.443 16:59:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:22.443 16:59:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:22.443 16:59:33 -- common/autotest_common.sh@10 -- # set +x 00:17:22.443 16:59:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:22.443 16:59:33 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:22.443 16:59:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.443 16:59:33 -- common/autotest_common.sh@10 -- # set +x 00:17:22.443 [2024-11-29 16:59:33.588289] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:22.443 16:59:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.443 16:59:33 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:22.443 16:59:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.443 16:59:33 -- common/autotest_common.sh@10 -- # set +x 00:17:22.443 Malloc0 00:17:22.443 16:59:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.443 16:59:33 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:22.443 16:59:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.443 16:59:33 -- common/autotest_common.sh@10 -- # set +x 00:17:22.443 16:59:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.443 16:59:33 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:22.443 16:59:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.443 16:59:33 -- common/autotest_common.sh@10 -- # set +x 00:17:22.443 16:59:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.443 16:59:33 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:22.443 16:59:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.443 16:59:33 -- common/autotest_common.sh@10 -- # set +x 00:17:22.443 [2024-11-29 16:59:33.626334] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:22.443 16:59:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.443 16:59:33 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:22.443 16:59:33 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:22.443 16:59:33 -- nvmf/common.sh@520 -- # config=() 00:17:22.443 16:59:33 -- nvmf/common.sh@520 -- # local subsystem config 00:17:22.443 16:59:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:22.443 16:59:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:22.443 { 00:17:22.443 "params": { 00:17:22.443 "name": "Nvme$subsystem", 00:17:22.443 "trtype": "$TEST_TRANSPORT", 00:17:22.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:22.443 "adrfam": "ipv4", 00:17:22.443 "trsvcid": "$NVMF_PORT", 00:17:22.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:22.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:22.443 "hdgst": ${hdgst:-false}, 00:17:22.443 "ddgst": ${ddgst:-false} 00:17:22.443 }, 00:17:22.443 "method": "bdev_nvme_attach_controller" 00:17:22.443 } 00:17:22.443 EOF 00:17:22.443 )") 00:17:22.443 16:59:33 -- nvmf/common.sh@542 -- # cat 00:17:22.443 16:59:33 -- nvmf/common.sh@544 -- # jq . 00:17:22.443 16:59:33 -- nvmf/common.sh@545 -- # IFS=, 00:17:22.443 16:59:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:22.443 "params": { 00:17:22.443 "name": "Nvme1", 00:17:22.443 "trtype": "tcp", 00:17:22.443 "traddr": "10.0.0.2", 00:17:22.443 "adrfam": "ipv4", 00:17:22.443 "trsvcid": "4420", 00:17:22.443 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:22.443 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:22.443 "hdgst": false, 00:17:22.443 "ddgst": false 00:17:22.443 }, 00:17:22.443 "method": "bdev_nvme_attach_controller" 00:17:22.443 }' 00:17:22.443 [2024-11-29 16:59:33.672453] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:22.443 [2024-11-29 16:59:33.672541] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid217949 ] 00:17:22.443 [2024-11-29 16:59:33.739429] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:22.443 [2024-11-29 16:59:33.852270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:22.443 [2024-11-29 16:59:33.852321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:22.443 [2024-11-29 16:59:33.852324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:22.703 [2024-11-29 16:59:34.050902] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:22.703 [2024-11-29 16:59:34.050954] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:22.703 I/O targets: 00:17:22.703 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:22.703 00:17:22.703 00:17:22.703 CUnit - A unit testing framework for C - Version 2.1-3 00:17:22.703 http://cunit.sourceforge.net/ 00:17:22.703 00:17:22.703 00:17:22.703 Suite: bdevio tests on: Nvme1n1 00:17:22.703 Test: blockdev write read block ...passed 00:17:22.961 Test: blockdev write zeroes read block ...passed 00:17:22.961 Test: blockdev write zeroes read no split ...passed 00:17:22.961 Test: blockdev write zeroes read split ...passed 00:17:22.961 Test: blockdev write zeroes read split partial ...passed 00:17:22.961 Test: blockdev reset ...[2024-11-29 16:59:34.210193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:22.961 [2024-11-29 16:59:34.210301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21337d0 (9): Bad file descriptor 00:17:22.961 [2024-11-29 16:59:34.320838] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:22.961 passed 00:17:22.961 Test: blockdev write read 8 blocks ...passed 00:17:22.961 Test: blockdev write read size > 128k ...passed 00:17:22.961 Test: blockdev write read invalid size ...passed 00:17:23.219 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:23.219 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:23.219 Test: blockdev write read max offset ...passed 00:17:23.219 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:23.219 Test: blockdev writev readv 8 blocks ...passed 00:17:23.219 Test: blockdev writev readv 30 x 1block ...passed 00:17:23.219 Test: blockdev writev readv block ...passed 00:17:23.219 Test: blockdev writev readv size > 128k ...passed 00:17:23.219 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:23.219 Test: blockdev comparev and writev ...[2024-11-29 16:59:34.575845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:23.219 [2024-11-29 16:59:34.575883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:23.219 [2024-11-29 16:59:34.575908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:23.219 [2024-11-29 16:59:34.575925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:23.219 [2024-11-29 16:59:34.576254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:23.219 [2024-11-29 16:59:34.576279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:23.219 [2024-11-29 16:59:34.576302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:23.219 [2024-11-29 16:59:34.576319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:23.219 [2024-11-29 16:59:34.576643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:23.219 [2024-11-29 16:59:34.576669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:23.219 [2024-11-29 16:59:34.576690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:23.219 [2024-11-29 16:59:34.576708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:23.219 [2024-11-29 16:59:34.577034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:23.219 [2024-11-29 16:59:34.577060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:23.219 [2024-11-29 16:59:34.577083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:23.219 [2024-11-29 16:59:34.577100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:23.219 passed 00:17:23.477 Test: blockdev nvme passthru rw ...passed 00:17:23.477 Test: blockdev nvme passthru vendor specific ...[2024-11-29 16:59:34.661216] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:23.477 [2024-11-29 16:59:34.661247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:23.477 [2024-11-29 16:59:34.661395] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:23.477 [2024-11-29 16:59:34.661419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:23.477 [2024-11-29 16:59:34.661553] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:23.477 [2024-11-29 16:59:34.661577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:23.477 [2024-11-29 16:59:34.661710] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:23.477 [2024-11-29 16:59:34.661733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:23.477 passed 00:17:23.477 Test: blockdev nvme admin passthru ...passed 00:17:23.477 Test: blockdev copy ...passed 00:17:23.477 00:17:23.477 Run Summary: Type Total Ran Passed Failed Inactive 00:17:23.477 suites 1 1 n/a 0 0 00:17:23.477 tests 23 23 23 0 0 00:17:23.477 asserts 152 152 152 0 n/a 00:17:23.477 00:17:23.477 Elapsed time = 1.345 seconds 00:17:23.736 16:59:35 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:23.736 16:59:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:23.736 16:59:35 -- common/autotest_common.sh@10 -- # set +x 00:17:23.736 16:59:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:23.736 16:59:35 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:23.736 16:59:35 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:23.736 16:59:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:23.736 16:59:35 -- nvmf/common.sh@116 -- # sync 00:17:23.736 16:59:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:23.736 16:59:35 -- nvmf/common.sh@119 -- # set +e 00:17:23.736 16:59:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:23.736 16:59:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:23.736 rmmod nvme_tcp 00:17:23.736 rmmod nvme_fabrics 00:17:23.736 rmmod nvme_keyring 00:17:23.736 16:59:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:23.736 16:59:35 -- nvmf/common.sh@123 -- # set -e 00:17:23.736 16:59:35 -- nvmf/common.sh@124 -- # return 0 00:17:23.736 16:59:35 -- nvmf/common.sh@477 -- # '[' -n 217788 ']' 00:17:23.736 16:59:35 -- nvmf/common.sh@478 -- # killprocess 217788 00:17:23.736 16:59:35 -- common/autotest_common.sh@936 -- # '[' -z 217788 ']' 00:17:23.736 16:59:35 -- common/autotest_common.sh@940 -- # kill -0 217788 00:17:24.001 16:59:35 -- common/autotest_common.sh@941 -- # uname 00:17:24.001 16:59:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:24.001 16:59:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 217788 00:17:24.001 16:59:35 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:24.001 16:59:35 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:24.001 16:59:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 217788' 00:17:24.001 killing process with pid 217788 00:17:24.001 16:59:35 -- common/autotest_common.sh@955 -- # kill 217788 00:17:24.001 16:59:35 -- common/autotest_common.sh@960 -- # wait 217788 00:17:24.263 16:59:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:24.263 16:59:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:24.263 16:59:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:24.263 16:59:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:24.263 16:59:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:24.263 16:59:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:24.263 16:59:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:24.263 16:59:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:26.799 16:59:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:26.799 00:17:26.799 real 0m7.483s 00:17:26.799 user 0m14.613s 00:17:26.799 sys 0m2.572s 00:17:26.799 16:59:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:26.799 16:59:37 -- common/autotest_common.sh@10 -- # set +x 00:17:26.799 ************************************ 00:17:26.799 END TEST nvmf_bdevio_no_huge 00:17:26.799 ************************************ 00:17:26.799 16:59:37 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:26.799 16:59:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:26.799 16:59:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:26.799 16:59:37 -- common/autotest_common.sh@10 -- # set +x 00:17:26.799 ************************************ 00:17:26.799 START TEST nvmf_tls 00:17:26.799 ************************************ 00:17:26.799 16:59:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:26.799 * Looking for test storage... 00:17:26.799 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:26.799 16:59:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:26.799 16:59:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:26.799 16:59:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:26.799 16:59:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:26.799 16:59:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:26.799 16:59:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:26.799 16:59:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:26.799 16:59:37 -- scripts/common.sh@335 -- # IFS=.-: 00:17:26.799 16:59:37 -- scripts/common.sh@335 -- # read -ra ver1 00:17:26.799 16:59:37 -- scripts/common.sh@336 -- # IFS=.-: 00:17:26.799 16:59:37 -- scripts/common.sh@336 -- # read -ra ver2 00:17:26.799 16:59:37 -- scripts/common.sh@337 -- # local 'op=<' 00:17:26.799 16:59:37 -- scripts/common.sh@339 -- # ver1_l=2 00:17:26.799 16:59:37 -- scripts/common.sh@340 -- # ver2_l=1 00:17:26.799 16:59:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:26.799 16:59:37 -- scripts/common.sh@343 -- # case "$op" in 00:17:26.799 16:59:37 -- scripts/common.sh@344 -- # : 1 00:17:26.799 16:59:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:26.799 16:59:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:26.799 16:59:37 -- scripts/common.sh@364 -- # decimal 1 00:17:26.799 16:59:37 -- scripts/common.sh@352 -- # local d=1 00:17:26.799 16:59:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:26.799 16:59:37 -- scripts/common.sh@354 -- # echo 1 00:17:26.799 16:59:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:26.799 16:59:37 -- scripts/common.sh@365 -- # decimal 2 00:17:26.799 16:59:37 -- scripts/common.sh@352 -- # local d=2 00:17:26.799 16:59:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:26.799 16:59:37 -- scripts/common.sh@354 -- # echo 2 00:17:26.799 16:59:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:26.799 16:59:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:26.799 16:59:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:26.799 16:59:37 -- scripts/common.sh@367 -- # return 0 00:17:26.799 16:59:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:26.799 16:59:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:26.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.799 --rc genhtml_branch_coverage=1 00:17:26.799 --rc genhtml_function_coverage=1 00:17:26.799 --rc genhtml_legend=1 00:17:26.799 --rc geninfo_all_blocks=1 00:17:26.799 --rc geninfo_unexecuted_blocks=1 00:17:26.799 00:17:26.799 ' 00:17:26.799 16:59:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:26.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.799 --rc genhtml_branch_coverage=1 00:17:26.799 --rc genhtml_function_coverage=1 00:17:26.799 --rc genhtml_legend=1 00:17:26.799 --rc geninfo_all_blocks=1 00:17:26.799 --rc geninfo_unexecuted_blocks=1 00:17:26.799 00:17:26.799 ' 00:17:26.799 16:59:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:26.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.799 --rc genhtml_branch_coverage=1 00:17:26.799 --rc genhtml_function_coverage=1 00:17:26.799 --rc genhtml_legend=1 00:17:26.799 --rc geninfo_all_blocks=1 00:17:26.799 --rc geninfo_unexecuted_blocks=1 00:17:26.799 00:17:26.799 ' 00:17:26.799 16:59:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:26.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.799 --rc genhtml_branch_coverage=1 00:17:26.799 --rc genhtml_function_coverage=1 00:17:26.799 --rc genhtml_legend=1 00:17:26.799 --rc geninfo_all_blocks=1 00:17:26.799 --rc geninfo_unexecuted_blocks=1 00:17:26.799 00:17:26.799 ' 00:17:26.799 16:59:37 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:26.799 16:59:37 -- nvmf/common.sh@7 -- # uname -s 00:17:26.799 16:59:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:26.799 16:59:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:26.799 16:59:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:26.799 16:59:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:26.799 16:59:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:26.799 16:59:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:26.799 16:59:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:26.799 16:59:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:26.799 16:59:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:26.799 16:59:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:26.799 16:59:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:26.799 16:59:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:26.799 16:59:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:26.799 16:59:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:26.799 16:59:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:26.799 16:59:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:26.799 16:59:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:26.799 16:59:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:26.799 16:59:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:26.800 16:59:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.800 16:59:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.800 16:59:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.800 16:59:37 -- paths/export.sh@5 -- # export PATH 00:17:26.800 16:59:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.800 16:59:37 -- nvmf/common.sh@46 -- # : 0 00:17:26.800 16:59:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:26.800 16:59:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:26.800 16:59:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:26.800 16:59:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:26.800 16:59:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:26.800 16:59:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:26.800 16:59:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:26.800 16:59:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:26.800 16:59:37 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:26.800 16:59:37 -- target/tls.sh@71 -- # nvmftestinit 00:17:26.800 16:59:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:26.800 16:59:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:26.800 16:59:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:26.800 16:59:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:26.800 16:59:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:26.800 16:59:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:26.800 16:59:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:26.800 16:59:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:26.800 16:59:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:26.800 16:59:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:26.800 16:59:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:26.800 16:59:37 -- common/autotest_common.sh@10 -- # set +x 00:17:28.705 16:59:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:28.705 16:59:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:28.705 16:59:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:28.705 16:59:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:28.705 16:59:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:28.705 16:59:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:28.705 16:59:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:28.705 16:59:39 -- nvmf/common.sh@294 -- # net_devs=() 00:17:28.705 16:59:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:28.705 16:59:39 -- nvmf/common.sh@295 -- # e810=() 00:17:28.705 16:59:39 -- nvmf/common.sh@295 -- # local -ga e810 00:17:28.705 16:59:39 -- nvmf/common.sh@296 -- # x722=() 00:17:28.705 16:59:39 -- nvmf/common.sh@296 -- # local -ga x722 00:17:28.705 16:59:39 -- nvmf/common.sh@297 -- # mlx=() 00:17:28.705 16:59:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:28.705 16:59:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:28.705 16:59:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:28.705 16:59:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:28.705 16:59:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:28.705 16:59:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:28.705 16:59:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:28.705 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:28.705 16:59:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:28.705 16:59:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:28.705 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:28.705 16:59:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:28.705 16:59:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:28.705 16:59:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:28.705 16:59:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:28.705 16:59:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:28.705 16:59:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:28.705 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:28.705 16:59:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:28.705 16:59:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:28.705 16:59:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:28.705 16:59:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:28.705 16:59:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:28.705 16:59:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:28.705 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:28.705 16:59:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:28.705 16:59:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:28.705 16:59:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:28.705 16:59:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:28.705 16:59:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:28.705 16:59:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:28.705 16:59:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:28.705 16:59:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:28.705 16:59:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:28.705 16:59:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:28.705 16:59:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:28.705 16:59:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:28.705 16:59:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:28.705 16:59:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:28.705 16:59:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:28.705 16:59:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:28.705 16:59:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:28.705 16:59:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:28.705 16:59:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:28.705 16:59:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:28.705 16:59:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:28.705 16:59:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:28.705 16:59:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:28.705 16:59:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:28.705 16:59:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:28.705 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:28.705 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:17:28.705 00:17:28.705 --- 10.0.0.2 ping statistics --- 00:17:28.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:28.705 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:17:28.706 16:59:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:28.706 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:28.706 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:17:28.706 00:17:28.706 --- 10.0.0.1 ping statistics --- 00:17:28.706 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:28.706 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:17:28.706 16:59:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:28.706 16:59:40 -- nvmf/common.sh@410 -- # return 0 00:17:28.706 16:59:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:28.706 16:59:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:28.706 16:59:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:28.706 16:59:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:28.706 16:59:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:28.706 16:59:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:28.706 16:59:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:28.706 16:59:40 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:28.706 16:59:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:28.706 16:59:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:28.706 16:59:40 -- common/autotest_common.sh@10 -- # set +x 00:17:28.706 16:59:40 -- nvmf/common.sh@469 -- # nvmfpid=220085 00:17:28.706 16:59:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:28.706 16:59:40 -- nvmf/common.sh@470 -- # waitforlisten 220085 00:17:28.706 16:59:40 -- common/autotest_common.sh@829 -- # '[' -z 220085 ']' 00:17:28.706 16:59:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:28.706 16:59:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:28.706 16:59:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:28.706 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:28.706 16:59:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:28.706 16:59:40 -- common/autotest_common.sh@10 -- # set +x 00:17:28.706 [2024-11-29 16:59:40.111405] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:28.706 [2024-11-29 16:59:40.111503] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:28.965 EAL: No free 2048 kB hugepages reported on node 1 00:17:28.965 [2024-11-29 16:59:40.186036] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:28.965 [2024-11-29 16:59:40.299850] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:28.965 [2024-11-29 16:59:40.300038] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:28.965 [2024-11-29 16:59:40.300060] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:28.965 [2024-11-29 16:59:40.300075] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:28.965 [2024-11-29 16:59:40.300115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:28.965 16:59:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:28.965 16:59:40 -- common/autotest_common.sh@862 -- # return 0 00:17:28.965 16:59:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:28.965 16:59:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:28.965 16:59:40 -- common/autotest_common.sh@10 -- # set +x 00:17:28.965 16:59:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:28.965 16:59:40 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:28.965 16:59:40 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:29.224 true 00:17:29.224 16:59:40 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:29.224 16:59:40 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:29.483 16:59:40 -- target/tls.sh@82 -- # version=0 00:17:29.483 16:59:40 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:29.483 16:59:40 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:29.741 16:59:41 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:29.741 16:59:41 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:30.000 16:59:41 -- target/tls.sh@90 -- # version=13 00:17:30.000 16:59:41 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:30.000 16:59:41 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:30.258 16:59:41 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:30.258 16:59:41 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:30.517 16:59:41 -- target/tls.sh@98 -- # version=7 00:17:30.517 16:59:41 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:30.517 16:59:41 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:30.517 16:59:41 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:30.776 16:59:42 -- target/tls.sh@105 -- # ktls=false 00:17:30.776 16:59:42 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:30.776 16:59:42 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:31.034 16:59:42 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:31.034 16:59:42 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:31.293 16:59:42 -- target/tls.sh@113 -- # ktls=true 00:17:31.293 16:59:42 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:31.293 16:59:42 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:31.552 16:59:42 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:31.552 16:59:42 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:31.811 16:59:43 -- target/tls.sh@121 -- # ktls=false 00:17:31.811 16:59:43 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:31.811 16:59:43 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:31.811 16:59:43 -- target/tls.sh@49 -- # local key hash crc 00:17:31.811 16:59:43 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:31.811 16:59:43 -- target/tls.sh@51 -- # hash=01 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # gzip -1 -c 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # tail -c8 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # head -c 4 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # crc='p$H�' 00:17:31.811 16:59:43 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:31.811 16:59:43 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:31.811 16:59:43 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:31.811 16:59:43 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:31.811 16:59:43 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:31.811 16:59:43 -- target/tls.sh@49 -- # local key hash crc 00:17:31.811 16:59:43 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:31.811 16:59:43 -- target/tls.sh@51 -- # hash=01 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # gzip -1 -c 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # tail -c8 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # head -c 4 00:17:31.811 16:59:43 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:31.811 16:59:43 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:31.811 16:59:43 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:31.811 16:59:43 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:31.811 16:59:43 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:31.811 16:59:43 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:31.811 16:59:43 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:31.811 16:59:43 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:31.811 16:59:43 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:31.811 16:59:43 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:31.811 16:59:43 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:31.811 16:59:43 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:32.069 16:59:43 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:32.635 16:59:43 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:32.635 16:59:43 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:32.635 16:59:43 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:32.635 [2024-11-29 16:59:44.019862] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:32.635 16:59:44 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:32.893 16:59:44 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:33.151 [2024-11-29 16:59:44.513175] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:33.151 [2024-11-29 16:59:44.513454] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:33.151 16:59:44 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:33.410 malloc0 00:17:33.410 16:59:44 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:33.669 16:59:45 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:33.925 16:59:45 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:33.925 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.125 Initializing NVMe Controllers 00:17:46.125 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:46.125 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:46.125 Initialization complete. Launching workers. 00:17:46.125 ======================================================== 00:17:46.125 Latency(us) 00:17:46.125 Device Information : IOPS MiB/s Average min max 00:17:46.125 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7670.57 29.96 8346.27 1248.01 9514.60 00:17:46.125 ======================================================== 00:17:46.125 Total : 7670.57 29.96 8346.27 1248.01 9514.60 00:17:46.125 00:17:46.125 16:59:55 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:46.125 16:59:55 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:46.125 16:59:55 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:46.125 16:59:55 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:46.125 16:59:55 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:46.125 16:59:55 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:46.125 16:59:55 -- target/tls.sh@28 -- # bdevperf_pid=222039 00:17:46.125 16:59:55 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:46.125 16:59:55 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:46.125 16:59:55 -- target/tls.sh@31 -- # waitforlisten 222039 /var/tmp/bdevperf.sock 00:17:46.125 16:59:55 -- common/autotest_common.sh@829 -- # '[' -z 222039 ']' 00:17:46.125 16:59:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:46.125 16:59:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:46.125 16:59:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:46.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:46.125 16:59:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:46.125 16:59:55 -- common/autotest_common.sh@10 -- # set +x 00:17:46.125 [2024-11-29 16:59:55.434561] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:46.125 [2024-11-29 16:59:55.434650] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid222039 ] 00:17:46.125 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.125 [2024-11-29 16:59:55.493340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.125 [2024-11-29 16:59:55.599644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:46.125 16:59:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.125 16:59:56 -- common/autotest_common.sh@862 -- # return 0 00:17:46.125 16:59:56 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:46.125 [2024-11-29 16:59:56.702881] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:46.125 TLSTESTn1 00:17:46.125 16:59:56 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:46.125 Running I/O for 10 seconds... 00:17:56.090 00:17:56.090 Latency(us) 00:17:56.090 [2024-11-29T16:00:07.521Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.090 [2024-11-29T16:00:07.521Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:56.090 Verification LBA range: start 0x0 length 0x2000 00:17:56.090 TLSTESTn1 : 10.01 4126.07 16.12 0.00 0.00 30986.14 4102.07 47574.28 00:17:56.090 [2024-11-29T16:00:07.521Z] =================================================================================================================== 00:17:56.090 [2024-11-29T16:00:07.521Z] Total : 4126.07 16.12 0.00 0.00 30986.14 4102.07 47574.28 00:17:56.090 0 00:17:56.090 17:00:06 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:56.090 17:00:06 -- target/tls.sh@45 -- # killprocess 222039 00:17:56.090 17:00:06 -- common/autotest_common.sh@936 -- # '[' -z 222039 ']' 00:17:56.090 17:00:06 -- common/autotest_common.sh@940 -- # kill -0 222039 00:17:56.090 17:00:06 -- common/autotest_common.sh@941 -- # uname 00:17:56.090 17:00:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.090 17:00:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 222039 00:17:56.091 17:00:06 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:56.091 17:00:06 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:56.091 17:00:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 222039' 00:17:56.091 killing process with pid 222039 00:17:56.091 17:00:06 -- common/autotest_common.sh@955 -- # kill 222039 00:17:56.091 Received shutdown signal, test time was about 10.000000 seconds 00:17:56.091 00:17:56.091 Latency(us) 00:17:56.091 [2024-11-29T16:00:07.522Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.091 [2024-11-29T16:00:07.522Z] =================================================================================================================== 00:17:56.091 [2024-11-29T16:00:07.522Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:56.091 17:00:06 -- common/autotest_common.sh@960 -- # wait 222039 00:17:56.091 17:00:07 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:56.091 17:00:07 -- common/autotest_common.sh@650 -- # local es=0 00:17:56.091 17:00:07 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:56.091 17:00:07 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:56.091 17:00:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:56.091 17:00:07 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:56.091 17:00:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:56.091 17:00:07 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:56.091 17:00:07 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:56.091 17:00:07 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:56.091 17:00:07 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:56.091 17:00:07 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:56.091 17:00:07 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:56.091 17:00:07 -- target/tls.sh@28 -- # bdevperf_pid=223536 00:17:56.091 17:00:07 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:56.091 17:00:07 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:56.091 17:00:07 -- target/tls.sh@31 -- # waitforlisten 223536 /var/tmp/bdevperf.sock 00:17:56.091 17:00:07 -- common/autotest_common.sh@829 -- # '[' -z 223536 ']' 00:17:56.091 17:00:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:56.091 17:00:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:56.091 17:00:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:56.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:56.091 17:00:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:56.091 17:00:07 -- common/autotest_common.sh@10 -- # set +x 00:17:56.091 [2024-11-29 17:00:07.278551] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:56.091 [2024-11-29 17:00:07.278658] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid223536 ] 00:17:56.091 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.091 [2024-11-29 17:00:07.342426] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.091 [2024-11-29 17:00:07.450731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:57.026 17:00:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:57.026 17:00:08 -- common/autotest_common.sh@862 -- # return 0 00:17:57.026 17:00:08 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:57.285 [2024-11-29 17:00:08.518019] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:57.285 [2024-11-29 17:00:08.525091] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:57.285 [2024-11-29 17:00:08.525699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ab01f0 (107): Transport endpoint is not connected 00:17:57.285 [2024-11-29 17:00:08.526688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ab01f0 (9): Bad file descriptor 00:17:57.286 [2024-11-29 17:00:08.527688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:57.286 [2024-11-29 17:00:08.527708] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:57.286 [2024-11-29 17:00:08.527723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:57.286 request: 00:17:57.286 { 00:17:57.286 "name": "TLSTEST", 00:17:57.286 "trtype": "tcp", 00:17:57.286 "traddr": "10.0.0.2", 00:17:57.286 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:57.286 "adrfam": "ipv4", 00:17:57.286 "trsvcid": "4420", 00:17:57.286 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:57.286 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:57.286 "method": "bdev_nvme_attach_controller", 00:17:57.286 "req_id": 1 00:17:57.286 } 00:17:57.286 Got JSON-RPC error response 00:17:57.286 response: 00:17:57.286 { 00:17:57.286 "code": -32602, 00:17:57.286 "message": "Invalid parameters" 00:17:57.286 } 00:17:57.286 17:00:08 -- target/tls.sh@36 -- # killprocess 223536 00:17:57.286 17:00:08 -- common/autotest_common.sh@936 -- # '[' -z 223536 ']' 00:17:57.286 17:00:08 -- common/autotest_common.sh@940 -- # kill -0 223536 00:17:57.286 17:00:08 -- common/autotest_common.sh@941 -- # uname 00:17:57.286 17:00:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:57.286 17:00:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 223536 00:17:57.286 17:00:08 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:57.286 17:00:08 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:57.286 17:00:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 223536' 00:17:57.286 killing process with pid 223536 00:17:57.286 17:00:08 -- common/autotest_common.sh@955 -- # kill 223536 00:17:57.286 Received shutdown signal, test time was about 10.000000 seconds 00:17:57.286 00:17:57.286 Latency(us) 00:17:57.286 [2024-11-29T16:00:08.717Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:57.286 [2024-11-29T16:00:08.717Z] =================================================================================================================== 00:17:57.286 [2024-11-29T16:00:08.717Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:57.286 17:00:08 -- common/autotest_common.sh@960 -- # wait 223536 00:17:57.545 17:00:08 -- target/tls.sh@37 -- # return 1 00:17:57.545 17:00:08 -- common/autotest_common.sh@653 -- # es=1 00:17:57.545 17:00:08 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:57.545 17:00:08 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:57.545 17:00:08 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:57.545 17:00:08 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:57.545 17:00:08 -- common/autotest_common.sh@650 -- # local es=0 00:17:57.545 17:00:08 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:57.545 17:00:08 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:57.545 17:00:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.545 17:00:08 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:57.545 17:00:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.545 17:00:08 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:57.545 17:00:08 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:57.545 17:00:08 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:57.545 17:00:08 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:57.545 17:00:08 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:57.545 17:00:08 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:57.545 17:00:08 -- target/tls.sh@28 -- # bdevperf_pid=224275 00:17:57.545 17:00:08 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:57.545 17:00:08 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:57.545 17:00:08 -- target/tls.sh@31 -- # waitforlisten 224275 /var/tmp/bdevperf.sock 00:17:57.545 17:00:08 -- common/autotest_common.sh@829 -- # '[' -z 224275 ']' 00:17:57.545 17:00:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:57.545 17:00:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:57.545 17:00:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:57.545 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:57.545 17:00:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:57.545 17:00:08 -- common/autotest_common.sh@10 -- # set +x 00:17:57.545 [2024-11-29 17:00:08.878876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:57.545 [2024-11-29 17:00:08.878979] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid224275 ] 00:17:57.545 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.545 [2024-11-29 17:00:08.939817] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.803 [2024-11-29 17:00:09.047682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:58.737 17:00:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:58.737 17:00:09 -- common/autotest_common.sh@862 -- # return 0 00:17:58.737 17:00:09 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:58.737 [2024-11-29 17:00:10.082437] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:58.737 [2024-11-29 17:00:10.089000] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:58.737 [2024-11-29 17:00:10.089033] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:58.737 [2024-11-29 17:00:10.089088] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:58.737 [2024-11-29 17:00:10.089298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ee31f0 (107): Transport endpoint is not connected 00:17:58.737 [2024-11-29 17:00:10.090287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ee31f0 (9): Bad file descriptor 00:17:58.737 [2024-11-29 17:00:10.091291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:58.737 [2024-11-29 17:00:10.091311] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:58.737 [2024-11-29 17:00:10.091326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:58.737 request: 00:17:58.737 { 00:17:58.737 "name": "TLSTEST", 00:17:58.737 "trtype": "tcp", 00:17:58.737 "traddr": "10.0.0.2", 00:17:58.737 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:58.737 "adrfam": "ipv4", 00:17:58.737 "trsvcid": "4420", 00:17:58.737 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:58.737 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:58.737 "method": "bdev_nvme_attach_controller", 00:17:58.737 "req_id": 1 00:17:58.737 } 00:17:58.737 Got JSON-RPC error response 00:17:58.737 response: 00:17:58.737 { 00:17:58.737 "code": -32602, 00:17:58.737 "message": "Invalid parameters" 00:17:58.737 } 00:17:58.737 17:00:10 -- target/tls.sh@36 -- # killprocess 224275 00:17:58.737 17:00:10 -- common/autotest_common.sh@936 -- # '[' -z 224275 ']' 00:17:58.737 17:00:10 -- common/autotest_common.sh@940 -- # kill -0 224275 00:17:58.737 17:00:10 -- common/autotest_common.sh@941 -- # uname 00:17:58.737 17:00:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:58.737 17:00:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224275 00:17:58.737 17:00:10 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:58.737 17:00:10 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:58.737 17:00:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224275' 00:17:58.737 killing process with pid 224275 00:17:58.737 17:00:10 -- common/autotest_common.sh@955 -- # kill 224275 00:17:58.737 Received shutdown signal, test time was about 10.000000 seconds 00:17:58.737 00:17:58.737 Latency(us) 00:17:58.737 [2024-11-29T16:00:10.168Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.737 [2024-11-29T16:00:10.168Z] =================================================================================================================== 00:17:58.737 [2024-11-29T16:00:10.168Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:58.737 17:00:10 -- common/autotest_common.sh@960 -- # wait 224275 00:17:58.996 17:00:10 -- target/tls.sh@37 -- # return 1 00:17:58.996 17:00:10 -- common/autotest_common.sh@653 -- # es=1 00:17:58.996 17:00:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:58.996 17:00:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:58.996 17:00:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:58.996 17:00:10 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:58.996 17:00:10 -- common/autotest_common.sh@650 -- # local es=0 00:17:58.996 17:00:10 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:58.996 17:00:10 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:58.996 17:00:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:58.996 17:00:10 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:58.996 17:00:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:58.996 17:00:10 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:58.996 17:00:10 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:58.996 17:00:10 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:58.996 17:00:10 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:58.996 17:00:10 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:58.996 17:00:10 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:58.996 17:00:10 -- target/tls.sh@28 -- # bdevperf_pid=224456 00:17:58.996 17:00:10 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:58.996 17:00:10 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:58.996 17:00:10 -- target/tls.sh@31 -- # waitforlisten 224456 /var/tmp/bdevperf.sock 00:17:58.996 17:00:10 -- common/autotest_common.sh@829 -- # '[' -z 224456 ']' 00:17:58.996 17:00:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:58.996 17:00:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:58.996 17:00:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:58.996 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:58.996 17:00:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:58.996 17:00:10 -- common/autotest_common.sh@10 -- # set +x 00:17:59.255 [2024-11-29 17:00:10.453681] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:59.255 [2024-11-29 17:00:10.453752] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid224456 ] 00:17:59.255 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.255 [2024-11-29 17:00:10.512502] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.255 [2024-11-29 17:00:10.621691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:00.191 17:00:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:00.191 17:00:11 -- common/autotest_common.sh@862 -- # return 0 00:18:00.191 17:00:11 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:00.449 [2024-11-29 17:00:11.649494] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:00.449 [2024-11-29 17:00:11.654597] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:18:00.449 [2024-11-29 17:00:11.654629] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:18:00.449 [2024-11-29 17:00:11.654683] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:18:00.449 [2024-11-29 17:00:11.655255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x87d1f0 (107): Transport endpoint is not connected 00:18:00.449 [2024-11-29 17:00:11.656253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x87d1f0 (9): Bad file descriptor 00:18:00.449 [2024-11-29 17:00:11.657258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:18:00.449 [2024-11-29 17:00:11.657278] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:18:00.449 [2024-11-29 17:00:11.657292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:18:00.449 request: 00:18:00.449 { 00:18:00.449 "name": "TLSTEST", 00:18:00.449 "trtype": "tcp", 00:18:00.449 "traddr": "10.0.0.2", 00:18:00.449 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:00.449 "adrfam": "ipv4", 00:18:00.449 "trsvcid": "4420", 00:18:00.449 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:00.450 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:18:00.450 "method": "bdev_nvme_attach_controller", 00:18:00.450 "req_id": 1 00:18:00.450 } 00:18:00.450 Got JSON-RPC error response 00:18:00.450 response: 00:18:00.450 { 00:18:00.450 "code": -32602, 00:18:00.450 "message": "Invalid parameters" 00:18:00.450 } 00:18:00.450 17:00:11 -- target/tls.sh@36 -- # killprocess 224456 00:18:00.450 17:00:11 -- common/autotest_common.sh@936 -- # '[' -z 224456 ']' 00:18:00.450 17:00:11 -- common/autotest_common.sh@940 -- # kill -0 224456 00:18:00.450 17:00:11 -- common/autotest_common.sh@941 -- # uname 00:18:00.450 17:00:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:00.450 17:00:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224456 00:18:00.450 17:00:11 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:00.450 17:00:11 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:00.450 17:00:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224456' 00:18:00.450 killing process with pid 224456 00:18:00.450 17:00:11 -- common/autotest_common.sh@955 -- # kill 224456 00:18:00.450 Received shutdown signal, test time was about 10.000000 seconds 00:18:00.450 00:18:00.450 Latency(us) 00:18:00.450 [2024-11-29T16:00:11.881Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:00.450 [2024-11-29T16:00:11.881Z] =================================================================================================================== 00:18:00.450 [2024-11-29T16:00:11.881Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:00.450 17:00:11 -- common/autotest_common.sh@960 -- # wait 224456 00:18:00.709 17:00:11 -- target/tls.sh@37 -- # return 1 00:18:00.709 17:00:11 -- common/autotest_common.sh@653 -- # es=1 00:18:00.709 17:00:11 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:00.709 17:00:11 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:00.709 17:00:11 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:00.709 17:00:11 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:18:00.709 17:00:11 -- common/autotest_common.sh@650 -- # local es=0 00:18:00.709 17:00:11 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:18:00.709 17:00:11 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:00.709 17:00:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:00.709 17:00:11 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:00.709 17:00:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:00.709 17:00:11 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:18:00.709 17:00:11 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:00.709 17:00:11 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:00.709 17:00:11 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:00.709 17:00:11 -- target/tls.sh@23 -- # psk= 00:18:00.709 17:00:11 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:00.709 17:00:11 -- target/tls.sh@28 -- # bdevperf_pid=224616 00:18:00.709 17:00:11 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:00.709 17:00:11 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:00.709 17:00:11 -- target/tls.sh@31 -- # waitforlisten 224616 /var/tmp/bdevperf.sock 00:18:00.709 17:00:11 -- common/autotest_common.sh@829 -- # '[' -z 224616 ']' 00:18:00.709 17:00:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:00.709 17:00:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:00.709 17:00:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:00.709 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:00.709 17:00:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:00.709 17:00:11 -- common/autotest_common.sh@10 -- # set +x 00:18:00.709 [2024-11-29 17:00:11.995116] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:00.709 [2024-11-29 17:00:11.995190] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid224616 ] 00:18:00.709 EAL: No free 2048 kB hugepages reported on node 1 00:18:00.709 [2024-11-29 17:00:12.052475] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:00.967 [2024-11-29 17:00:12.161502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:01.900 17:00:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:01.900 17:00:13 -- common/autotest_common.sh@862 -- # return 0 00:18:01.900 17:00:13 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:18:01.900 [2024-11-29 17:00:13.247171] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:18:01.900 [2024-11-29 17:00:13.249191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a0050 (9): Bad file descriptor 00:18:01.900 [2024-11-29 17:00:13.250187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:01.900 [2024-11-29 17:00:13.250208] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:18:01.900 [2024-11-29 17:00:13.250223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:01.900 request: 00:18:01.900 { 00:18:01.900 "name": "TLSTEST", 00:18:01.900 "trtype": "tcp", 00:18:01.900 "traddr": "10.0.0.2", 00:18:01.900 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:01.900 "adrfam": "ipv4", 00:18:01.900 "trsvcid": "4420", 00:18:01.900 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:01.900 "method": "bdev_nvme_attach_controller", 00:18:01.900 "req_id": 1 00:18:01.900 } 00:18:01.900 Got JSON-RPC error response 00:18:01.900 response: 00:18:01.900 { 00:18:01.900 "code": -32602, 00:18:01.900 "message": "Invalid parameters" 00:18:01.900 } 00:18:01.900 17:00:13 -- target/tls.sh@36 -- # killprocess 224616 00:18:01.900 17:00:13 -- common/autotest_common.sh@936 -- # '[' -z 224616 ']' 00:18:01.900 17:00:13 -- common/autotest_common.sh@940 -- # kill -0 224616 00:18:01.900 17:00:13 -- common/autotest_common.sh@941 -- # uname 00:18:01.900 17:00:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:01.900 17:00:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224616 00:18:01.900 17:00:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:01.900 17:00:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:01.900 17:00:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224616' 00:18:01.900 killing process with pid 224616 00:18:01.900 17:00:13 -- common/autotest_common.sh@955 -- # kill 224616 00:18:01.900 Received shutdown signal, test time was about 10.000000 seconds 00:18:01.900 00:18:01.900 Latency(us) 00:18:01.900 [2024-11-29T16:00:13.331Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.900 [2024-11-29T16:00:13.331Z] =================================================================================================================== 00:18:01.901 [2024-11-29T16:00:13.332Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:01.901 17:00:13 -- common/autotest_common.sh@960 -- # wait 224616 00:18:02.159 17:00:13 -- target/tls.sh@37 -- # return 1 00:18:02.159 17:00:13 -- common/autotest_common.sh@653 -- # es=1 00:18:02.159 17:00:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:02.159 17:00:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:02.159 17:00:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:02.159 17:00:13 -- target/tls.sh@167 -- # killprocess 220085 00:18:02.159 17:00:13 -- common/autotest_common.sh@936 -- # '[' -z 220085 ']' 00:18:02.159 17:00:13 -- common/autotest_common.sh@940 -- # kill -0 220085 00:18:02.159 17:00:13 -- common/autotest_common.sh@941 -- # uname 00:18:02.159 17:00:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:02.159 17:00:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 220085 00:18:02.159 17:00:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:02.159 17:00:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:02.159 17:00:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 220085' 00:18:02.159 killing process with pid 220085 00:18:02.159 17:00:13 -- common/autotest_common.sh@955 -- # kill 220085 00:18:02.159 17:00:13 -- common/autotest_common.sh@960 -- # wait 220085 00:18:02.726 17:00:13 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:18:02.726 17:00:13 -- target/tls.sh@49 -- # local key hash crc 00:18:02.726 17:00:13 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:18:02.726 17:00:13 -- target/tls.sh@51 -- # hash=02 00:18:02.726 17:00:13 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:18:02.726 17:00:13 -- target/tls.sh@52 -- # gzip -1 -c 00:18:02.726 17:00:13 -- target/tls.sh@52 -- # tail -c8 00:18:02.726 17:00:13 -- target/tls.sh@52 -- # head -c 4 00:18:02.726 17:00:13 -- target/tls.sh@52 -- # crc='�e�'\''' 00:18:02.726 17:00:13 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:18:02.726 17:00:13 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:18:02.726 17:00:13 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:18:02.726 17:00:13 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:18:02.726 17:00:13 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:02.726 17:00:13 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:18:02.726 17:00:13 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:02.726 17:00:13 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:18:02.726 17:00:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:02.726 17:00:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:02.726 17:00:13 -- common/autotest_common.sh@10 -- # set +x 00:18:02.726 17:00:13 -- nvmf/common.sh@469 -- # nvmfpid=224897 00:18:02.727 17:00:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:02.727 17:00:13 -- nvmf/common.sh@470 -- # waitforlisten 224897 00:18:02.727 17:00:13 -- common/autotest_common.sh@829 -- # '[' -z 224897 ']' 00:18:02.727 17:00:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:02.727 17:00:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:02.727 17:00:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:02.727 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:02.727 17:00:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:02.727 17:00:13 -- common/autotest_common.sh@10 -- # set +x 00:18:02.727 [2024-11-29 17:00:13.923815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:02.727 [2024-11-29 17:00:13.923911] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:02.727 EAL: No free 2048 kB hugepages reported on node 1 00:18:02.727 [2024-11-29 17:00:13.988885] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:02.727 [2024-11-29 17:00:14.095757] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:02.727 [2024-11-29 17:00:14.095919] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:02.727 [2024-11-29 17:00:14.095949] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:02.727 [2024-11-29 17:00:14.095972] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:02.727 [2024-11-29 17:00:14.096021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:03.664 17:00:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:03.664 17:00:14 -- common/autotest_common.sh@862 -- # return 0 00:18:03.664 17:00:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:03.664 17:00:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:03.664 17:00:14 -- common/autotest_common.sh@10 -- # set +x 00:18:03.664 17:00:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:03.664 17:00:14 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:03.664 17:00:14 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:03.664 17:00:14 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:03.925 [2024-11-29 17:00:15.196023] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:03.925 17:00:15 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:04.183 17:00:15 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:04.441 [2024-11-29 17:00:15.733508] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:04.441 [2024-11-29 17:00:15.733800] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:04.441 17:00:15 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:04.700 malloc0 00:18:04.700 17:00:16 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:04.958 17:00:16 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:05.217 17:00:16 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:05.217 17:00:16 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:05.217 17:00:16 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:05.217 17:00:16 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:05.217 17:00:16 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:05.217 17:00:16 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:05.217 17:00:16 -- target/tls.sh@28 -- # bdevperf_pid=225206 00:18:05.217 17:00:16 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:05.217 17:00:16 -- target/tls.sh@31 -- # waitforlisten 225206 /var/tmp/bdevperf.sock 00:18:05.217 17:00:16 -- common/autotest_common.sh@829 -- # '[' -z 225206 ']' 00:18:05.217 17:00:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:05.217 17:00:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:05.217 17:00:16 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:05.217 17:00:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:05.217 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:05.217 17:00:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:05.217 17:00:16 -- common/autotest_common.sh@10 -- # set +x 00:18:05.217 [2024-11-29 17:00:16.568227] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:05.217 [2024-11-29 17:00:16.568301] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid225206 ] 00:18:05.217 EAL: No free 2048 kB hugepages reported on node 1 00:18:05.217 [2024-11-29 17:00:16.628871] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:05.476 [2024-11-29 17:00:16.739447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:06.412 17:00:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:06.413 17:00:17 -- common/autotest_common.sh@862 -- # return 0 00:18:06.413 17:00:17 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:06.413 [2024-11-29 17:00:17.810526] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:06.671 TLSTESTn1 00:18:06.671 17:00:17 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:06.671 Running I/O for 10 seconds... 00:18:16.641 00:18:16.641 Latency(us) 00:18:16.641 [2024-11-29T16:00:28.072Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.641 [2024-11-29T16:00:28.072Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:16.641 Verification LBA range: start 0x0 length 0x2000 00:18:16.641 TLSTESTn1 : 10.02 4322.26 16.88 0.00 0.00 29571.34 5315.70 47574.28 00:18:16.641 [2024-11-29T16:00:28.072Z] =================================================================================================================== 00:18:16.641 [2024-11-29T16:00:28.072Z] Total : 4322.26 16.88 0.00 0.00 29571.34 5315.70 47574.28 00:18:16.641 0 00:18:16.899 17:00:28 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:16.899 17:00:28 -- target/tls.sh@45 -- # killprocess 225206 00:18:16.899 17:00:28 -- common/autotest_common.sh@936 -- # '[' -z 225206 ']' 00:18:16.899 17:00:28 -- common/autotest_common.sh@940 -- # kill -0 225206 00:18:16.899 17:00:28 -- common/autotest_common.sh@941 -- # uname 00:18:16.899 17:00:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:16.899 17:00:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 225206 00:18:16.899 17:00:28 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:16.899 17:00:28 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:16.899 17:00:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 225206' 00:18:16.899 killing process with pid 225206 00:18:16.899 17:00:28 -- common/autotest_common.sh@955 -- # kill 225206 00:18:16.899 Received shutdown signal, test time was about 10.000000 seconds 00:18:16.899 00:18:16.899 Latency(us) 00:18:16.899 [2024-11-29T16:00:28.330Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.899 [2024-11-29T16:00:28.330Z] =================================================================================================================== 00:18:16.899 [2024-11-29T16:00:28.330Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:16.899 17:00:28 -- common/autotest_common.sh@960 -- # wait 225206 00:18:17.158 17:00:28 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.158 17:00:28 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.158 17:00:28 -- common/autotest_common.sh@650 -- # local es=0 00:18:17.158 17:00:28 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.158 17:00:28 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:17.158 17:00:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:17.158 17:00:28 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:17.158 17:00:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:17.158 17:00:28 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.158 17:00:28 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:17.158 17:00:28 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:17.158 17:00:28 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:17.158 17:00:28 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:17.158 17:00:28 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:17.158 17:00:28 -- target/tls.sh@28 -- # bdevperf_pid=226694 00:18:17.158 17:00:28 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:17.158 17:00:28 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:17.158 17:00:28 -- target/tls.sh@31 -- # waitforlisten 226694 /var/tmp/bdevperf.sock 00:18:17.158 17:00:28 -- common/autotest_common.sh@829 -- # '[' -z 226694 ']' 00:18:17.158 17:00:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:17.158 17:00:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:17.158 17:00:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:17.158 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:17.158 17:00:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:17.158 17:00:28 -- common/autotest_common.sh@10 -- # set +x 00:18:17.158 [2024-11-29 17:00:28.421478] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:17.158 [2024-11-29 17:00:28.421552] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid226694 ] 00:18:17.158 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.158 [2024-11-29 17:00:28.478587] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:17.158 [2024-11-29 17:00:28.579364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:18.092 17:00:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:18.092 17:00:29 -- common/autotest_common.sh@862 -- # return 0 00:18:18.092 17:00:29 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:18.350 [2024-11-29 17:00:29.649160] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:18.350 [2024-11-29 17:00:29.649236] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:18.350 request: 00:18:18.350 { 00:18:18.350 "name": "TLSTEST", 00:18:18.351 "trtype": "tcp", 00:18:18.351 "traddr": "10.0.0.2", 00:18:18.351 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.351 "adrfam": "ipv4", 00:18:18.351 "trsvcid": "4420", 00:18:18.351 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.351 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:18.351 "method": "bdev_nvme_attach_controller", 00:18:18.351 "req_id": 1 00:18:18.351 } 00:18:18.351 Got JSON-RPC error response 00:18:18.351 response: 00:18:18.351 { 00:18:18.351 "code": -22, 00:18:18.351 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:18.351 } 00:18:18.351 17:00:29 -- target/tls.sh@36 -- # killprocess 226694 00:18:18.351 17:00:29 -- common/autotest_common.sh@936 -- # '[' -z 226694 ']' 00:18:18.351 17:00:29 -- common/autotest_common.sh@940 -- # kill -0 226694 00:18:18.351 17:00:29 -- common/autotest_common.sh@941 -- # uname 00:18:18.351 17:00:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:18.351 17:00:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 226694 00:18:18.351 17:00:29 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:18.351 17:00:29 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:18.351 17:00:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 226694' 00:18:18.351 killing process with pid 226694 00:18:18.351 17:00:29 -- common/autotest_common.sh@955 -- # kill 226694 00:18:18.351 Received shutdown signal, test time was about 10.000000 seconds 00:18:18.351 00:18:18.351 Latency(us) 00:18:18.351 [2024-11-29T16:00:29.782Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:18.351 [2024-11-29T16:00:29.782Z] =================================================================================================================== 00:18:18.351 [2024-11-29T16:00:29.782Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:18.351 17:00:29 -- common/autotest_common.sh@960 -- # wait 226694 00:18:18.609 17:00:29 -- target/tls.sh@37 -- # return 1 00:18:18.609 17:00:29 -- common/autotest_common.sh@653 -- # es=1 00:18:18.609 17:00:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:18.609 17:00:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:18.609 17:00:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:18.609 17:00:29 -- target/tls.sh@183 -- # killprocess 224897 00:18:18.609 17:00:29 -- common/autotest_common.sh@936 -- # '[' -z 224897 ']' 00:18:18.609 17:00:29 -- common/autotest_common.sh@940 -- # kill -0 224897 00:18:18.609 17:00:29 -- common/autotest_common.sh@941 -- # uname 00:18:18.609 17:00:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:18.609 17:00:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224897 00:18:18.609 17:00:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:18.609 17:00:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:18.609 17:00:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224897' 00:18:18.609 killing process with pid 224897 00:18:18.609 17:00:30 -- common/autotest_common.sh@955 -- # kill 224897 00:18:18.609 17:00:30 -- common/autotest_common.sh@960 -- # wait 224897 00:18:18.868 17:00:30 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:18.868 17:00:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:18.868 17:00:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:18.868 17:00:30 -- common/autotest_common.sh@10 -- # set +x 00:18:19.127 17:00:30 -- nvmf/common.sh@469 -- # nvmfpid=226978 00:18:19.127 17:00:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:19.127 17:00:30 -- nvmf/common.sh@470 -- # waitforlisten 226978 00:18:19.127 17:00:30 -- common/autotest_common.sh@829 -- # '[' -z 226978 ']' 00:18:19.127 17:00:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:19.127 17:00:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:19.127 17:00:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:19.127 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:19.127 17:00:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:19.127 17:00:30 -- common/autotest_common.sh@10 -- # set +x 00:18:19.127 [2024-11-29 17:00:30.343556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:19.127 [2024-11-29 17:00:30.343653] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:19.127 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.127 [2024-11-29 17:00:30.414361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.127 [2024-11-29 17:00:30.532539] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:19.127 [2024-11-29 17:00:30.532708] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:19.127 [2024-11-29 17:00:30.532728] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:19.127 [2024-11-29 17:00:30.532742] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:19.127 [2024-11-29 17:00:30.532787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:20.064 17:00:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:20.064 17:00:31 -- common/autotest_common.sh@862 -- # return 0 00:18:20.064 17:00:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:20.064 17:00:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:20.064 17:00:31 -- common/autotest_common.sh@10 -- # set +x 00:18:20.064 17:00:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:20.064 17:00:31 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:20.064 17:00:31 -- common/autotest_common.sh@650 -- # local es=0 00:18:20.064 17:00:31 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:20.064 17:00:31 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:20.064 17:00:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:20.064 17:00:31 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:20.064 17:00:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:20.064 17:00:31 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:20.064 17:00:31 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:20.064 17:00:31 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:20.322 [2024-11-29 17:00:31.601945] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:20.322 17:00:31 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:20.580 17:00:31 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:20.838 [2024-11-29 17:00:32.083223] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:20.838 [2024-11-29 17:00:32.083475] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:20.838 17:00:32 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:21.096 malloc0 00:18:21.096 17:00:32 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:21.355 17:00:32 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:21.613 [2024-11-29 17:00:32.849508] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:21.613 [2024-11-29 17:00:32.849556] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:21.613 [2024-11-29 17:00:32.849581] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:21.613 request: 00:18:21.613 { 00:18:21.613 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.613 "host": "nqn.2016-06.io.spdk:host1", 00:18:21.613 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:21.613 "method": "nvmf_subsystem_add_host", 00:18:21.613 "req_id": 1 00:18:21.613 } 00:18:21.613 Got JSON-RPC error response 00:18:21.613 response: 00:18:21.613 { 00:18:21.613 "code": -32603, 00:18:21.613 "message": "Internal error" 00:18:21.613 } 00:18:21.613 17:00:32 -- common/autotest_common.sh@653 -- # es=1 00:18:21.613 17:00:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:21.613 17:00:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:21.613 17:00:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:21.613 17:00:32 -- target/tls.sh@189 -- # killprocess 226978 00:18:21.613 17:00:32 -- common/autotest_common.sh@936 -- # '[' -z 226978 ']' 00:18:21.613 17:00:32 -- common/autotest_common.sh@940 -- # kill -0 226978 00:18:21.613 17:00:32 -- common/autotest_common.sh@941 -- # uname 00:18:21.613 17:00:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:21.613 17:00:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 226978 00:18:21.613 17:00:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:21.613 17:00:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:21.613 17:00:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 226978' 00:18:21.613 killing process with pid 226978 00:18:21.613 17:00:32 -- common/autotest_common.sh@955 -- # kill 226978 00:18:21.613 17:00:32 -- common/autotest_common.sh@960 -- # wait 226978 00:18:21.872 17:00:33 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:21.872 17:00:33 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:21.872 17:00:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:21.872 17:00:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:21.872 17:00:33 -- common/autotest_common.sh@10 -- # set +x 00:18:21.872 17:00:33 -- nvmf/common.sh@469 -- # nvmfpid=227291 00:18:21.872 17:00:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:21.872 17:00:33 -- nvmf/common.sh@470 -- # waitforlisten 227291 00:18:21.872 17:00:33 -- common/autotest_common.sh@829 -- # '[' -z 227291 ']' 00:18:21.872 17:00:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:21.872 17:00:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:21.872 17:00:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:21.872 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:21.872 17:00:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:21.872 17:00:33 -- common/autotest_common.sh@10 -- # set +x 00:18:21.872 [2024-11-29 17:00:33.258082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:21.872 [2024-11-29 17:00:33.258160] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:21.872 EAL: No free 2048 kB hugepages reported on node 1 00:18:22.131 [2024-11-29 17:00:33.324666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:22.131 [2024-11-29 17:00:33.435373] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:22.131 [2024-11-29 17:00:33.435533] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:22.131 [2024-11-29 17:00:33.435552] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:22.131 [2024-11-29 17:00:33.435567] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:22.131 [2024-11-29 17:00:33.435598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:23.065 17:00:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:23.065 17:00:34 -- common/autotest_common.sh@862 -- # return 0 00:18:23.065 17:00:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:23.065 17:00:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:23.065 17:00:34 -- common/autotest_common.sh@10 -- # set +x 00:18:23.065 17:00:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:23.065 17:00:34 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:23.065 17:00:34 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:23.065 17:00:34 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:23.324 [2024-11-29 17:00:34.498331] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:23.324 17:00:34 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:23.582 17:00:34 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:23.840 [2024-11-29 17:00:35.023737] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:23.840 [2024-11-29 17:00:35.024010] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:23.840 17:00:35 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:24.098 malloc0 00:18:24.098 17:00:35 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:24.356 17:00:35 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:24.614 17:00:35 -- target/tls.sh@197 -- # bdevperf_pid=227636 00:18:24.614 17:00:35 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:24.614 17:00:35 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:24.614 17:00:35 -- target/tls.sh@200 -- # waitforlisten 227636 /var/tmp/bdevperf.sock 00:18:24.614 17:00:35 -- common/autotest_common.sh@829 -- # '[' -z 227636 ']' 00:18:24.614 17:00:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:24.614 17:00:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:24.614 17:00:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:24.614 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:24.614 17:00:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:24.614 17:00:35 -- common/autotest_common.sh@10 -- # set +x 00:18:24.614 [2024-11-29 17:00:35.887786] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:24.614 [2024-11-29 17:00:35.887868] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid227636 ] 00:18:24.614 EAL: No free 2048 kB hugepages reported on node 1 00:18:24.614 [2024-11-29 17:00:35.949278] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:24.873 [2024-11-29 17:00:36.056741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:25.809 17:00:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:25.809 17:00:36 -- common/autotest_common.sh@862 -- # return 0 00:18:25.809 17:00:36 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:25.809 [2024-11-29 17:00:37.170906] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:26.068 TLSTESTn1 00:18:26.068 17:00:37 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:26.327 17:00:37 -- target/tls.sh@205 -- # tgtconf='{ 00:18:26.327 "subsystems": [ 00:18:26.327 { 00:18:26.327 "subsystem": "iobuf", 00:18:26.327 "config": [ 00:18:26.327 { 00:18:26.327 "method": "iobuf_set_options", 00:18:26.327 "params": { 00:18:26.327 "small_pool_count": 8192, 00:18:26.327 "large_pool_count": 1024, 00:18:26.327 "small_bufsize": 8192, 00:18:26.327 "large_bufsize": 135168 00:18:26.327 } 00:18:26.327 } 00:18:26.327 ] 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "subsystem": "sock", 00:18:26.327 "config": [ 00:18:26.327 { 00:18:26.327 "method": "sock_impl_set_options", 00:18:26.327 "params": { 00:18:26.327 "impl_name": "posix", 00:18:26.327 "recv_buf_size": 2097152, 00:18:26.327 "send_buf_size": 2097152, 00:18:26.327 "enable_recv_pipe": true, 00:18:26.327 "enable_quickack": false, 00:18:26.327 "enable_placement_id": 0, 00:18:26.327 "enable_zerocopy_send_server": true, 00:18:26.327 "enable_zerocopy_send_client": false, 00:18:26.327 "zerocopy_threshold": 0, 00:18:26.327 "tls_version": 0, 00:18:26.327 "enable_ktls": false 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "sock_impl_set_options", 00:18:26.327 "params": { 00:18:26.327 "impl_name": "ssl", 00:18:26.327 "recv_buf_size": 4096, 00:18:26.327 "send_buf_size": 4096, 00:18:26.327 "enable_recv_pipe": true, 00:18:26.327 "enable_quickack": false, 00:18:26.327 "enable_placement_id": 0, 00:18:26.327 "enable_zerocopy_send_server": true, 00:18:26.327 "enable_zerocopy_send_client": false, 00:18:26.327 "zerocopy_threshold": 0, 00:18:26.327 "tls_version": 0, 00:18:26.327 "enable_ktls": false 00:18:26.327 } 00:18:26.327 } 00:18:26.327 ] 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "subsystem": "vmd", 00:18:26.327 "config": [] 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "subsystem": "accel", 00:18:26.327 "config": [ 00:18:26.327 { 00:18:26.327 "method": "accel_set_options", 00:18:26.327 "params": { 00:18:26.327 "small_cache_size": 128, 00:18:26.327 "large_cache_size": 16, 00:18:26.327 "task_count": 2048, 00:18:26.327 "sequence_count": 2048, 00:18:26.327 "buf_count": 2048 00:18:26.327 } 00:18:26.327 } 00:18:26.327 ] 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "subsystem": "bdev", 00:18:26.327 "config": [ 00:18:26.327 { 00:18:26.327 "method": "bdev_set_options", 00:18:26.327 "params": { 00:18:26.327 "bdev_io_pool_size": 65535, 00:18:26.327 "bdev_io_cache_size": 256, 00:18:26.327 "bdev_auto_examine": true, 00:18:26.327 "iobuf_small_cache_size": 128, 00:18:26.327 "iobuf_large_cache_size": 16 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "bdev_raid_set_options", 00:18:26.327 "params": { 00:18:26.327 "process_window_size_kb": 1024 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "bdev_iscsi_set_options", 00:18:26.327 "params": { 00:18:26.327 "timeout_sec": 30 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "bdev_nvme_set_options", 00:18:26.327 "params": { 00:18:26.327 "action_on_timeout": "none", 00:18:26.327 "timeout_us": 0, 00:18:26.327 "timeout_admin_us": 0, 00:18:26.327 "keep_alive_timeout_ms": 10000, 00:18:26.327 "transport_retry_count": 4, 00:18:26.327 "arbitration_burst": 0, 00:18:26.327 "low_priority_weight": 0, 00:18:26.327 "medium_priority_weight": 0, 00:18:26.327 "high_priority_weight": 0, 00:18:26.327 "nvme_adminq_poll_period_us": 10000, 00:18:26.327 "nvme_ioq_poll_period_us": 0, 00:18:26.327 "io_queue_requests": 0, 00:18:26.327 "delay_cmd_submit": true, 00:18:26.327 "bdev_retry_count": 3, 00:18:26.327 "transport_ack_timeout": 0, 00:18:26.327 "ctrlr_loss_timeout_sec": 0, 00:18:26.327 "reconnect_delay_sec": 0, 00:18:26.327 "fast_io_fail_timeout_sec": 0, 00:18:26.327 "generate_uuids": false, 00:18:26.327 "transport_tos": 0, 00:18:26.327 "io_path_stat": false, 00:18:26.327 "allow_accel_sequence": false 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "bdev_nvme_set_hotplug", 00:18:26.327 "params": { 00:18:26.327 "period_us": 100000, 00:18:26.327 "enable": false 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "bdev_malloc_create", 00:18:26.327 "params": { 00:18:26.327 "name": "malloc0", 00:18:26.327 "num_blocks": 8192, 00:18:26.327 "block_size": 4096, 00:18:26.327 "physical_block_size": 4096, 00:18:26.327 "uuid": "9f1f369a-89d6-4db3-ae73-03e6ede4b46a", 00:18:26.327 "optimal_io_boundary": 0 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "bdev_wait_for_examine" 00:18:26.327 } 00:18:26.327 ] 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "subsystem": "nbd", 00:18:26.327 "config": [] 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "subsystem": "scheduler", 00:18:26.327 "config": [ 00:18:26.327 { 00:18:26.327 "method": "framework_set_scheduler", 00:18:26.327 "params": { 00:18:26.327 "name": "static" 00:18:26.327 } 00:18:26.327 } 00:18:26.327 ] 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "subsystem": "nvmf", 00:18:26.327 "config": [ 00:18:26.327 { 00:18:26.327 "method": "nvmf_set_config", 00:18:26.327 "params": { 00:18:26.327 "discovery_filter": "match_any", 00:18:26.327 "admin_cmd_passthru": { 00:18:26.327 "identify_ctrlr": false 00:18:26.327 } 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "nvmf_set_max_subsystems", 00:18:26.327 "params": { 00:18:26.327 "max_subsystems": 1024 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "nvmf_set_crdt", 00:18:26.327 "params": { 00:18:26.327 "crdt1": 0, 00:18:26.327 "crdt2": 0, 00:18:26.327 "crdt3": 0 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "nvmf_create_transport", 00:18:26.327 "params": { 00:18:26.327 "trtype": "TCP", 00:18:26.327 "max_queue_depth": 128, 00:18:26.327 "max_io_qpairs_per_ctrlr": 127, 00:18:26.327 "in_capsule_data_size": 4096, 00:18:26.327 "max_io_size": 131072, 00:18:26.327 "io_unit_size": 131072, 00:18:26.327 "max_aq_depth": 128, 00:18:26.327 "num_shared_buffers": 511, 00:18:26.327 "buf_cache_size": 4294967295, 00:18:26.327 "dif_insert_or_strip": false, 00:18:26.327 "zcopy": false, 00:18:26.327 "c2h_success": false, 00:18:26.327 "sock_priority": 0, 00:18:26.327 "abort_timeout_sec": 1 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "nvmf_create_subsystem", 00:18:26.327 "params": { 00:18:26.327 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:26.327 "allow_any_host": false, 00:18:26.327 "serial_number": "SPDK00000000000001", 00:18:26.327 "model_number": "SPDK bdev Controller", 00:18:26.327 "max_namespaces": 10, 00:18:26.327 "min_cntlid": 1, 00:18:26.327 "max_cntlid": 65519, 00:18:26.327 "ana_reporting": false 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.327 "method": "nvmf_subsystem_add_host", 00:18:26.327 "params": { 00:18:26.327 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:26.327 "host": "nqn.2016-06.io.spdk:host1", 00:18:26.327 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:26.327 } 00:18:26.327 }, 00:18:26.327 { 00:18:26.328 "method": "nvmf_subsystem_add_ns", 00:18:26.328 "params": { 00:18:26.328 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:26.328 "namespace": { 00:18:26.328 "nsid": 1, 00:18:26.328 "bdev_name": "malloc0", 00:18:26.328 "nguid": "9F1F369A89D64DB3AE7303E6EDE4B46A", 00:18:26.328 "uuid": "9f1f369a-89d6-4db3-ae73-03e6ede4b46a" 00:18:26.328 } 00:18:26.328 } 00:18:26.328 }, 00:18:26.328 { 00:18:26.328 "method": "nvmf_subsystem_add_listener", 00:18:26.328 "params": { 00:18:26.328 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:26.328 "listen_address": { 00:18:26.328 "trtype": "TCP", 00:18:26.328 "adrfam": "IPv4", 00:18:26.328 "traddr": "10.0.0.2", 00:18:26.328 "trsvcid": "4420" 00:18:26.328 }, 00:18:26.328 "secure_channel": true 00:18:26.328 } 00:18:26.328 } 00:18:26.328 ] 00:18:26.328 } 00:18:26.328 ] 00:18:26.328 }' 00:18:26.328 17:00:37 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:26.586 17:00:37 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:26.586 "subsystems": [ 00:18:26.586 { 00:18:26.586 "subsystem": "iobuf", 00:18:26.586 "config": [ 00:18:26.586 { 00:18:26.586 "method": "iobuf_set_options", 00:18:26.586 "params": { 00:18:26.586 "small_pool_count": 8192, 00:18:26.586 "large_pool_count": 1024, 00:18:26.586 "small_bufsize": 8192, 00:18:26.586 "large_bufsize": 135168 00:18:26.586 } 00:18:26.586 } 00:18:26.586 ] 00:18:26.586 }, 00:18:26.586 { 00:18:26.586 "subsystem": "sock", 00:18:26.586 "config": [ 00:18:26.586 { 00:18:26.586 "method": "sock_impl_set_options", 00:18:26.586 "params": { 00:18:26.586 "impl_name": "posix", 00:18:26.586 "recv_buf_size": 2097152, 00:18:26.586 "send_buf_size": 2097152, 00:18:26.586 "enable_recv_pipe": true, 00:18:26.586 "enable_quickack": false, 00:18:26.586 "enable_placement_id": 0, 00:18:26.586 "enable_zerocopy_send_server": true, 00:18:26.586 "enable_zerocopy_send_client": false, 00:18:26.586 "zerocopy_threshold": 0, 00:18:26.586 "tls_version": 0, 00:18:26.586 "enable_ktls": false 00:18:26.586 } 00:18:26.586 }, 00:18:26.586 { 00:18:26.586 "method": "sock_impl_set_options", 00:18:26.586 "params": { 00:18:26.586 "impl_name": "ssl", 00:18:26.586 "recv_buf_size": 4096, 00:18:26.586 "send_buf_size": 4096, 00:18:26.586 "enable_recv_pipe": true, 00:18:26.586 "enable_quickack": false, 00:18:26.586 "enable_placement_id": 0, 00:18:26.586 "enable_zerocopy_send_server": true, 00:18:26.586 "enable_zerocopy_send_client": false, 00:18:26.586 "zerocopy_threshold": 0, 00:18:26.586 "tls_version": 0, 00:18:26.586 "enable_ktls": false 00:18:26.586 } 00:18:26.586 } 00:18:26.586 ] 00:18:26.586 }, 00:18:26.586 { 00:18:26.586 "subsystem": "vmd", 00:18:26.586 "config": [] 00:18:26.586 }, 00:18:26.586 { 00:18:26.586 "subsystem": "accel", 00:18:26.586 "config": [ 00:18:26.586 { 00:18:26.586 "method": "accel_set_options", 00:18:26.586 "params": { 00:18:26.586 "small_cache_size": 128, 00:18:26.586 "large_cache_size": 16, 00:18:26.586 "task_count": 2048, 00:18:26.586 "sequence_count": 2048, 00:18:26.586 "buf_count": 2048 00:18:26.586 } 00:18:26.586 } 00:18:26.586 ] 00:18:26.586 }, 00:18:26.586 { 00:18:26.586 "subsystem": "bdev", 00:18:26.586 "config": [ 00:18:26.586 { 00:18:26.586 "method": "bdev_set_options", 00:18:26.586 "params": { 00:18:26.586 "bdev_io_pool_size": 65535, 00:18:26.586 "bdev_io_cache_size": 256, 00:18:26.586 "bdev_auto_examine": true, 00:18:26.586 "iobuf_small_cache_size": 128, 00:18:26.586 "iobuf_large_cache_size": 16 00:18:26.586 } 00:18:26.586 }, 00:18:26.586 { 00:18:26.586 "method": "bdev_raid_set_options", 00:18:26.587 "params": { 00:18:26.587 "process_window_size_kb": 1024 00:18:26.587 } 00:18:26.587 }, 00:18:26.587 { 00:18:26.587 "method": "bdev_iscsi_set_options", 00:18:26.587 "params": { 00:18:26.587 "timeout_sec": 30 00:18:26.587 } 00:18:26.587 }, 00:18:26.587 { 00:18:26.587 "method": "bdev_nvme_set_options", 00:18:26.587 "params": { 00:18:26.587 "action_on_timeout": "none", 00:18:26.587 "timeout_us": 0, 00:18:26.587 "timeout_admin_us": 0, 00:18:26.587 "keep_alive_timeout_ms": 10000, 00:18:26.587 "transport_retry_count": 4, 00:18:26.587 "arbitration_burst": 0, 00:18:26.587 "low_priority_weight": 0, 00:18:26.587 "medium_priority_weight": 0, 00:18:26.587 "high_priority_weight": 0, 00:18:26.587 "nvme_adminq_poll_period_us": 10000, 00:18:26.587 "nvme_ioq_poll_period_us": 0, 00:18:26.587 "io_queue_requests": 512, 00:18:26.587 "delay_cmd_submit": true, 00:18:26.587 "bdev_retry_count": 3, 00:18:26.587 "transport_ack_timeout": 0, 00:18:26.587 "ctrlr_loss_timeout_sec": 0, 00:18:26.587 "reconnect_delay_sec": 0, 00:18:26.587 "fast_io_fail_timeout_sec": 0, 00:18:26.587 "generate_uuids": false, 00:18:26.587 "transport_tos": 0, 00:18:26.587 "io_path_stat": false, 00:18:26.587 "allow_accel_sequence": false 00:18:26.587 } 00:18:26.587 }, 00:18:26.587 { 00:18:26.587 "method": "bdev_nvme_attach_controller", 00:18:26.587 "params": { 00:18:26.587 "name": "TLSTEST", 00:18:26.587 "trtype": "TCP", 00:18:26.587 "adrfam": "IPv4", 00:18:26.587 "traddr": "10.0.0.2", 00:18:26.587 "trsvcid": "4420", 00:18:26.587 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:26.587 "prchk_reftag": false, 00:18:26.587 "prchk_guard": false, 00:18:26.587 "ctrlr_loss_timeout_sec": 0, 00:18:26.587 "reconnect_delay_sec": 0, 00:18:26.587 "fast_io_fail_timeout_sec": 0, 00:18:26.587 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:26.587 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:26.587 "hdgst": false, 00:18:26.587 "ddgst": false 00:18:26.587 } 00:18:26.587 }, 00:18:26.587 { 00:18:26.587 "method": "bdev_nvme_set_hotplug", 00:18:26.587 "params": { 00:18:26.587 "period_us": 100000, 00:18:26.587 "enable": false 00:18:26.587 } 00:18:26.587 }, 00:18:26.587 { 00:18:26.587 "method": "bdev_wait_for_examine" 00:18:26.587 } 00:18:26.587 ] 00:18:26.587 }, 00:18:26.587 { 00:18:26.587 "subsystem": "nbd", 00:18:26.587 "config": [] 00:18:26.587 } 00:18:26.587 ] 00:18:26.587 }' 00:18:26.587 17:00:37 -- target/tls.sh@208 -- # killprocess 227636 00:18:26.587 17:00:37 -- common/autotest_common.sh@936 -- # '[' -z 227636 ']' 00:18:26.587 17:00:37 -- common/autotest_common.sh@940 -- # kill -0 227636 00:18:26.587 17:00:37 -- common/autotest_common.sh@941 -- # uname 00:18:26.587 17:00:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:26.587 17:00:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 227636 00:18:26.845 17:00:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:26.845 17:00:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:26.845 17:00:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 227636' 00:18:26.845 killing process with pid 227636 00:18:26.845 17:00:38 -- common/autotest_common.sh@955 -- # kill 227636 00:18:26.845 Received shutdown signal, test time was about 10.000000 seconds 00:18:26.845 00:18:26.845 Latency(us) 00:18:26.845 [2024-11-29T16:00:38.276Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:26.845 [2024-11-29T16:00:38.276Z] =================================================================================================================== 00:18:26.845 [2024-11-29T16:00:38.277Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:26.846 17:00:38 -- common/autotest_common.sh@960 -- # wait 227636 00:18:26.846 17:00:38 -- target/tls.sh@209 -- # killprocess 227291 00:18:26.846 17:00:38 -- common/autotest_common.sh@936 -- # '[' -z 227291 ']' 00:18:26.846 17:00:38 -- common/autotest_common.sh@940 -- # kill -0 227291 00:18:27.104 17:00:38 -- common/autotest_common.sh@941 -- # uname 00:18:27.104 17:00:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:27.104 17:00:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 227291 00:18:27.104 17:00:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:27.104 17:00:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:27.104 17:00:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 227291' 00:18:27.104 killing process with pid 227291 00:18:27.104 17:00:38 -- common/autotest_common.sh@955 -- # kill 227291 00:18:27.104 17:00:38 -- common/autotest_common.sh@960 -- # wait 227291 00:18:27.362 17:00:38 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:27.363 17:00:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:27.363 17:00:38 -- target/tls.sh@212 -- # echo '{ 00:18:27.363 "subsystems": [ 00:18:27.363 { 00:18:27.363 "subsystem": "iobuf", 00:18:27.363 "config": [ 00:18:27.363 { 00:18:27.363 "method": "iobuf_set_options", 00:18:27.363 "params": { 00:18:27.363 "small_pool_count": 8192, 00:18:27.363 "large_pool_count": 1024, 00:18:27.363 "small_bufsize": 8192, 00:18:27.363 "large_bufsize": 135168 00:18:27.363 } 00:18:27.363 } 00:18:27.363 ] 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "subsystem": "sock", 00:18:27.363 "config": [ 00:18:27.363 { 00:18:27.363 "method": "sock_impl_set_options", 00:18:27.363 "params": { 00:18:27.363 "impl_name": "posix", 00:18:27.363 "recv_buf_size": 2097152, 00:18:27.363 "send_buf_size": 2097152, 00:18:27.363 "enable_recv_pipe": true, 00:18:27.363 "enable_quickack": false, 00:18:27.363 "enable_placement_id": 0, 00:18:27.363 "enable_zerocopy_send_server": true, 00:18:27.363 "enable_zerocopy_send_client": false, 00:18:27.363 "zerocopy_threshold": 0, 00:18:27.363 "tls_version": 0, 00:18:27.363 "enable_ktls": false 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "sock_impl_set_options", 00:18:27.363 "params": { 00:18:27.363 "impl_name": "ssl", 00:18:27.363 "recv_buf_size": 4096, 00:18:27.363 "send_buf_size": 4096, 00:18:27.363 "enable_recv_pipe": true, 00:18:27.363 "enable_quickack": false, 00:18:27.363 "enable_placement_id": 0, 00:18:27.363 "enable_zerocopy_send_server": true, 00:18:27.363 "enable_zerocopy_send_client": false, 00:18:27.363 "zerocopy_threshold": 0, 00:18:27.363 "tls_version": 0, 00:18:27.363 "enable_ktls": false 00:18:27.363 } 00:18:27.363 } 00:18:27.363 ] 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "subsystem": "vmd", 00:18:27.363 "config": [] 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "subsystem": "accel", 00:18:27.363 "config": [ 00:18:27.363 { 00:18:27.363 "method": "accel_set_options", 00:18:27.363 "params": { 00:18:27.363 "small_cache_size": 128, 00:18:27.363 "large_cache_size": 16, 00:18:27.363 "task_count": 2048, 00:18:27.363 "sequence_count": 2048, 00:18:27.363 "buf_count": 2048 00:18:27.363 } 00:18:27.363 } 00:18:27.363 ] 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "subsystem": "bdev", 00:18:27.363 "config": [ 00:18:27.363 { 00:18:27.363 "method": "bdev_set_options", 00:18:27.363 "params": { 00:18:27.363 "bdev_io_pool_size": 65535, 00:18:27.363 "bdev_io_cache_size": 256, 00:18:27.363 "bdev_auto_examine": true, 00:18:27.363 "iobuf_small_cache_size": 128, 00:18:27.363 "iobuf_large_cache_size": 16 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "bdev_raid_set_options", 00:18:27.363 "params": { 00:18:27.363 "process_window_size_kb": 1024 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "bdev_iscsi_set_options", 00:18:27.363 "params": { 00:18:27.363 "timeout_sec": 30 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "bdev_nvme_set_options", 00:18:27.363 "params": { 00:18:27.363 "action_on_timeout": "none", 00:18:27.363 "timeout_us": 0, 00:18:27.363 "timeout_admin_us": 0, 00:18:27.363 "keep_alive_timeout_ms": 10000, 00:18:27.363 "transport_retry_count": 4, 00:18:27.363 "arbitration_burst": 0, 00:18:27.363 "low_priority_weight": 0, 00:18:27.363 "medium_priority_weight": 0, 00:18:27.363 "high_priority_weight": 0, 00:18:27.363 "nvme_adminq_poll_period_us": 10000, 00:18:27.363 "nvme_ioq_poll_period_us": 0, 00:18:27.363 "io_queue_requests": 0, 00:18:27.363 "delay_cmd_submit": true, 00:18:27.363 "bdev_retry_count": 3, 00:18:27.363 "transport_ack_timeout": 0, 00:18:27.363 "ctrlr_loss_timeout_sec": 0, 00:18:27.363 "reconnect_delay_sec": 0, 00:18:27.363 "fast_io_fail_timeout_sec": 0, 00:18:27.363 "generate_uuids": false, 00:18:27.363 "transport_tos": 0, 00:18:27.363 "io_path_stat": false, 00:18:27.363 "allow_accel_sequence": false 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "bdev_nvme_set_hotplug", 00:18:27.363 "params": { 00:18:27.363 "period_us": 100000, 00:18:27.363 "enable": false 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "bdev_malloc_create", 00:18:27.363 "params": { 00:18:27.363 "name": "malloc0", 00:18:27.363 "num_blocks": 8192, 00:18:27.363 "block_size": 4096, 00:18:27.363 "physical_block_size": 4096, 00:18:27.363 "uuid": "9f1f369a-89d6-4db3-ae73-03e6ede4b46a", 00:18:27.363 "optimal_io_boundary": 0 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "bdev_wait_for_examine" 00:18:27.363 } 00:18:27.363 ] 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "subsystem": "nbd", 00:18:27.363 "config": [] 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "subsystem": "scheduler", 00:18:27.363 "config": [ 00:18:27.363 { 00:18:27.363 "method": "framework_set_scheduler", 00:18:27.363 "params": { 00:18:27.363 "name": "static" 00:18:27.363 } 00:18:27.363 } 00:18:27.363 ] 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "subsystem": "nvmf", 00:18:27.363 "config": [ 00:18:27.363 { 00:18:27.363 "method": "nvmf_set_config", 00:18:27.363 "params": { 00:18:27.363 "discovery_filter": "match_any", 00:18:27.363 "admin_cmd_passthru": { 00:18:27.363 "identify_ctrlr": false 00:18:27.363 } 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "nvmf_set_max_subsystems", 00:18:27.363 "params": { 00:18:27.363 "max_subsystems": 1024 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "nvmf_set_crdt", 00:18:27.363 "params": { 00:18:27.363 "crdt1": 0, 00:18:27.363 "crdt2": 0, 00:18:27.363 "crdt3": 0 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "nvmf_create_transport", 00:18:27.363 "params": { 00:18:27.363 "trtype": "TCP", 00:18:27.363 "max_queue_depth": 128, 00:18:27.363 "max_io_qpairs_per_ctrlr": 127, 00:18:27.363 "in_capsule_data_size": 4096, 00:18:27.363 "max_io_size": 131072, 00:18:27.363 "io_unit_size": 131072, 00:18:27.363 "max_aq_depth": 128, 00:18:27.363 "num_shared_buffers": 511, 00:18:27.363 "buf_cache_size": 4294967295, 00:18:27.363 "dif_insert_or_strip": false, 00:18:27.363 "zcopy": false, 00:18:27.363 "c2h_success": false, 00:18:27.363 "sock_priority": 0, 00:18:27.363 "abort_timeout_sec": 1 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "nvmf_create_subsystem", 00:18:27.363 "params": { 00:18:27.363 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:27.363 "allow_any_host": false, 00:18:27.363 "serial_number": "SPDK00000000000001", 00:18:27.363 "model_number": "SPDK bdev Controller", 00:18:27.363 "max_namespaces": 10, 00:18:27.363 "min_cntlid": 1, 00:18:27.363 "max_cntlid": 65519, 00:18:27.363 "ana_reporting": false 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "nvmf_subsystem_add_host", 00:18:27.363 "params": { 00:18:27.363 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:27.363 "host": "nqn.2016-06.io.spdk:host1", 00:18:27.363 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:27.363 } 00:18:27.363 }, 00:18:27.363 { 00:18:27.363 "method": "nvmf_subsystem_add_ns", 00:18:27.363 "params": { 00:18:27.364 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:27.364 "namespace": { 00:18:27.364 "nsid": 1, 00:18:27.364 "bdev_name": "malloc0", 00:18:27.364 "nguid": "9F1F369A89D64DB3AE7303E6EDE4B46A", 00:18:27.364 "uuid": "9f1f369a-89d6-4db3-ae73-03e6ede4b46a" 00:18:27.364 } 00:18:27.364 } 00:18:27.364 }, 00:18:27.364 { 00:18:27.364 "method": "nvmf_subsystem_add_listener", 00:18:27.364 "params": { 00:18:27.364 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:27.364 "listen_address": { 00:18:27.364 "trtype": "TCP", 00:18:27.364 "adrfam": "IPv4", 00:18:27.364 "traddr": "10.0.0.2", 00:18:27.364 "trsvcid": "4420" 00:18:27.364 }, 00:18:27.364 "secure_channel": true 00:18:27.364 } 00:18:27.364 } 00:18:27.364 ] 00:18:27.364 } 00:18:27.364 ] 00:18:27.364 }' 00:18:27.364 17:00:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:27.364 17:00:38 -- common/autotest_common.sh@10 -- # set +x 00:18:27.364 17:00:38 -- nvmf/common.sh@469 -- # nvmfpid=228008 00:18:27.364 17:00:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:27.364 17:00:38 -- nvmf/common.sh@470 -- # waitforlisten 228008 00:18:27.364 17:00:38 -- common/autotest_common.sh@829 -- # '[' -z 228008 ']' 00:18:27.364 17:00:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:27.364 17:00:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:27.364 17:00:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:27.364 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:27.364 17:00:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:27.364 17:00:38 -- common/autotest_common.sh@10 -- # set +x 00:18:27.364 [2024-11-29 17:00:38.671695] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:27.364 [2024-11-29 17:00:38.671780] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:27.364 EAL: No free 2048 kB hugepages reported on node 1 00:18:27.364 [2024-11-29 17:00:38.741345] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:27.623 [2024-11-29 17:00:38.857640] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:27.623 [2024-11-29 17:00:38.857810] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:27.623 [2024-11-29 17:00:38.857829] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:27.623 [2024-11-29 17:00:38.857844] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:27.623 [2024-11-29 17:00:38.857877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:27.881 [2024-11-29 17:00:39.081094] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:27.881 [2024-11-29 17:00:39.113093] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:27.881 [2024-11-29 17:00:39.113368] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:28.449 17:00:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:28.449 17:00:39 -- common/autotest_common.sh@862 -- # return 0 00:18:28.449 17:00:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:28.449 17:00:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:28.449 17:00:39 -- common/autotest_common.sh@10 -- # set +x 00:18:28.449 17:00:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:28.449 17:00:39 -- target/tls.sh@216 -- # bdevperf_pid=228164 00:18:28.449 17:00:39 -- target/tls.sh@217 -- # waitforlisten 228164 /var/tmp/bdevperf.sock 00:18:28.449 17:00:39 -- common/autotest_common.sh@829 -- # '[' -z 228164 ']' 00:18:28.449 17:00:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:28.449 17:00:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:28.449 17:00:39 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:28.449 17:00:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:28.449 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:28.449 17:00:39 -- target/tls.sh@213 -- # echo '{ 00:18:28.449 "subsystems": [ 00:18:28.449 { 00:18:28.449 "subsystem": "iobuf", 00:18:28.449 "config": [ 00:18:28.449 { 00:18:28.449 "method": "iobuf_set_options", 00:18:28.449 "params": { 00:18:28.449 "small_pool_count": 8192, 00:18:28.449 "large_pool_count": 1024, 00:18:28.449 "small_bufsize": 8192, 00:18:28.449 "large_bufsize": 135168 00:18:28.449 } 00:18:28.449 } 00:18:28.449 ] 00:18:28.449 }, 00:18:28.449 { 00:18:28.449 "subsystem": "sock", 00:18:28.449 "config": [ 00:18:28.449 { 00:18:28.449 "method": "sock_impl_set_options", 00:18:28.449 "params": { 00:18:28.449 "impl_name": "posix", 00:18:28.449 "recv_buf_size": 2097152, 00:18:28.449 "send_buf_size": 2097152, 00:18:28.449 "enable_recv_pipe": true, 00:18:28.449 "enable_quickack": false, 00:18:28.449 "enable_placement_id": 0, 00:18:28.449 "enable_zerocopy_send_server": true, 00:18:28.449 "enable_zerocopy_send_client": false, 00:18:28.449 "zerocopy_threshold": 0, 00:18:28.449 "tls_version": 0, 00:18:28.449 "enable_ktls": false 00:18:28.449 } 00:18:28.449 }, 00:18:28.449 { 00:18:28.449 "method": "sock_impl_set_options", 00:18:28.449 "params": { 00:18:28.449 "impl_name": "ssl", 00:18:28.449 "recv_buf_size": 4096, 00:18:28.449 "send_buf_size": 4096, 00:18:28.449 "enable_recv_pipe": true, 00:18:28.449 "enable_quickack": false, 00:18:28.449 "enable_placement_id": 0, 00:18:28.449 "enable_zerocopy_send_server": true, 00:18:28.449 "enable_zerocopy_send_client": false, 00:18:28.449 "zerocopy_threshold": 0, 00:18:28.449 "tls_version": 0, 00:18:28.449 "enable_ktls": false 00:18:28.449 } 00:18:28.449 } 00:18:28.449 ] 00:18:28.449 }, 00:18:28.449 { 00:18:28.449 "subsystem": "vmd", 00:18:28.449 "config": [] 00:18:28.449 }, 00:18:28.449 { 00:18:28.449 "subsystem": "accel", 00:18:28.449 "config": [ 00:18:28.449 { 00:18:28.449 "method": "accel_set_options", 00:18:28.449 "params": { 00:18:28.449 "small_cache_size": 128, 00:18:28.449 "large_cache_size": 16, 00:18:28.449 "task_count": 2048, 00:18:28.449 "sequence_count": 2048, 00:18:28.449 "buf_count": 2048 00:18:28.449 } 00:18:28.449 } 00:18:28.449 ] 00:18:28.449 }, 00:18:28.449 { 00:18:28.449 "subsystem": "bdev", 00:18:28.449 "config": [ 00:18:28.449 { 00:18:28.449 "method": "bdev_set_options", 00:18:28.449 "params": { 00:18:28.449 "bdev_io_pool_size": 65535, 00:18:28.449 "bdev_io_cache_size": 256, 00:18:28.449 "bdev_auto_examine": true, 00:18:28.449 "iobuf_small_cache_size": 128, 00:18:28.449 "iobuf_large_cache_size": 16 00:18:28.449 } 00:18:28.449 }, 00:18:28.449 { 00:18:28.449 "method": "bdev_raid_set_options", 00:18:28.449 "params": { 00:18:28.449 "process_window_size_kb": 1024 00:18:28.449 } 00:18:28.449 }, 00:18:28.449 { 00:18:28.449 "method": "bdev_iscsi_set_options", 00:18:28.449 "params": { 00:18:28.449 "timeout_sec": 30 00:18:28.449 } 00:18:28.449 }, 00:18:28.450 { 00:18:28.450 "method": "bdev_nvme_set_options", 00:18:28.450 "params": { 00:18:28.450 "action_on_timeout": "none", 00:18:28.450 "timeout_us": 0, 00:18:28.450 "timeout_admin_us": 0, 00:18:28.450 "keep_alive_timeout_ms": 10000, 00:18:28.450 "transport_retry_count": 4, 00:18:28.450 "arbitration_burst": 0, 00:18:28.450 "low_priority_weight": 0, 00:18:28.450 "medium_priority_weight": 0, 00:18:28.450 "high_priority_weight": 0, 00:18:28.450 "nvme_adminq_poll_period_us": 10000, 00:18:28.450 "nvme_ioq_poll_period_us": 0, 00:18:28.450 "io_queue_requests": 512, 00:18:28.450 "delay_cmd_submit": true, 00:18:28.450 "bdev_retry_count": 3, 00:18:28.450 "transport_ack_timeout": 0, 00:18:28.450 "ctrlr_loss_timeout_sec": 0, 00:18:28.450 "reconnect_delay_sec": 0, 00:18:28.450 "fast_io_fail_timeout_sec": 0, 00:18:28.450 "generate_uuids": false, 00:18:28.450 "transport_tos": 0, 00:18:28.450 "io_path_stat": false, 00:18:28.450 "allow_accel_sequence": false 00:18:28.450 } 00:18:28.450 }, 00:18:28.450 { 00:18:28.450 "method": "bdev_nvme_attach_controller", 00:18:28.450 "params": { 00:18:28.450 "name": "TLSTEST", 00:18:28.450 "trtype": "TCP", 00:18:28.450 "adrfam": "IPv4", 00:18:28.450 "traddr": "10.0.0.2", 00:18:28.450 "trsvcid": "4420", 00:18:28.450 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:28.450 "prchk_reftag": false, 00:18:28.450 "prchk_guard": false, 00:18:28.450 "ctrlr_loss_timeout_sec": 0, 00:18:28.450 "reconnect_delay_sec": 0, 00:18:28.450 "fast_io_fail_timeout_sec": 0, 00:18:28.450 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:28.450 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:28.450 "hdgst": false, 00:18:28.450 "ddgst": false 00:18:28.450 } 00:18:28.450 }, 00:18:28.450 { 00:18:28.450 "method": "bdev_nvme_set_hotplug", 00:18:28.450 "params": { 00:18:28.450 "period_us": 100000, 00:18:28.450 "enable": false 00:18:28.450 } 00:18:28.450 }, 00:18:28.450 { 00:18:28.450 "method": "bdev_wait_for_examine" 00:18:28.450 } 00:18:28.450 ] 00:18:28.450 }, 00:18:28.450 { 00:18:28.450 "subsystem": "nbd", 00:18:28.450 "config": [] 00:18:28.450 } 00:18:28.450 ] 00:18:28.450 }' 00:18:28.450 17:00:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:28.450 17:00:39 -- common/autotest_common.sh@10 -- # set +x 00:18:28.450 [2024-11-29 17:00:39.678476] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:28.450 [2024-11-29 17:00:39.678546] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid228164 ] 00:18:28.450 EAL: No free 2048 kB hugepages reported on node 1 00:18:28.450 [2024-11-29 17:00:39.739564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:28.450 [2024-11-29 17:00:39.857290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:28.709 [2024-11-29 17:00:40.027033] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:29.276 17:00:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:29.276 17:00:40 -- common/autotest_common.sh@862 -- # return 0 00:18:29.276 17:00:40 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:29.534 Running I/O for 10 seconds... 00:18:39.506 00:18:39.506 Latency(us) 00:18:39.506 [2024-11-29T16:00:50.937Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.506 [2024-11-29T16:00:50.937Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:39.506 Verification LBA range: start 0x0 length 0x2000 00:18:39.506 TLSTESTn1 : 10.02 4319.27 16.87 0.00 0.00 29592.68 7087.60 50098.63 00:18:39.506 [2024-11-29T16:00:50.937Z] =================================================================================================================== 00:18:39.506 [2024-11-29T16:00:50.937Z] Total : 4319.27 16.87 0.00 0.00 29592.68 7087.60 50098.63 00:18:39.506 0 00:18:39.506 17:00:50 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:39.506 17:00:50 -- target/tls.sh@223 -- # killprocess 228164 00:18:39.506 17:00:50 -- common/autotest_common.sh@936 -- # '[' -z 228164 ']' 00:18:39.506 17:00:50 -- common/autotest_common.sh@940 -- # kill -0 228164 00:18:39.506 17:00:50 -- common/autotest_common.sh@941 -- # uname 00:18:39.506 17:00:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.506 17:00:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 228164 00:18:39.506 17:00:50 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:39.506 17:00:50 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:39.506 17:00:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 228164' 00:18:39.506 killing process with pid 228164 00:18:39.506 17:00:50 -- common/autotest_common.sh@955 -- # kill 228164 00:18:39.506 Received shutdown signal, test time was about 10.000000 seconds 00:18:39.506 00:18:39.506 Latency(us) 00:18:39.506 [2024-11-29T16:00:50.937Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.506 [2024-11-29T16:00:50.937Z] =================================================================================================================== 00:18:39.506 [2024-11-29T16:00:50.937Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:39.506 17:00:50 -- common/autotest_common.sh@960 -- # wait 228164 00:18:39.764 17:00:51 -- target/tls.sh@224 -- # killprocess 228008 00:18:39.764 17:00:51 -- common/autotest_common.sh@936 -- # '[' -z 228008 ']' 00:18:39.764 17:00:51 -- common/autotest_common.sh@940 -- # kill -0 228008 00:18:39.764 17:00:51 -- common/autotest_common.sh@941 -- # uname 00:18:39.764 17:00:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.764 17:00:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 228008 00:18:39.764 17:00:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:39.764 17:00:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:39.764 17:00:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 228008' 00:18:39.764 killing process with pid 228008 00:18:39.764 17:00:51 -- common/autotest_common.sh@955 -- # kill 228008 00:18:39.764 17:00:51 -- common/autotest_common.sh@960 -- # wait 228008 00:18:40.330 17:00:51 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:40.330 17:00:51 -- target/tls.sh@227 -- # cleanup 00:18:40.330 17:00:51 -- target/tls.sh@15 -- # process_shm --id 0 00:18:40.330 17:00:51 -- common/autotest_common.sh@806 -- # type=--id 00:18:40.330 17:00:51 -- common/autotest_common.sh@807 -- # id=0 00:18:40.330 17:00:51 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:40.330 17:00:51 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:40.330 17:00:51 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:40.330 17:00:51 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:40.330 17:00:51 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:40.330 17:00:51 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:40.330 nvmf_trace.0 00:18:40.330 17:00:51 -- common/autotest_common.sh@821 -- # return 0 00:18:40.330 17:00:51 -- target/tls.sh@16 -- # killprocess 228164 00:18:40.330 17:00:51 -- common/autotest_common.sh@936 -- # '[' -z 228164 ']' 00:18:40.330 17:00:51 -- common/autotest_common.sh@940 -- # kill -0 228164 00:18:40.330 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (228164) - No such process 00:18:40.330 17:00:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 228164 is not found' 00:18:40.330 Process with pid 228164 is not found 00:18:40.330 17:00:51 -- target/tls.sh@17 -- # nvmftestfini 00:18:40.330 17:00:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:40.330 17:00:51 -- nvmf/common.sh@116 -- # sync 00:18:40.330 17:00:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:40.330 17:00:51 -- nvmf/common.sh@119 -- # set +e 00:18:40.330 17:00:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:40.330 17:00:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:40.330 rmmod nvme_tcp 00:18:40.330 rmmod nvme_fabrics 00:18:40.330 rmmod nvme_keyring 00:18:40.330 17:00:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:40.330 17:00:51 -- nvmf/common.sh@123 -- # set -e 00:18:40.330 17:00:51 -- nvmf/common.sh@124 -- # return 0 00:18:40.330 17:00:51 -- nvmf/common.sh@477 -- # '[' -n 228008 ']' 00:18:40.330 17:00:51 -- nvmf/common.sh@478 -- # killprocess 228008 00:18:40.330 17:00:51 -- common/autotest_common.sh@936 -- # '[' -z 228008 ']' 00:18:40.330 17:00:51 -- common/autotest_common.sh@940 -- # kill -0 228008 00:18:40.330 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (228008) - No such process 00:18:40.330 17:00:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 228008 is not found' 00:18:40.330 Process with pid 228008 is not found 00:18:40.330 17:00:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:40.330 17:00:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:40.330 17:00:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:40.330 17:00:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:40.330 17:00:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:40.331 17:00:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:40.331 17:00:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:40.331 17:00:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:42.234 17:00:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:42.234 17:00:53 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:42.234 00:18:42.234 real 1m15.914s 00:18:42.234 user 2m4.686s 00:18:42.234 sys 0m22.071s 00:18:42.234 17:00:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:42.234 17:00:53 -- common/autotest_common.sh@10 -- # set +x 00:18:42.234 ************************************ 00:18:42.234 END TEST nvmf_tls 00:18:42.234 ************************************ 00:18:42.234 17:00:53 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:42.234 17:00:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:42.234 17:00:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:42.234 17:00:53 -- common/autotest_common.sh@10 -- # set +x 00:18:42.234 ************************************ 00:18:42.234 START TEST nvmf_fips 00:18:42.234 ************************************ 00:18:42.234 17:00:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:42.495 * Looking for test storage... 00:18:42.495 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:42.495 17:00:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:42.495 17:00:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:42.495 17:00:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:42.495 17:00:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:42.495 17:00:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:42.495 17:00:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:42.495 17:00:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:42.495 17:00:53 -- scripts/common.sh@335 -- # IFS=.-: 00:18:42.495 17:00:53 -- scripts/common.sh@335 -- # read -ra ver1 00:18:42.495 17:00:53 -- scripts/common.sh@336 -- # IFS=.-: 00:18:42.495 17:00:53 -- scripts/common.sh@336 -- # read -ra ver2 00:18:42.495 17:00:53 -- scripts/common.sh@337 -- # local 'op=<' 00:18:42.495 17:00:53 -- scripts/common.sh@339 -- # ver1_l=2 00:18:42.495 17:00:53 -- scripts/common.sh@340 -- # ver2_l=1 00:18:42.495 17:00:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:42.495 17:00:53 -- scripts/common.sh@343 -- # case "$op" in 00:18:42.495 17:00:53 -- scripts/common.sh@344 -- # : 1 00:18:42.495 17:00:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:42.495 17:00:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:42.495 17:00:53 -- scripts/common.sh@364 -- # decimal 1 00:18:42.495 17:00:53 -- scripts/common.sh@352 -- # local d=1 00:18:42.495 17:00:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:42.495 17:00:53 -- scripts/common.sh@354 -- # echo 1 00:18:42.495 17:00:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:42.495 17:00:53 -- scripts/common.sh@365 -- # decimal 2 00:18:42.495 17:00:53 -- scripts/common.sh@352 -- # local d=2 00:18:42.495 17:00:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:42.495 17:00:53 -- scripts/common.sh@354 -- # echo 2 00:18:42.495 17:00:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:42.495 17:00:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:42.495 17:00:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:42.495 17:00:53 -- scripts/common.sh@367 -- # return 0 00:18:42.495 17:00:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:42.495 17:00:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:42.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.496 --rc genhtml_branch_coverage=1 00:18:42.496 --rc genhtml_function_coverage=1 00:18:42.496 --rc genhtml_legend=1 00:18:42.496 --rc geninfo_all_blocks=1 00:18:42.496 --rc geninfo_unexecuted_blocks=1 00:18:42.496 00:18:42.496 ' 00:18:42.496 17:00:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:42.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.496 --rc genhtml_branch_coverage=1 00:18:42.496 --rc genhtml_function_coverage=1 00:18:42.496 --rc genhtml_legend=1 00:18:42.496 --rc geninfo_all_blocks=1 00:18:42.496 --rc geninfo_unexecuted_blocks=1 00:18:42.496 00:18:42.496 ' 00:18:42.496 17:00:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:42.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.496 --rc genhtml_branch_coverage=1 00:18:42.496 --rc genhtml_function_coverage=1 00:18:42.496 --rc genhtml_legend=1 00:18:42.496 --rc geninfo_all_blocks=1 00:18:42.496 --rc geninfo_unexecuted_blocks=1 00:18:42.496 00:18:42.496 ' 00:18:42.496 17:00:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:42.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.496 --rc genhtml_branch_coverage=1 00:18:42.496 --rc genhtml_function_coverage=1 00:18:42.496 --rc genhtml_legend=1 00:18:42.496 --rc geninfo_all_blocks=1 00:18:42.496 --rc geninfo_unexecuted_blocks=1 00:18:42.496 00:18:42.496 ' 00:18:42.496 17:00:53 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:42.496 17:00:53 -- nvmf/common.sh@7 -- # uname -s 00:18:42.496 17:00:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:42.496 17:00:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:42.496 17:00:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:42.496 17:00:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:42.496 17:00:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:42.496 17:00:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:42.496 17:00:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:42.496 17:00:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:42.496 17:00:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:42.496 17:00:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:42.496 17:00:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:42.496 17:00:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:42.496 17:00:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:42.496 17:00:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:42.496 17:00:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:42.496 17:00:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:42.496 17:00:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:42.496 17:00:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:42.496 17:00:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:42.496 17:00:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.496 17:00:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.496 17:00:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.496 17:00:53 -- paths/export.sh@5 -- # export PATH 00:18:42.496 17:00:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.496 17:00:53 -- nvmf/common.sh@46 -- # : 0 00:18:42.496 17:00:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:42.496 17:00:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:42.496 17:00:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:42.496 17:00:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:42.496 17:00:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:42.496 17:00:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:42.496 17:00:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:42.496 17:00:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:42.496 17:00:53 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:42.496 17:00:53 -- fips/fips.sh@89 -- # check_openssl_version 00:18:42.496 17:00:53 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:42.496 17:00:53 -- fips/fips.sh@85 -- # openssl version 00:18:42.496 17:00:53 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:42.496 17:00:53 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:42.496 17:00:53 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:42.496 17:00:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:42.496 17:00:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:42.496 17:00:53 -- scripts/common.sh@335 -- # IFS=.-: 00:18:42.496 17:00:53 -- scripts/common.sh@335 -- # read -ra ver1 00:18:42.496 17:00:53 -- scripts/common.sh@336 -- # IFS=.-: 00:18:42.496 17:00:53 -- scripts/common.sh@336 -- # read -ra ver2 00:18:42.496 17:00:53 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:42.496 17:00:53 -- scripts/common.sh@339 -- # ver1_l=3 00:18:42.496 17:00:53 -- scripts/common.sh@340 -- # ver2_l=3 00:18:42.496 17:00:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:42.496 17:00:53 -- scripts/common.sh@343 -- # case "$op" in 00:18:42.496 17:00:53 -- scripts/common.sh@347 -- # : 1 00:18:42.496 17:00:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:42.496 17:00:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:42.496 17:00:53 -- scripts/common.sh@364 -- # decimal 3 00:18:42.496 17:00:53 -- scripts/common.sh@352 -- # local d=3 00:18:42.496 17:00:53 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:42.496 17:00:53 -- scripts/common.sh@354 -- # echo 3 00:18:42.496 17:00:53 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:42.496 17:00:53 -- scripts/common.sh@365 -- # decimal 3 00:18:42.496 17:00:53 -- scripts/common.sh@352 -- # local d=3 00:18:42.496 17:00:53 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:42.496 17:00:53 -- scripts/common.sh@354 -- # echo 3 00:18:42.496 17:00:53 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:42.496 17:00:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:42.496 17:00:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:42.496 17:00:53 -- scripts/common.sh@363 -- # (( v++ )) 00:18:42.496 17:00:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:42.496 17:00:53 -- scripts/common.sh@364 -- # decimal 1 00:18:42.496 17:00:53 -- scripts/common.sh@352 -- # local d=1 00:18:42.496 17:00:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:42.496 17:00:53 -- scripts/common.sh@354 -- # echo 1 00:18:42.496 17:00:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:42.496 17:00:53 -- scripts/common.sh@365 -- # decimal 0 00:18:42.496 17:00:53 -- scripts/common.sh@352 -- # local d=0 00:18:42.496 17:00:53 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:42.496 17:00:53 -- scripts/common.sh@354 -- # echo 0 00:18:42.496 17:00:53 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:42.496 17:00:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:42.496 17:00:53 -- scripts/common.sh@366 -- # return 0 00:18:42.496 17:00:53 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:42.496 17:00:53 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:42.496 17:00:53 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:42.496 17:00:53 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:42.496 17:00:53 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:42.496 17:00:53 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:42.496 17:00:53 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:42.496 17:00:53 -- fips/fips.sh@113 -- # build_openssl_config 00:18:42.496 17:00:53 -- fips/fips.sh@37 -- # cat 00:18:42.496 17:00:53 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:42.496 17:00:53 -- fips/fips.sh@58 -- # cat - 00:18:42.496 17:00:53 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:42.496 17:00:53 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:42.496 17:00:53 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:42.496 17:00:53 -- fips/fips.sh@116 -- # openssl list -providers 00:18:42.496 17:00:53 -- fips/fips.sh@116 -- # grep name 00:18:42.756 17:00:53 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:42.756 17:00:53 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:42.756 17:00:53 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:42.756 17:00:53 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:42.756 17:00:53 -- fips/fips.sh@127 -- # : 00:18:42.756 17:00:53 -- common/autotest_common.sh@650 -- # local es=0 00:18:42.756 17:00:53 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:42.756 17:00:53 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:42.756 17:00:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:42.756 17:00:53 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:42.756 17:00:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:42.756 17:00:53 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:42.756 17:00:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:42.756 17:00:53 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:42.756 17:00:53 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:42.756 17:00:53 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:42.756 Error setting digest 00:18:42.756 4002A4F55B7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:42.756 4002A4F55B7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:42.756 17:00:53 -- common/autotest_common.sh@653 -- # es=1 00:18:42.756 17:00:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:42.756 17:00:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:42.756 17:00:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:42.756 17:00:53 -- fips/fips.sh@130 -- # nvmftestinit 00:18:42.756 17:00:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:42.756 17:00:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:42.756 17:00:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:42.756 17:00:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:42.756 17:00:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:42.756 17:00:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:42.756 17:00:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:42.756 17:00:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:42.756 17:00:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:42.756 17:00:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:42.756 17:00:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:42.756 17:00:53 -- common/autotest_common.sh@10 -- # set +x 00:18:44.662 17:00:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:44.662 17:00:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:44.662 17:00:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:44.662 17:00:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:44.662 17:00:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:44.662 17:00:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:44.662 17:00:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:44.662 17:00:56 -- nvmf/common.sh@294 -- # net_devs=() 00:18:44.662 17:00:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:44.662 17:00:56 -- nvmf/common.sh@295 -- # e810=() 00:18:44.662 17:00:56 -- nvmf/common.sh@295 -- # local -ga e810 00:18:44.662 17:00:56 -- nvmf/common.sh@296 -- # x722=() 00:18:44.662 17:00:56 -- nvmf/common.sh@296 -- # local -ga x722 00:18:44.662 17:00:56 -- nvmf/common.sh@297 -- # mlx=() 00:18:44.662 17:00:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:44.662 17:00:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:44.662 17:00:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:44.662 17:00:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:44.662 17:00:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:44.662 17:00:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:44.662 17:00:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:44.662 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:44.662 17:00:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:44.662 17:00:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:44.662 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:44.662 17:00:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:44.662 17:00:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:44.662 17:00:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:44.662 17:00:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:44.662 17:00:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:44.922 17:00:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:44.922 17:00:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:44.922 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:44.922 17:00:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:44.922 17:00:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:44.922 17:00:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:44.922 17:00:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:44.922 17:00:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:44.922 17:00:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:44.922 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:44.922 17:00:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:44.922 17:00:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:44.922 17:00:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:44.922 17:00:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:44.922 17:00:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:44.922 17:00:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:44.922 17:00:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:44.922 17:00:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:44.922 17:00:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:44.922 17:00:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:44.922 17:00:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:44.922 17:00:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:44.922 17:00:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:44.922 17:00:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:44.922 17:00:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:44.922 17:00:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:44.922 17:00:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:44.922 17:00:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:44.922 17:00:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:44.922 17:00:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:44.922 17:00:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:44.922 17:00:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:44.922 17:00:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:44.922 17:00:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:44.922 17:00:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:44.922 17:00:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:44.922 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:44.922 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:18:44.922 00:18:44.922 --- 10.0.0.2 ping statistics --- 00:18:44.922 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:44.922 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:18:44.922 17:00:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:44.922 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:44.922 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:18:44.922 00:18:44.922 --- 10.0.0.1 ping statistics --- 00:18:44.922 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:44.922 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:18:44.922 17:00:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:44.922 17:00:56 -- nvmf/common.sh@410 -- # return 0 00:18:44.922 17:00:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:44.922 17:00:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:44.922 17:00:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:44.922 17:00:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:44.922 17:00:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:44.922 17:00:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:44.922 17:00:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:44.922 17:00:56 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:44.922 17:00:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:44.922 17:00:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:44.922 17:00:56 -- common/autotest_common.sh@10 -- # set +x 00:18:44.922 17:00:56 -- nvmf/common.sh@469 -- # nvmfpid=231527 00:18:44.922 17:00:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:44.922 17:00:56 -- nvmf/common.sh@470 -- # waitforlisten 231527 00:18:44.922 17:00:56 -- common/autotest_common.sh@829 -- # '[' -z 231527 ']' 00:18:44.922 17:00:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:44.922 17:00:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:44.922 17:00:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:44.922 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:44.922 17:00:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:44.922 17:00:56 -- common/autotest_common.sh@10 -- # set +x 00:18:44.922 [2024-11-29 17:00:56.321856] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:44.922 [2024-11-29 17:00:56.321927] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:45.181 EAL: No free 2048 kB hugepages reported on node 1 00:18:45.181 [2024-11-29 17:00:56.385927] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:45.181 [2024-11-29 17:00:56.492715] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:45.181 [2024-11-29 17:00:56.492853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:45.181 [2024-11-29 17:00:56.492869] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:45.181 [2024-11-29 17:00:56.492881] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:45.181 [2024-11-29 17:00:56.492906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:46.117 17:00:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:46.117 17:00:57 -- common/autotest_common.sh@862 -- # return 0 00:18:46.117 17:00:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:46.117 17:00:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:46.117 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:18:46.117 17:00:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:46.117 17:00:57 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:46.117 17:00:57 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:46.117 17:00:57 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:46.117 17:00:57 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:46.117 17:00:57 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:46.117 17:00:57 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:46.117 17:00:57 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:46.117 17:00:57 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:46.376 [2024-11-29 17:00:57.617112] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:46.376 [2024-11-29 17:00:57.633113] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:46.376 [2024-11-29 17:00:57.633373] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:46.376 malloc0 00:18:46.376 17:00:57 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:46.376 17:00:57 -- fips/fips.sh@147 -- # bdevperf_pid=231788 00:18:46.376 17:00:57 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:46.376 17:00:57 -- fips/fips.sh@148 -- # waitforlisten 231788 /var/tmp/bdevperf.sock 00:18:46.376 17:00:57 -- common/autotest_common.sh@829 -- # '[' -z 231788 ']' 00:18:46.376 17:00:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:46.376 17:00:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:46.376 17:00:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:46.376 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:46.376 17:00:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:46.376 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:18:46.376 [2024-11-29 17:00:57.751436] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:46.376 [2024-11-29 17:00:57.751513] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid231788 ] 00:18:46.376 EAL: No free 2048 kB hugepages reported on node 1 00:18:46.634 [2024-11-29 17:00:57.810079] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:46.634 [2024-11-29 17:00:57.920805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:47.569 17:00:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:47.569 17:00:58 -- common/autotest_common.sh@862 -- # return 0 00:18:47.569 17:00:58 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:47.569 [2024-11-29 17:00:58.960538] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:47.828 TLSTESTn1 00:18:47.828 17:00:59 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:47.828 Running I/O for 10 seconds... 00:18:57.799 00:18:57.799 Latency(us) 00:18:57.799 [2024-11-29T16:01:09.230Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:57.799 [2024-11-29T16:01:09.230Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:57.799 Verification LBA range: start 0x0 length 0x2000 00:18:57.799 TLSTESTn1 : 10.01 4507.01 17.61 0.00 0.00 28360.96 5242.88 47185.92 00:18:57.799 [2024-11-29T16:01:09.230Z] =================================================================================================================== 00:18:57.799 [2024-11-29T16:01:09.230Z] Total : 4507.01 17.61 0.00 0.00 28360.96 5242.88 47185.92 00:18:57.799 0 00:18:57.799 17:01:09 -- fips/fips.sh@1 -- # cleanup 00:18:57.799 17:01:09 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:57.799 17:01:09 -- common/autotest_common.sh@806 -- # type=--id 00:18:57.799 17:01:09 -- common/autotest_common.sh@807 -- # id=0 00:18:57.799 17:01:09 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:57.799 17:01:09 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:57.799 17:01:09 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:57.799 17:01:09 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:57.799 17:01:09 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:57.799 17:01:09 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:57.799 nvmf_trace.0 00:18:58.058 17:01:09 -- common/autotest_common.sh@821 -- # return 0 00:18:58.058 17:01:09 -- fips/fips.sh@16 -- # killprocess 231788 00:18:58.058 17:01:09 -- common/autotest_common.sh@936 -- # '[' -z 231788 ']' 00:18:58.058 17:01:09 -- common/autotest_common.sh@940 -- # kill -0 231788 00:18:58.058 17:01:09 -- common/autotest_common.sh@941 -- # uname 00:18:58.058 17:01:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:58.058 17:01:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 231788 00:18:58.058 17:01:09 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:58.058 17:01:09 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:58.058 17:01:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 231788' 00:18:58.058 killing process with pid 231788 00:18:58.058 17:01:09 -- common/autotest_common.sh@955 -- # kill 231788 00:18:58.058 Received shutdown signal, test time was about 10.000000 seconds 00:18:58.058 00:18:58.058 Latency(us) 00:18:58.058 [2024-11-29T16:01:09.489Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:58.058 [2024-11-29T16:01:09.489Z] =================================================================================================================== 00:18:58.058 [2024-11-29T16:01:09.489Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:58.058 17:01:09 -- common/autotest_common.sh@960 -- # wait 231788 00:18:58.316 17:01:09 -- fips/fips.sh@17 -- # nvmftestfini 00:18:58.316 17:01:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:58.316 17:01:09 -- nvmf/common.sh@116 -- # sync 00:18:58.316 17:01:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:58.316 17:01:09 -- nvmf/common.sh@119 -- # set +e 00:18:58.316 17:01:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:58.316 17:01:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:58.316 rmmod nvme_tcp 00:18:58.316 rmmod nvme_fabrics 00:18:58.316 rmmod nvme_keyring 00:18:58.316 17:01:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:58.316 17:01:09 -- nvmf/common.sh@123 -- # set -e 00:18:58.316 17:01:09 -- nvmf/common.sh@124 -- # return 0 00:18:58.316 17:01:09 -- nvmf/common.sh@477 -- # '[' -n 231527 ']' 00:18:58.316 17:01:09 -- nvmf/common.sh@478 -- # killprocess 231527 00:18:58.316 17:01:09 -- common/autotest_common.sh@936 -- # '[' -z 231527 ']' 00:18:58.316 17:01:09 -- common/autotest_common.sh@940 -- # kill -0 231527 00:18:58.316 17:01:09 -- common/autotest_common.sh@941 -- # uname 00:18:58.316 17:01:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:58.316 17:01:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 231527 00:18:58.316 17:01:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:58.316 17:01:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:58.316 17:01:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 231527' 00:18:58.316 killing process with pid 231527 00:18:58.316 17:01:09 -- common/autotest_common.sh@955 -- # kill 231527 00:18:58.316 17:01:09 -- common/autotest_common.sh@960 -- # wait 231527 00:18:58.575 17:01:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:58.575 17:01:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:58.575 17:01:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:58.575 17:01:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:58.575 17:01:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:58.575 17:01:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:58.575 17:01:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:58.575 17:01:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:01.113 17:01:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:01.113 17:01:11 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:01.113 00:19:01.113 real 0m18.330s 00:19:01.113 user 0m24.068s 00:19:01.113 sys 0m5.832s 00:19:01.113 17:01:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:01.113 17:01:11 -- common/autotest_common.sh@10 -- # set +x 00:19:01.113 ************************************ 00:19:01.113 END TEST nvmf_fips 00:19:01.113 ************************************ 00:19:01.113 17:01:11 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:19:01.113 17:01:11 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:19:01.113 17:01:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:01.113 17:01:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:01.113 17:01:11 -- common/autotest_common.sh@10 -- # set +x 00:19:01.113 ************************************ 00:19:01.113 START TEST nvmf_fuzz 00:19:01.113 ************************************ 00:19:01.113 17:01:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:19:01.113 * Looking for test storage... 00:19:01.113 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:01.113 17:01:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:01.113 17:01:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:01.113 17:01:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:01.113 17:01:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:01.113 17:01:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:01.113 17:01:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:01.113 17:01:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:01.113 17:01:12 -- scripts/common.sh@335 -- # IFS=.-: 00:19:01.113 17:01:12 -- scripts/common.sh@335 -- # read -ra ver1 00:19:01.113 17:01:12 -- scripts/common.sh@336 -- # IFS=.-: 00:19:01.113 17:01:12 -- scripts/common.sh@336 -- # read -ra ver2 00:19:01.113 17:01:12 -- scripts/common.sh@337 -- # local 'op=<' 00:19:01.113 17:01:12 -- scripts/common.sh@339 -- # ver1_l=2 00:19:01.113 17:01:12 -- scripts/common.sh@340 -- # ver2_l=1 00:19:01.113 17:01:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:01.113 17:01:12 -- scripts/common.sh@343 -- # case "$op" in 00:19:01.113 17:01:12 -- scripts/common.sh@344 -- # : 1 00:19:01.113 17:01:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:01.113 17:01:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:01.113 17:01:12 -- scripts/common.sh@364 -- # decimal 1 00:19:01.113 17:01:12 -- scripts/common.sh@352 -- # local d=1 00:19:01.113 17:01:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:01.113 17:01:12 -- scripts/common.sh@354 -- # echo 1 00:19:01.113 17:01:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:01.113 17:01:12 -- scripts/common.sh@365 -- # decimal 2 00:19:01.113 17:01:12 -- scripts/common.sh@352 -- # local d=2 00:19:01.113 17:01:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:01.113 17:01:12 -- scripts/common.sh@354 -- # echo 2 00:19:01.113 17:01:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:01.113 17:01:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:01.113 17:01:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:01.113 17:01:12 -- scripts/common.sh@367 -- # return 0 00:19:01.113 17:01:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:01.113 17:01:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:01.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:01.113 --rc genhtml_branch_coverage=1 00:19:01.113 --rc genhtml_function_coverage=1 00:19:01.114 --rc genhtml_legend=1 00:19:01.114 --rc geninfo_all_blocks=1 00:19:01.114 --rc geninfo_unexecuted_blocks=1 00:19:01.114 00:19:01.114 ' 00:19:01.114 17:01:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:01.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:01.114 --rc genhtml_branch_coverage=1 00:19:01.114 --rc genhtml_function_coverage=1 00:19:01.114 --rc genhtml_legend=1 00:19:01.114 --rc geninfo_all_blocks=1 00:19:01.114 --rc geninfo_unexecuted_blocks=1 00:19:01.114 00:19:01.114 ' 00:19:01.114 17:01:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:01.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:01.114 --rc genhtml_branch_coverage=1 00:19:01.114 --rc genhtml_function_coverage=1 00:19:01.114 --rc genhtml_legend=1 00:19:01.114 --rc geninfo_all_blocks=1 00:19:01.114 --rc geninfo_unexecuted_blocks=1 00:19:01.114 00:19:01.114 ' 00:19:01.114 17:01:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:01.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:01.114 --rc genhtml_branch_coverage=1 00:19:01.114 --rc genhtml_function_coverage=1 00:19:01.114 --rc genhtml_legend=1 00:19:01.114 --rc geninfo_all_blocks=1 00:19:01.114 --rc geninfo_unexecuted_blocks=1 00:19:01.114 00:19:01.114 ' 00:19:01.114 17:01:12 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:01.114 17:01:12 -- nvmf/common.sh@7 -- # uname -s 00:19:01.114 17:01:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:01.114 17:01:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:01.114 17:01:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:01.114 17:01:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:01.114 17:01:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:01.114 17:01:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:01.114 17:01:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:01.114 17:01:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:01.114 17:01:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:01.114 17:01:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:01.114 17:01:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:01.114 17:01:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:01.114 17:01:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:01.114 17:01:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:01.114 17:01:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:01.114 17:01:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:01.114 17:01:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:01.114 17:01:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:01.114 17:01:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:01.114 17:01:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.114 17:01:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.114 17:01:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.114 17:01:12 -- paths/export.sh@5 -- # export PATH 00:19:01.114 17:01:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.114 17:01:12 -- nvmf/common.sh@46 -- # : 0 00:19:01.114 17:01:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:01.114 17:01:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:01.114 17:01:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:01.114 17:01:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:01.114 17:01:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:01.114 17:01:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:01.114 17:01:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:01.114 17:01:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:01.114 17:01:12 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:19:01.114 17:01:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:01.114 17:01:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:01.114 17:01:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:01.114 17:01:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:01.114 17:01:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:01.114 17:01:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:01.114 17:01:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:01.114 17:01:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:01.114 17:01:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:01.114 17:01:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:01.114 17:01:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:01.114 17:01:12 -- common/autotest_common.sh@10 -- # set +x 00:19:03.016 17:01:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:03.016 17:01:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:03.016 17:01:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:03.016 17:01:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:03.016 17:01:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:03.016 17:01:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:03.016 17:01:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:03.016 17:01:14 -- nvmf/common.sh@294 -- # net_devs=() 00:19:03.016 17:01:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:03.016 17:01:14 -- nvmf/common.sh@295 -- # e810=() 00:19:03.016 17:01:14 -- nvmf/common.sh@295 -- # local -ga e810 00:19:03.016 17:01:14 -- nvmf/common.sh@296 -- # x722=() 00:19:03.016 17:01:14 -- nvmf/common.sh@296 -- # local -ga x722 00:19:03.016 17:01:14 -- nvmf/common.sh@297 -- # mlx=() 00:19:03.016 17:01:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:03.016 17:01:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:03.016 17:01:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:03.016 17:01:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:03.016 17:01:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:03.016 17:01:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:03.016 17:01:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:03.016 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:03.016 17:01:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:03.016 17:01:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:03.016 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:03.016 17:01:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:03.016 17:01:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:03.016 17:01:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:03.016 17:01:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:03.016 17:01:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:03.016 17:01:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:03.016 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:03.016 17:01:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:03.016 17:01:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:03.016 17:01:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:03.016 17:01:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:03.016 17:01:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:03.016 17:01:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:03.016 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:03.016 17:01:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:03.016 17:01:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:03.016 17:01:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:03.016 17:01:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:03.016 17:01:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:03.016 17:01:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:03.016 17:01:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:03.016 17:01:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:03.016 17:01:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:03.016 17:01:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:03.016 17:01:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:03.016 17:01:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:03.016 17:01:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:03.016 17:01:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:03.016 17:01:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:03.016 17:01:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:03.016 17:01:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:03.016 17:01:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:03.016 17:01:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:03.016 17:01:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:03.016 17:01:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:03.016 17:01:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:03.017 17:01:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:03.017 17:01:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:03.017 17:01:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:03.017 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:03.017 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:19:03.017 00:19:03.017 --- 10.0.0.2 ping statistics --- 00:19:03.017 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:03.017 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:19:03.017 17:01:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:03.017 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:03.017 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.063 ms 00:19:03.017 00:19:03.017 --- 10.0.0.1 ping statistics --- 00:19:03.017 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:03.017 rtt min/avg/max/mdev = 0.063/0.063/0.063/0.000 ms 00:19:03.017 17:01:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:03.017 17:01:14 -- nvmf/common.sh@410 -- # return 0 00:19:03.017 17:01:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:03.017 17:01:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:03.017 17:01:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:03.017 17:01:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:03.017 17:01:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:03.017 17:01:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:03.017 17:01:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:03.017 17:01:14 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=235108 00:19:03.017 17:01:14 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:19:03.017 17:01:14 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:19:03.017 17:01:14 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 235108 00:19:03.017 17:01:14 -- common/autotest_common.sh@829 -- # '[' -z 235108 ']' 00:19:03.017 17:01:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:03.017 17:01:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:03.017 17:01:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:03.017 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:03.017 17:01:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:03.017 17:01:14 -- common/autotest_common.sh@10 -- # set +x 00:19:03.947 17:01:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:03.947 17:01:15 -- common/autotest_common.sh@862 -- # return 0 00:19:03.947 17:01:15 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:03.947 17:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.947 17:01:15 -- common/autotest_common.sh@10 -- # set +x 00:19:03.947 17:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.947 17:01:15 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:19:03.947 17:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.947 17:01:15 -- common/autotest_common.sh@10 -- # set +x 00:19:03.947 Malloc0 00:19:03.947 17:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.947 17:01:15 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:03.947 17:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.947 17:01:15 -- common/autotest_common.sh@10 -- # set +x 00:19:03.947 17:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.947 17:01:15 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:03.947 17:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.947 17:01:15 -- common/autotest_common.sh@10 -- # set +x 00:19:03.947 17:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.947 17:01:15 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:03.947 17:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.947 17:01:15 -- common/autotest_common.sh@10 -- # set +x 00:19:03.947 17:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.947 17:01:15 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:19:03.947 17:01:15 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:36.027 Fuzzing completed. Shutting down the fuzz application 00:19:36.027 00:19:36.027 Dumping successful admin opcodes: 00:19:36.027 8, 9, 10, 24, 00:19:36.027 Dumping successful io opcodes: 00:19:36.027 0, 9, 00:19:36.027 NS: 0x200003aeff00 I/O qp, Total commands completed: 468379, total successful commands: 2701, random_seed: 1663445760 00:19:36.027 NS: 0x200003aeff00 admin qp, Total commands completed: 55952, total successful commands: 444, random_seed: 3978177600 00:19:36.027 17:01:45 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:36.027 Fuzzing completed. Shutting down the fuzz application 00:19:36.027 00:19:36.027 Dumping successful admin opcodes: 00:19:36.027 24, 00:19:36.027 Dumping successful io opcodes: 00:19:36.027 00:19:36.027 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3376453325 00:19:36.027 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3376606749 00:19:36.027 17:01:47 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:36.027 17:01:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.027 17:01:47 -- common/autotest_common.sh@10 -- # set +x 00:19:36.027 17:01:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.027 17:01:47 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:36.027 17:01:47 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:36.027 17:01:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:36.027 17:01:47 -- nvmf/common.sh@116 -- # sync 00:19:36.027 17:01:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:36.027 17:01:47 -- nvmf/common.sh@119 -- # set +e 00:19:36.027 17:01:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:36.027 17:01:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:36.027 rmmod nvme_tcp 00:19:36.027 rmmod nvme_fabrics 00:19:36.027 rmmod nvme_keyring 00:19:36.286 17:01:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:36.286 17:01:47 -- nvmf/common.sh@123 -- # set -e 00:19:36.286 17:01:47 -- nvmf/common.sh@124 -- # return 0 00:19:36.286 17:01:47 -- nvmf/common.sh@477 -- # '[' -n 235108 ']' 00:19:36.286 17:01:47 -- nvmf/common.sh@478 -- # killprocess 235108 00:19:36.286 17:01:47 -- common/autotest_common.sh@936 -- # '[' -z 235108 ']' 00:19:36.286 17:01:47 -- common/autotest_common.sh@940 -- # kill -0 235108 00:19:36.286 17:01:47 -- common/autotest_common.sh@941 -- # uname 00:19:36.286 17:01:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:36.286 17:01:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 235108 00:19:36.286 17:01:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:36.286 17:01:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:36.286 17:01:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 235108' 00:19:36.286 killing process with pid 235108 00:19:36.286 17:01:47 -- common/autotest_common.sh@955 -- # kill 235108 00:19:36.286 17:01:47 -- common/autotest_common.sh@960 -- # wait 235108 00:19:36.545 17:01:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:36.545 17:01:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:36.545 17:01:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:36.545 17:01:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:36.545 17:01:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:36.545 17:01:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:36.545 17:01:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:36.545 17:01:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:38.456 17:01:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:38.456 17:01:49 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:38.715 00:19:38.715 real 0m37.905s 00:19:38.715 user 0m52.314s 00:19:38.715 sys 0m14.682s 00:19:38.715 17:01:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:38.715 17:01:49 -- common/autotest_common.sh@10 -- # set +x 00:19:38.715 ************************************ 00:19:38.715 END TEST nvmf_fuzz 00:19:38.715 ************************************ 00:19:38.715 17:01:49 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:38.715 17:01:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:38.715 17:01:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:38.715 17:01:49 -- common/autotest_common.sh@10 -- # set +x 00:19:38.715 ************************************ 00:19:38.715 START TEST nvmf_multiconnection 00:19:38.715 ************************************ 00:19:38.715 17:01:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:38.715 * Looking for test storage... 00:19:38.715 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:38.715 17:01:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:38.715 17:01:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:38.715 17:01:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:38.715 17:01:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:38.716 17:01:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:38.716 17:01:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:38.716 17:01:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:38.716 17:01:50 -- scripts/common.sh@335 -- # IFS=.-: 00:19:38.716 17:01:50 -- scripts/common.sh@335 -- # read -ra ver1 00:19:38.716 17:01:50 -- scripts/common.sh@336 -- # IFS=.-: 00:19:38.716 17:01:50 -- scripts/common.sh@336 -- # read -ra ver2 00:19:38.716 17:01:50 -- scripts/common.sh@337 -- # local 'op=<' 00:19:38.716 17:01:50 -- scripts/common.sh@339 -- # ver1_l=2 00:19:38.716 17:01:50 -- scripts/common.sh@340 -- # ver2_l=1 00:19:38.716 17:01:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:38.716 17:01:50 -- scripts/common.sh@343 -- # case "$op" in 00:19:38.716 17:01:50 -- scripts/common.sh@344 -- # : 1 00:19:38.716 17:01:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:38.716 17:01:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:38.716 17:01:50 -- scripts/common.sh@364 -- # decimal 1 00:19:38.716 17:01:50 -- scripts/common.sh@352 -- # local d=1 00:19:38.716 17:01:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:38.716 17:01:50 -- scripts/common.sh@354 -- # echo 1 00:19:38.716 17:01:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:38.716 17:01:50 -- scripts/common.sh@365 -- # decimal 2 00:19:38.716 17:01:50 -- scripts/common.sh@352 -- # local d=2 00:19:38.716 17:01:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:38.716 17:01:50 -- scripts/common.sh@354 -- # echo 2 00:19:38.716 17:01:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:38.716 17:01:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:38.716 17:01:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:38.716 17:01:50 -- scripts/common.sh@367 -- # return 0 00:19:38.716 17:01:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:38.716 17:01:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:38.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:38.716 --rc genhtml_branch_coverage=1 00:19:38.716 --rc genhtml_function_coverage=1 00:19:38.716 --rc genhtml_legend=1 00:19:38.716 --rc geninfo_all_blocks=1 00:19:38.716 --rc geninfo_unexecuted_blocks=1 00:19:38.716 00:19:38.716 ' 00:19:38.716 17:01:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:38.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:38.716 --rc genhtml_branch_coverage=1 00:19:38.716 --rc genhtml_function_coverage=1 00:19:38.716 --rc genhtml_legend=1 00:19:38.716 --rc geninfo_all_blocks=1 00:19:38.716 --rc geninfo_unexecuted_blocks=1 00:19:38.716 00:19:38.716 ' 00:19:38.716 17:01:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:38.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:38.716 --rc genhtml_branch_coverage=1 00:19:38.716 --rc genhtml_function_coverage=1 00:19:38.716 --rc genhtml_legend=1 00:19:38.716 --rc geninfo_all_blocks=1 00:19:38.716 --rc geninfo_unexecuted_blocks=1 00:19:38.716 00:19:38.716 ' 00:19:38.716 17:01:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:38.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:38.716 --rc genhtml_branch_coverage=1 00:19:38.716 --rc genhtml_function_coverage=1 00:19:38.716 --rc genhtml_legend=1 00:19:38.716 --rc geninfo_all_blocks=1 00:19:38.716 --rc geninfo_unexecuted_blocks=1 00:19:38.716 00:19:38.716 ' 00:19:38.716 17:01:50 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:38.716 17:01:50 -- nvmf/common.sh@7 -- # uname -s 00:19:38.716 17:01:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:38.716 17:01:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:38.716 17:01:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:38.716 17:01:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:38.716 17:01:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:38.716 17:01:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:38.716 17:01:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:38.716 17:01:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:38.716 17:01:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:38.716 17:01:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:38.716 17:01:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:38.716 17:01:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:38.716 17:01:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:38.716 17:01:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:38.716 17:01:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:38.716 17:01:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:38.716 17:01:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:38.716 17:01:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:38.716 17:01:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:38.716 17:01:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.716 17:01:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.716 17:01:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.716 17:01:50 -- paths/export.sh@5 -- # export PATH 00:19:38.716 17:01:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.716 17:01:50 -- nvmf/common.sh@46 -- # : 0 00:19:38.716 17:01:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:38.716 17:01:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:38.716 17:01:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:38.716 17:01:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:38.716 17:01:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:38.716 17:01:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:38.716 17:01:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:38.716 17:01:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:38.716 17:01:50 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:38.716 17:01:50 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:38.716 17:01:50 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:38.716 17:01:50 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:38.716 17:01:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:38.716 17:01:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:38.716 17:01:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:38.716 17:01:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:38.716 17:01:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:38.716 17:01:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:38.716 17:01:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:38.716 17:01:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:38.716 17:01:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:38.716 17:01:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:38.716 17:01:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:38.716 17:01:50 -- common/autotest_common.sh@10 -- # set +x 00:19:41.248 17:01:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:41.248 17:01:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:41.248 17:01:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:41.248 17:01:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:41.248 17:01:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:41.248 17:01:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:41.248 17:01:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:41.248 17:01:52 -- nvmf/common.sh@294 -- # net_devs=() 00:19:41.248 17:01:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:41.248 17:01:52 -- nvmf/common.sh@295 -- # e810=() 00:19:41.248 17:01:52 -- nvmf/common.sh@295 -- # local -ga e810 00:19:41.248 17:01:52 -- nvmf/common.sh@296 -- # x722=() 00:19:41.248 17:01:52 -- nvmf/common.sh@296 -- # local -ga x722 00:19:41.248 17:01:52 -- nvmf/common.sh@297 -- # mlx=() 00:19:41.248 17:01:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:41.248 17:01:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:41.248 17:01:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:41.248 17:01:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:41.248 17:01:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:41.248 17:01:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:41.248 17:01:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:41.248 17:01:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:41.249 17:01:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:41.249 17:01:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:41.249 17:01:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:41.249 17:01:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:41.249 17:01:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:41.249 17:01:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:41.249 17:01:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:41.249 17:01:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:41.249 17:01:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:41.249 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:41.249 17:01:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:41.249 17:01:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:41.249 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:41.249 17:01:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:41.249 17:01:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:41.249 17:01:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.249 17:01:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:41.249 17:01:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.249 17:01:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:41.249 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:41.249 17:01:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.249 17:01:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:41.249 17:01:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.249 17:01:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:41.249 17:01:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.249 17:01:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:41.249 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:41.249 17:01:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.249 17:01:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:41.249 17:01:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:41.249 17:01:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:41.249 17:01:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:41.249 17:01:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:41.249 17:01:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:41.249 17:01:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:41.249 17:01:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:41.249 17:01:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:41.249 17:01:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:41.249 17:01:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:41.249 17:01:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:41.249 17:01:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:41.249 17:01:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:41.249 17:01:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:41.249 17:01:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:41.249 17:01:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:41.249 17:01:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:41.249 17:01:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:41.249 17:01:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:41.249 17:01:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:41.249 17:01:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:41.249 17:01:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:41.249 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:41.249 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.174 ms 00:19:41.249 00:19:41.249 --- 10.0.0.2 ping statistics --- 00:19:41.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:41.249 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:19:41.249 17:01:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:41.249 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:41.249 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.060 ms 00:19:41.249 00:19:41.249 --- 10.0.0.1 ping statistics --- 00:19:41.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:41.249 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:19:41.249 17:01:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:41.249 17:01:52 -- nvmf/common.sh@410 -- # return 0 00:19:41.249 17:01:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:41.249 17:01:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:41.249 17:01:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:41.249 17:01:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:41.249 17:01:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:41.249 17:01:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:41.249 17:01:52 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:41.249 17:01:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:41.249 17:01:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:41.249 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:19:41.249 17:01:52 -- nvmf/common.sh@469 -- # nvmfpid=241107 00:19:41.249 17:01:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:41.249 17:01:52 -- nvmf/common.sh@470 -- # waitforlisten 241107 00:19:41.249 17:01:52 -- common/autotest_common.sh@829 -- # '[' -z 241107 ']' 00:19:41.249 17:01:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:41.249 17:01:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:41.249 17:01:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:41.249 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:41.249 17:01:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:41.249 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:19:41.249 [2024-11-29 17:01:52.309880] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:41.249 [2024-11-29 17:01:52.309983] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:41.249 EAL: No free 2048 kB hugepages reported on node 1 00:19:41.249 [2024-11-29 17:01:52.373733] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:41.249 [2024-11-29 17:01:52.485049] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:41.249 [2024-11-29 17:01:52.485212] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:41.249 [2024-11-29 17:01:52.485230] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:41.249 [2024-11-29 17:01:52.485242] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:41.249 [2024-11-29 17:01:52.485298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:41.249 [2024-11-29 17:01:52.485361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:41.249 [2024-11-29 17:01:52.485384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:41.249 [2024-11-29 17:01:52.485387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:42.182 17:01:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:42.182 17:01:53 -- common/autotest_common.sh@862 -- # return 0 00:19:42.182 17:01:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:42.182 17:01:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:42.182 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.182 17:01:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:42.182 17:01:53 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:42.182 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.182 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.182 [2024-11-29 17:01:53.311572] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:42.182 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.182 17:01:53 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:42.183 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.183 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 Malloc1 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 [2024-11-29 17:01:53.368643] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.183 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 Malloc2 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.183 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 Malloc3 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.183 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 Malloc4 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.183 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 Malloc5 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.183 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 Malloc6 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.183 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.183 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:42.183 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.183 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.441 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.441 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.441 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:42.441 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.441 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.441 Malloc7 00:19:42.441 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.441 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.442 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 Malloc8 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.442 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 Malloc9 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.442 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 Malloc10 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.442 17:01:53 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 Malloc11 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.442 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.442 17:01:53 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:42.442 17:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:42.442 17:01:53 -- common/autotest_common.sh@10 -- # set +x 00:19:42.699 17:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:42.699 17:01:53 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:42.699 17:01:53 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.699 17:01:53 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:43.263 17:01:54 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:43.263 17:01:54 -- common/autotest_common.sh@1187 -- # local i=0 00:19:43.263 17:01:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:43.263 17:01:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:43.263 17:01:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:45.182 17:01:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:45.183 17:01:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:45.183 17:01:56 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:45.183 17:01:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:45.183 17:01:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:45.183 17:01:56 -- common/autotest_common.sh@1197 -- # return 0 00:19:45.183 17:01:56 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:45.183 17:01:56 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:46.118 17:01:57 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:46.118 17:01:57 -- common/autotest_common.sh@1187 -- # local i=0 00:19:46.118 17:01:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:46.118 17:01:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:46.118 17:01:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:48.019 17:01:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:48.019 17:01:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:48.019 17:01:59 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:48.019 17:01:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:48.019 17:01:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:48.019 17:01:59 -- common/autotest_common.sh@1197 -- # return 0 00:19:48.019 17:01:59 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.019 17:01:59 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:48.585 17:01:59 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:48.585 17:01:59 -- common/autotest_common.sh@1187 -- # local i=0 00:19:48.585 17:01:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:48.585 17:01:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:48.585 17:01:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:51.114 17:02:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:51.114 17:02:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:51.114 17:02:01 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:51.114 17:02:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:51.114 17:02:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.114 17:02:02 -- common/autotest_common.sh@1197 -- # return 0 00:19:51.114 17:02:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.114 17:02:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:51.372 17:02:02 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:51.372 17:02:02 -- common/autotest_common.sh@1187 -- # local i=0 00:19:51.372 17:02:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:51.372 17:02:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:51.372 17:02:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:53.271 17:02:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:53.271 17:02:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:53.271 17:02:04 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:53.271 17:02:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:53.271 17:02:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:53.271 17:02:04 -- common/autotest_common.sh@1197 -- # return 0 00:19:53.271 17:02:04 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.271 17:02:04 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:54.212 17:02:05 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:54.212 17:02:05 -- common/autotest_common.sh@1187 -- # local i=0 00:19:54.212 17:02:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:54.212 17:02:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:54.212 17:02:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:56.109 17:02:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:56.109 17:02:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:56.109 17:02:07 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:56.109 17:02:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:56.109 17:02:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:56.109 17:02:07 -- common/autotest_common.sh@1197 -- # return 0 00:19:56.109 17:02:07 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.109 17:02:07 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:57.044 17:02:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:57.044 17:02:08 -- common/autotest_common.sh@1187 -- # local i=0 00:19:57.044 17:02:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:57.044 17:02:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:57.044 17:02:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:58.938 17:02:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:58.938 17:02:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:58.938 17:02:10 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:58.938 17:02:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:58.938 17:02:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:58.938 17:02:10 -- common/autotest_common.sh@1197 -- # return 0 00:19:58.938 17:02:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:58.938 17:02:10 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:59.499 17:02:10 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:59.499 17:02:10 -- common/autotest_common.sh@1187 -- # local i=0 00:19:59.499 17:02:10 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:59.499 17:02:10 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:59.499 17:02:10 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:02.027 17:02:12 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:02.027 17:02:12 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:02.027 17:02:12 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:20:02.027 17:02:12 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:02.027 17:02:12 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:02.027 17:02:12 -- common/autotest_common.sh@1197 -- # return 0 00:20:02.027 17:02:12 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:02.027 17:02:12 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:20:02.593 17:02:13 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:20:02.593 17:02:13 -- common/autotest_common.sh@1187 -- # local i=0 00:20:02.593 17:02:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:02.593 17:02:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:02.593 17:02:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:04.491 17:02:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:04.491 17:02:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:04.492 17:02:15 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:20:04.492 17:02:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:04.492 17:02:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:04.492 17:02:15 -- common/autotest_common.sh@1197 -- # return 0 00:20:04.492 17:02:15 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:04.492 17:02:15 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:20:05.867 17:02:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:20:05.867 17:02:16 -- common/autotest_common.sh@1187 -- # local i=0 00:20:05.867 17:02:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:05.867 17:02:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:05.867 17:02:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:07.768 17:02:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:07.768 17:02:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:07.768 17:02:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:20:07.768 17:02:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:07.768 17:02:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:07.768 17:02:18 -- common/autotest_common.sh@1197 -- # return 0 00:20:07.768 17:02:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:07.768 17:02:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:20:08.702 17:02:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:20:08.702 17:02:19 -- common/autotest_common.sh@1187 -- # local i=0 00:20:08.702 17:02:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:08.702 17:02:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:08.702 17:02:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:10.601 17:02:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:10.601 17:02:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:10.601 17:02:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:20:10.601 17:02:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:10.601 17:02:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:10.601 17:02:21 -- common/autotest_common.sh@1197 -- # return 0 00:20:10.601 17:02:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:10.601 17:02:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:20:11.536 17:02:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:11.536 17:02:22 -- common/autotest_common.sh@1187 -- # local i=0 00:20:11.536 17:02:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:11.536 17:02:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:11.536 17:02:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:13.437 17:02:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:13.437 17:02:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:13.437 17:02:24 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:20:13.695 17:02:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:13.695 17:02:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:13.695 17:02:24 -- common/autotest_common.sh@1197 -- # return 0 00:20:13.695 17:02:24 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:13.695 [global] 00:20:13.695 thread=1 00:20:13.695 invalidate=1 00:20:13.695 rw=read 00:20:13.695 time_based=1 00:20:13.695 runtime=10 00:20:13.695 ioengine=libaio 00:20:13.695 direct=1 00:20:13.695 bs=262144 00:20:13.695 iodepth=64 00:20:13.695 norandommap=1 00:20:13.695 numjobs=1 00:20:13.695 00:20:13.695 [job0] 00:20:13.695 filename=/dev/nvme0n1 00:20:13.695 [job1] 00:20:13.695 filename=/dev/nvme10n1 00:20:13.695 [job2] 00:20:13.695 filename=/dev/nvme1n1 00:20:13.695 [job3] 00:20:13.695 filename=/dev/nvme2n1 00:20:13.695 [job4] 00:20:13.695 filename=/dev/nvme3n1 00:20:13.695 [job5] 00:20:13.695 filename=/dev/nvme4n1 00:20:13.695 [job6] 00:20:13.695 filename=/dev/nvme5n1 00:20:13.695 [job7] 00:20:13.695 filename=/dev/nvme6n1 00:20:13.695 [job8] 00:20:13.695 filename=/dev/nvme7n1 00:20:13.695 [job9] 00:20:13.695 filename=/dev/nvme8n1 00:20:13.695 [job10] 00:20:13.695 filename=/dev/nvme9n1 00:20:13.695 Could not set queue depth (nvme0n1) 00:20:13.695 Could not set queue depth (nvme10n1) 00:20:13.695 Could not set queue depth (nvme1n1) 00:20:13.695 Could not set queue depth (nvme2n1) 00:20:13.695 Could not set queue depth (nvme3n1) 00:20:13.695 Could not set queue depth (nvme4n1) 00:20:13.695 Could not set queue depth (nvme5n1) 00:20:13.695 Could not set queue depth (nvme6n1) 00:20:13.695 Could not set queue depth (nvme7n1) 00:20:13.695 Could not set queue depth (nvme8n1) 00:20:13.695 Could not set queue depth (nvme9n1) 00:20:13.952 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:13.952 fio-3.35 00:20:13.952 Starting 11 threads 00:20:26.174 00:20:26.174 job0: (groupid=0, jobs=1): err= 0: pid=245622: Fri Nov 29 17:02:35 2024 00:20:26.174 read: IOPS=849, BW=212MiB/s (223MB/s)(2145MiB/10103msec) 00:20:26.174 slat (usec): min=9, max=85537, avg=463.11, stdev=3206.50 00:20:26.174 clat (usec): min=1313, max=242996, avg=74837.84, stdev=44151.46 00:20:26.174 lat (usec): min=1331, max=260360, avg=75300.95, stdev=44533.38 00:20:26.174 clat percentiles (msec): 00:20:26.174 | 1.00th=[ 6], 5.00th=[ 13], 10.00th=[ 23], 20.00th=[ 33], 00:20:26.174 | 30.00th=[ 45], 40.00th=[ 58], 50.00th=[ 70], 60.00th=[ 82], 00:20:26.174 | 70.00th=[ 95], 80.00th=[ 115], 90.00th=[ 138], 95.00th=[ 153], 00:20:26.174 | 99.00th=[ 197], 99.50th=[ 207], 99.90th=[ 222], 99.95th=[ 226], 00:20:26.174 | 99.99th=[ 243] 00:20:26.174 bw ( KiB/s): min=110080, max=380416, per=11.12%, avg=218035.20, stdev=67911.33, samples=20 00:20:26.174 iops : min= 430, max= 1486, avg=851.70, stdev=265.28, samples=20 00:20:26.174 lat (msec) : 2=0.07%, 4=0.21%, 10=2.63%, 20=5.89%, 50=24.94% 00:20:26.174 lat (msec) : 100=39.54%, 250=26.72% 00:20:26.174 cpu : usr=0.31%, sys=2.28%, ctx=1795, majf=0, minf=4097 00:20:26.174 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:26.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.174 issued rwts: total=8581,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.174 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.174 job1: (groupid=0, jobs=1): err= 0: pid=245623: Fri Nov 29 17:02:35 2024 00:20:26.174 read: IOPS=677, BW=169MiB/s (177MB/s)(1705MiB/10072msec) 00:20:26.174 slat (usec): min=9, max=120514, avg=955.20, stdev=4752.92 00:20:26.174 clat (usec): min=1010, max=253088, avg=93518.33, stdev=46223.11 00:20:26.174 lat (usec): min=1036, max=278817, avg=94473.53, stdev=46834.55 00:20:26.174 clat percentiles (msec): 00:20:26.174 | 1.00th=[ 5], 5.00th=[ 20], 10.00th=[ 32], 20.00th=[ 50], 00:20:26.174 | 30.00th=[ 66], 40.00th=[ 80], 50.00th=[ 93], 60.00th=[ 108], 00:20:26.174 | 70.00th=[ 123], 80.00th=[ 136], 90.00th=[ 155], 95.00th=[ 169], 00:20:26.174 | 99.00th=[ 194], 99.50th=[ 205], 99.90th=[ 220], 99.95th=[ 241], 00:20:26.174 | 99.99th=[ 253] 00:20:26.174 bw ( KiB/s): min=90112, max=270336, per=8.82%, avg=172928.00, stdev=47819.66, samples=20 00:20:26.174 iops : min= 352, max= 1056, avg=675.50, stdev=186.80, samples=20 00:20:26.174 lat (msec) : 2=0.03%, 4=0.92%, 10=1.04%, 20=3.08%, 50=15.60% 00:20:26.174 lat (msec) : 100=33.99%, 250=45.30%, 500=0.03% 00:20:26.174 cpu : usr=0.27%, sys=1.72%, ctx=1451, majf=0, minf=4098 00:20:26.174 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:26.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.174 issued rwts: total=6819,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.174 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.174 job2: (groupid=0, jobs=1): err= 0: pid=245624: Fri Nov 29 17:02:35 2024 00:20:26.174 read: IOPS=629, BW=157MiB/s (165MB/s)(1590MiB/10104msec) 00:20:26.174 slat (usec): min=8, max=109579, avg=949.30, stdev=4424.19 00:20:26.174 clat (usec): min=987, max=282056, avg=100679.13, stdev=47163.45 00:20:26.174 lat (usec): min=1010, max=315352, avg=101628.43, stdev=47776.22 00:20:26.174 clat percentiles (msec): 00:20:26.174 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 40], 20.00th=[ 62], 00:20:26.174 | 30.00th=[ 79], 40.00th=[ 91], 50.00th=[ 103], 60.00th=[ 113], 00:20:26.174 | 70.00th=[ 127], 80.00th=[ 140], 90.00th=[ 153], 95.00th=[ 167], 00:20:26.174 | 99.00th=[ 239], 99.50th=[ 257], 99.90th=[ 268], 99.95th=[ 271], 00:20:26.174 | 99.99th=[ 284] 00:20:26.174 bw ( KiB/s): min=98816, max=283648, per=8.22%, avg=161126.40, stdev=46196.06, samples=20 00:20:26.174 iops : min= 386, max= 1108, avg=629.40, stdev=180.45, samples=20 00:20:26.174 lat (usec) : 1000=0.02% 00:20:26.174 lat (msec) : 2=0.42%, 4=0.64%, 10=2.69%, 20=2.61%, 50=7.05% 00:20:26.174 lat (msec) : 100=34.43%, 250=51.31%, 500=0.83% 00:20:26.174 cpu : usr=0.28%, sys=1.58%, ctx=1449, majf=0, minf=4097 00:20:26.174 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:26.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.174 issued rwts: total=6358,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.174 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.174 job3: (groupid=0, jobs=1): err= 0: pid=245625: Fri Nov 29 17:02:35 2024 00:20:26.174 read: IOPS=621, BW=155MiB/s (163MB/s)(1570MiB/10101msec) 00:20:26.174 slat (usec): min=8, max=101972, avg=1333.88, stdev=4776.30 00:20:26.174 clat (usec): min=1649, max=304624, avg=101546.64, stdev=45160.48 00:20:26.174 lat (usec): min=1678, max=304666, avg=102880.52, stdev=45842.62 00:20:26.174 clat percentiles (msec): 00:20:26.174 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 52], 20.00th=[ 70], 00:20:26.174 | 30.00th=[ 80], 40.00th=[ 87], 50.00th=[ 95], 60.00th=[ 106], 00:20:26.174 | 70.00th=[ 122], 80.00th=[ 136], 90.00th=[ 159], 95.00th=[ 184], 00:20:26.174 | 99.00th=[ 236], 99.50th=[ 255], 99.90th=[ 271], 99.95th=[ 275], 00:20:26.174 | 99.99th=[ 305] 00:20:26.174 bw ( KiB/s): min=79360, max=220160, per=8.12%, avg=159124.45, stdev=42790.48, samples=20 00:20:26.174 iops : min= 310, max= 860, avg=621.55, stdev=167.12, samples=20 00:20:26.174 lat (msec) : 2=0.03%, 4=0.06%, 10=1.11%, 20=2.60%, 50=5.43% 00:20:26.174 lat (msec) : 100=46.25%, 250=43.80%, 500=0.72% 00:20:26.174 cpu : usr=0.27%, sys=2.07%, ctx=1160, majf=0, minf=4097 00:20:26.174 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:26.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.174 issued rwts: total=6279,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.174 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.174 job4: (groupid=0, jobs=1): err= 0: pid=245626: Fri Nov 29 17:02:35 2024 00:20:26.174 read: IOPS=587, BW=147MiB/s (154MB/s)(1485MiB/10100msec) 00:20:26.174 slat (usec): min=8, max=95060, avg=1201.78, stdev=4416.44 00:20:26.174 clat (msec): min=3, max=281, avg=107.58, stdev=42.38 00:20:26.174 lat (msec): min=3, max=314, avg=108.78, stdev=43.08 00:20:26.174 clat percentiles (msec): 00:20:26.174 | 1.00th=[ 15], 5.00th=[ 42], 10.00th=[ 57], 20.00th=[ 77], 00:20:26.174 | 30.00th=[ 86], 40.00th=[ 95], 50.00th=[ 106], 60.00th=[ 115], 00:20:26.174 | 70.00th=[ 125], 80.00th=[ 140], 90.00th=[ 161], 95.00th=[ 182], 00:20:26.174 | 99.00th=[ 247], 99.50th=[ 259], 99.90th=[ 275], 99.95th=[ 284], 00:20:26.174 | 99.99th=[ 284] 00:20:26.174 bw ( KiB/s): min=75776, max=242688, per=7.67%, avg=150411.00, stdev=41638.55, samples=20 00:20:26.174 iops : min= 296, max= 948, avg=587.50, stdev=162.69, samples=20 00:20:26.174 lat (msec) : 4=0.17%, 10=0.51%, 20=1.08%, 50=6.11%, 100=37.69% 00:20:26.174 lat (msec) : 250=53.74%, 500=0.71% 00:20:26.174 cpu : usr=0.23%, sys=1.74%, ctx=1307, majf=0, minf=4097 00:20:26.174 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:26.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.174 issued rwts: total=5938,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.174 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.174 job5: (groupid=0, jobs=1): err= 0: pid=245627: Fri Nov 29 17:02:35 2024 00:20:26.174 read: IOPS=851, BW=213MiB/s (223MB/s)(2132MiB/10016msec) 00:20:26.175 slat (usec): min=8, max=144109, avg=986.78, stdev=3875.43 00:20:26.175 clat (usec): min=791, max=283652, avg=74117.53, stdev=44287.36 00:20:26.175 lat (usec): min=810, max=298874, avg=75104.32, stdev=44803.20 00:20:26.175 clat percentiles (msec): 00:20:26.175 | 1.00th=[ 6], 5.00th=[ 15], 10.00th=[ 27], 20.00th=[ 33], 00:20:26.175 | 30.00th=[ 41], 40.00th=[ 56], 50.00th=[ 69], 60.00th=[ 80], 00:20:26.175 | 70.00th=[ 93], 80.00th=[ 114], 90.00th=[ 136], 95.00th=[ 155], 00:20:26.175 | 99.00th=[ 180], 99.50th=[ 207], 99.90th=[ 275], 99.95th=[ 284], 00:20:26.175 | 99.99th=[ 284] 00:20:26.175 bw ( KiB/s): min=105984, max=410624, per=11.06%, avg=216729.60, stdev=89324.81, samples=20 00:20:26.175 iops : min= 414, max= 1604, avg=846.60, stdev=348.93, samples=20 00:20:26.175 lat (usec) : 1000=0.01% 00:20:26.175 lat (msec) : 2=0.45%, 4=0.28%, 10=1.22%, 20=4.92%, 50=28.37% 00:20:26.175 lat (msec) : 100=38.33%, 250=26.03%, 500=0.39% 00:20:26.175 cpu : usr=0.41%, sys=2.78%, ctx=1581, majf=0, minf=3721 00:20:26.175 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:26.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.175 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.175 issued rwts: total=8529,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.175 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.175 job6: (groupid=0, jobs=1): err= 0: pid=245628: Fri Nov 29 17:02:35 2024 00:20:26.175 read: IOPS=752, BW=188MiB/s (197MB/s)(1900MiB/10102msec) 00:20:26.175 slat (usec): min=9, max=169097, avg=1099.53, stdev=4540.63 00:20:26.175 clat (msec): min=3, max=287, avg=83.90, stdev=47.23 00:20:26.175 lat (msec): min=3, max=382, avg=85.00, stdev=47.95 00:20:26.175 clat percentiles (msec): 00:20:26.175 | 1.00th=[ 9], 5.00th=[ 24], 10.00th=[ 33], 20.00th=[ 41], 00:20:26.175 | 30.00th=[ 49], 40.00th=[ 66], 50.00th=[ 82], 60.00th=[ 94], 00:20:26.175 | 70.00th=[ 105], 80.00th=[ 120], 90.00th=[ 142], 95.00th=[ 174], 00:20:26.175 | 99.00th=[ 230], 99.50th=[ 253], 99.90th=[ 266], 99.95th=[ 271], 00:20:26.175 | 99.99th=[ 288] 00:20:26.175 bw ( KiB/s): min=95232, max=403968, per=9.85%, avg=192972.80, stdev=87212.59, samples=20 00:20:26.175 iops : min= 372, max= 1578, avg=753.80, stdev=340.67, samples=20 00:20:26.175 lat (msec) : 4=0.13%, 10=1.63%, 20=3.00%, 50=26.42%, 100=34.90% 00:20:26.175 lat (msec) : 250=33.21%, 500=0.71% 00:20:26.175 cpu : usr=0.50%, sys=2.25%, ctx=1388, majf=0, minf=4097 00:20:26.175 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:26.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.175 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.175 issued rwts: total=7601,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.175 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.175 job7: (groupid=0, jobs=1): err= 0: pid=245629: Fri Nov 29 17:02:35 2024 00:20:26.175 read: IOPS=699, BW=175MiB/s (183MB/s)(1759MiB/10054msec) 00:20:26.175 slat (usec): min=11, max=91200, avg=1312.50, stdev=4050.70 00:20:26.175 clat (usec): min=1766, max=225089, avg=90091.22, stdev=34909.35 00:20:26.175 lat (usec): min=1793, max=225149, avg=91403.72, stdev=35499.63 00:20:26.175 clat percentiles (msec): 00:20:26.175 | 1.00th=[ 12], 5.00th=[ 42], 10.00th=[ 54], 20.00th=[ 63], 00:20:26.175 | 30.00th=[ 71], 40.00th=[ 78], 50.00th=[ 84], 60.00th=[ 91], 00:20:26.175 | 70.00th=[ 103], 80.00th=[ 122], 90.00th=[ 142], 95.00th=[ 155], 00:20:26.175 | 99.00th=[ 180], 99.50th=[ 199], 99.90th=[ 213], 99.95th=[ 220], 00:20:26.175 | 99.99th=[ 226] 00:20:26.175 bw ( KiB/s): min=100352, max=286208, per=9.11%, avg=178468.05, stdev=48225.81, samples=20 00:20:26.175 iops : min= 392, max= 1118, avg=697.10, stdev=188.45, samples=20 00:20:26.175 lat (msec) : 2=0.01%, 4=0.44%, 10=0.45%, 20=0.23%, 50=6.87% 00:20:26.175 lat (msec) : 100=60.42%, 250=31.58% 00:20:26.175 cpu : usr=0.42%, sys=2.37%, ctx=1203, majf=0, minf=4097 00:20:26.175 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:26.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.175 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.175 issued rwts: total=7034,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.175 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.175 job8: (groupid=0, jobs=1): err= 0: pid=245630: Fri Nov 29 17:02:35 2024 00:20:26.175 read: IOPS=673, BW=168MiB/s (177MB/s)(1696MiB/10072msec) 00:20:26.175 slat (usec): min=8, max=98374, avg=1021.91, stdev=3954.50 00:20:26.175 clat (usec): min=1200, max=270228, avg=93918.08, stdev=42334.10 00:20:26.175 lat (usec): min=1224, max=357932, avg=94939.98, stdev=42911.39 00:20:26.175 clat percentiles (msec): 00:20:26.175 | 1.00th=[ 12], 5.00th=[ 29], 10.00th=[ 44], 20.00th=[ 62], 00:20:26.175 | 30.00th=[ 71], 40.00th=[ 81], 50.00th=[ 90], 60.00th=[ 101], 00:20:26.175 | 70.00th=[ 111], 80.00th=[ 127], 90.00th=[ 150], 95.00th=[ 165], 00:20:26.175 | 99.00th=[ 236], 99.50th=[ 249], 99.90th=[ 262], 99.95th=[ 264], 00:20:26.175 | 99.99th=[ 271] 00:20:26.175 bw ( KiB/s): min=96768, max=261632, per=8.78%, avg=172083.20, stdev=47333.93, samples=20 00:20:26.175 iops : min= 378, max= 1022, avg=672.20, stdev=184.90, samples=20 00:20:26.175 lat (msec) : 2=0.18%, 4=0.44%, 10=0.22%, 20=1.59%, 50=10.18% 00:20:26.175 lat (msec) : 100=47.81%, 250=39.09%, 500=0.49% 00:20:26.175 cpu : usr=0.36%, sys=2.00%, ctx=1406, majf=0, minf=4097 00:20:26.175 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:26.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.175 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.175 issued rwts: total=6785,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.175 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.175 job9: (groupid=0, jobs=1): err= 0: pid=245631: Fri Nov 29 17:02:35 2024 00:20:26.175 read: IOPS=641, BW=160MiB/s (168MB/s)(1607MiB/10017msec) 00:20:26.175 slat (usec): min=8, max=94105, avg=1060.45, stdev=4409.53 00:20:26.175 clat (usec): min=939, max=268867, avg=98641.96, stdev=49945.85 00:20:26.175 lat (usec): min=959, max=303545, avg=99702.42, stdev=50591.92 00:20:26.175 clat percentiles (usec): 00:20:26.175 | 1.00th=[ 1860], 5.00th=[ 11863], 10.00th=[ 27919], 20.00th=[ 55313], 00:20:26.175 | 30.00th=[ 71828], 40.00th=[ 86508], 50.00th=[102237], 60.00th=[115868], 00:20:26.175 | 70.00th=[129500], 80.00th=[141558], 90.00th=[156238], 95.00th=[170918], 00:20:26.175 | 99.00th=[233833], 99.50th=[252707], 99.90th=[256902], 99.95th=[256902], 00:20:26.175 | 99.99th=[270533] 00:20:26.175 bw ( KiB/s): min=81920, max=275456, per=8.31%, avg=162892.80, stdev=48905.56, samples=20 00:20:26.175 iops : min= 320, max= 1076, avg=636.30, stdev=191.04, samples=20 00:20:26.175 lat (usec) : 1000=0.02% 00:20:26.175 lat (msec) : 2=1.24%, 4=1.48%, 10=1.59%, 20=2.16%, 50=11.84% 00:20:26.175 lat (msec) : 100=29.89%, 250=51.10%, 500=0.67% 00:20:26.175 cpu : usr=0.27%, sys=2.01%, ctx=1428, majf=0, minf=4098 00:20:26.175 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:26.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.175 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.175 issued rwts: total=6426,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.175 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.175 job10: (groupid=0, jobs=1): err= 0: pid=245632: Fri Nov 29 17:02:35 2024 00:20:26.175 read: IOPS=696, BW=174MiB/s (182MB/s)(1753MiB/10074msec) 00:20:26.175 slat (usec): min=8, max=129495, avg=839.82, stdev=4235.39 00:20:26.175 clat (usec): min=1260, max=256405, avg=91018.86, stdev=41994.77 00:20:26.175 lat (usec): min=1311, max=336188, avg=91858.68, stdev=42482.35 00:20:26.175 clat percentiles (msec): 00:20:26.175 | 1.00th=[ 5], 5.00th=[ 23], 10.00th=[ 35], 20.00th=[ 59], 00:20:26.175 | 30.00th=[ 69], 40.00th=[ 80], 50.00th=[ 89], 60.00th=[ 97], 00:20:26.175 | 70.00th=[ 111], 80.00th=[ 130], 90.00th=[ 148], 95.00th=[ 163], 00:20:26.175 | 99.00th=[ 201], 99.50th=[ 218], 99.90th=[ 224], 99.95th=[ 234], 00:20:26.175 | 99.99th=[ 257] 00:20:26.175 bw ( KiB/s): min=105472, max=247296, per=9.08%, avg=177894.40, stdev=41635.02, samples=20 00:20:26.175 iops : min= 412, max= 966, avg=694.90, stdev=162.64, samples=20 00:20:26.175 lat (msec) : 2=0.30%, 4=0.68%, 10=1.60%, 20=2.22%, 50=9.71% 00:20:26.175 lat (msec) : 100=47.86%, 250=37.61%, 500=0.01% 00:20:26.175 cpu : usr=0.32%, sys=2.03%, ctx=1571, majf=0, minf=4098 00:20:26.175 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:26.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.175 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:26.175 issued rwts: total=7012,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.175 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:26.175 00:20:26.175 Run status group 0 (all jobs): 00:20:26.175 READ: bw=1914MiB/s (2007MB/s), 147MiB/s-213MiB/s (154MB/s-223MB/s), io=18.9GiB (20.3GB), run=10016-10104msec 00:20:26.175 00:20:26.175 Disk stats (read/write): 00:20:26.175 nvme0n1: ios=16940/0, merge=0/0, ticks=1245351/0, in_queue=1245351, util=97.31% 00:20:26.175 nvme10n1: ios=13414/0, merge=0/0, ticks=1237779/0, in_queue=1237779, util=97.52% 00:20:26.175 nvme1n1: ios=12551/0, merge=0/0, ticks=1243718/0, in_queue=1243718, util=97.77% 00:20:26.175 nvme2n1: ios=12392/0, merge=0/0, ticks=1238462/0, in_queue=1238462, util=97.89% 00:20:26.175 nvme3n1: ios=11704/0, merge=0/0, ticks=1239417/0, in_queue=1239417, util=97.97% 00:20:26.175 nvme4n1: ios=16829/0, merge=0/0, ticks=1241025/0, in_queue=1241025, util=98.30% 00:20:26.175 nvme5n1: ios=15034/0, merge=0/0, ticks=1237368/0, in_queue=1237368, util=98.45% 00:20:26.175 nvme6n1: ios=13714/0, merge=0/0, ticks=1233773/0, in_queue=1233773, util=98.54% 00:20:26.175 nvme7n1: ios=13409/0, merge=0/0, ticks=1240701/0, in_queue=1240701, util=98.94% 00:20:26.175 nvme8n1: ios=12623/0, merge=0/0, ticks=1241523/0, in_queue=1241523, util=99.11% 00:20:26.175 nvme9n1: ios=13859/0, merge=0/0, ticks=1245125/0, in_queue=1245125, util=99.22% 00:20:26.175 17:02:35 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:26.175 [global] 00:20:26.175 thread=1 00:20:26.175 invalidate=1 00:20:26.175 rw=randwrite 00:20:26.175 time_based=1 00:20:26.175 runtime=10 00:20:26.175 ioengine=libaio 00:20:26.175 direct=1 00:20:26.175 bs=262144 00:20:26.175 iodepth=64 00:20:26.175 norandommap=1 00:20:26.175 numjobs=1 00:20:26.175 00:20:26.175 [job0] 00:20:26.175 filename=/dev/nvme0n1 00:20:26.175 [job1] 00:20:26.175 filename=/dev/nvme10n1 00:20:26.175 [job2] 00:20:26.175 filename=/dev/nvme1n1 00:20:26.175 [job3] 00:20:26.175 filename=/dev/nvme2n1 00:20:26.175 [job4] 00:20:26.175 filename=/dev/nvme3n1 00:20:26.176 [job5] 00:20:26.176 filename=/dev/nvme4n1 00:20:26.176 [job6] 00:20:26.176 filename=/dev/nvme5n1 00:20:26.176 [job7] 00:20:26.176 filename=/dev/nvme6n1 00:20:26.176 [job8] 00:20:26.176 filename=/dev/nvme7n1 00:20:26.176 [job9] 00:20:26.176 filename=/dev/nvme8n1 00:20:26.176 [job10] 00:20:26.176 filename=/dev/nvme9n1 00:20:26.176 Could not set queue depth (nvme0n1) 00:20:26.176 Could not set queue depth (nvme10n1) 00:20:26.176 Could not set queue depth (nvme1n1) 00:20:26.176 Could not set queue depth (nvme2n1) 00:20:26.176 Could not set queue depth (nvme3n1) 00:20:26.176 Could not set queue depth (nvme4n1) 00:20:26.176 Could not set queue depth (nvme5n1) 00:20:26.176 Could not set queue depth (nvme6n1) 00:20:26.176 Could not set queue depth (nvme7n1) 00:20:26.176 Could not set queue depth (nvme8n1) 00:20:26.176 Could not set queue depth (nvme9n1) 00:20:26.176 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:26.176 fio-3.35 00:20:26.176 Starting 11 threads 00:20:36.376 00:20:36.376 job0: (groupid=0, jobs=1): err= 0: pid=246720: Fri Nov 29 17:02:46 2024 00:20:36.376 write: IOPS=577, BW=144MiB/s (151MB/s)(1471MiB/10182msec); 0 zone resets 00:20:36.376 slat (usec): min=13, max=63627, avg=1085.69, stdev=3483.73 00:20:36.376 clat (usec): min=714, max=476207, avg=109639.65, stdev=78791.02 00:20:36.376 lat (usec): min=757, max=476258, avg=110725.34, stdev=79761.38 00:20:36.376 clat percentiles (usec): 00:20:36.376 | 1.00th=[ 1500], 5.00th=[ 12125], 10.00th=[ 21890], 20.00th=[ 39060], 00:20:36.376 | 30.00th=[ 41681], 40.00th=[ 66847], 50.00th=[103285], 60.00th=[132645], 00:20:36.376 | 70.00th=[152044], 80.00th=[177210], 90.00th=[208667], 95.00th=[235930], 00:20:36.376 | 99.00th=[362808], 99.50th=[383779], 99.90th=[459277], 99.95th=[459277], 00:20:36.376 | 99.99th=[476054] 00:20:36.376 bw ( KiB/s): min=49152, max=397824, per=10.81%, avg=148957.60, stdev=80546.02, samples=20 00:20:36.376 iops : min= 192, max= 1554, avg=581.85, stdev=314.65, samples=20 00:20:36.376 lat (usec) : 750=0.05%, 1000=0.29% 00:20:36.376 lat (msec) : 2=1.11%, 4=0.92%, 10=2.09%, 20=4.56%, 50=25.77% 00:20:36.376 lat (msec) : 100=13.84%, 250=47.36%, 500=4.01% 00:20:36.376 cpu : usr=1.58%, sys=2.34%, ctx=3491, majf=0, minf=1 00:20:36.376 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:36.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.376 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.376 issued rwts: total=0,5882,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.376 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.376 job1: (groupid=0, jobs=1): err= 0: pid=246758: Fri Nov 29 17:02:46 2024 00:20:36.376 write: IOPS=498, BW=125MiB/s (131MB/s)(1257MiB/10092msec); 0 zone resets 00:20:36.376 slat (usec): min=14, max=110061, avg=1458.46, stdev=4544.65 00:20:36.376 clat (usec): min=809, max=458668, avg=126992.63, stdev=88668.07 00:20:36.376 lat (usec): min=878, max=458722, avg=128451.09, stdev=89853.23 00:20:36.376 clat percentiles (msec): 00:20:36.376 | 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 13], 20.00th=[ 26], 00:20:36.376 | 30.00th=[ 41], 40.00th=[ 101], 50.00th=[ 148], 60.00th=[ 171], 00:20:36.376 | 70.00th=[ 186], 80.00th=[ 203], 90.00th=[ 228], 95.00th=[ 251], 00:20:36.376 | 99.00th=[ 355], 99.50th=[ 368], 99.90th=[ 393], 99.95th=[ 393], 00:20:36.376 | 99.99th=[ 460] 00:20:36.376 bw ( KiB/s): min=69632, max=224768, per=9.22%, avg=127035.25, stdev=43436.97, samples=20 00:20:36.376 iops : min= 272, max= 878, avg=496.10, stdev=169.61, samples=20 00:20:36.376 lat (usec) : 1000=0.06% 00:20:36.376 lat (msec) : 2=0.20%, 4=2.25%, 10=5.83%, 20=8.69%, 50=15.80% 00:20:36.376 lat (msec) : 100=7.08%, 250=54.89%, 500=5.19% 00:20:36.376 cpu : usr=1.50%, sys=1.74%, ctx=3080, majf=0, minf=1 00:20:36.376 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:36.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.376 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.376 issued rwts: total=0,5026,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.376 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.376 job2: (groupid=0, jobs=1): err= 0: pid=246793: Fri Nov 29 17:02:46 2024 00:20:36.376 write: IOPS=485, BW=121MiB/s (127MB/s)(1231MiB/10135msec); 0 zone resets 00:20:36.376 slat (usec): min=18, max=81381, avg=1734.66, stdev=4582.03 00:20:36.376 clat (usec): min=1275, max=358265, avg=129854.32, stdev=79280.73 00:20:36.376 lat (usec): min=1417, max=358335, avg=131588.98, stdev=80297.16 00:20:36.376 clat percentiles (msec): 00:20:36.376 | 1.00th=[ 4], 5.00th=[ 16], 10.00th=[ 42], 20.00th=[ 49], 00:20:36.376 | 30.00th=[ 66], 40.00th=[ 90], 50.00th=[ 129], 60.00th=[ 161], 00:20:36.376 | 70.00th=[ 180], 80.00th=[ 197], 90.00th=[ 239], 95.00th=[ 271], 00:20:36.376 | 99.00th=[ 326], 99.50th=[ 338], 99.90th=[ 355], 99.95th=[ 359], 00:20:36.376 | 99.99th=[ 359] 00:20:36.376 bw ( KiB/s): min=57344, max=254976, per=9.03%, avg=124449.60, stdev=60005.34, samples=20 00:20:36.376 iops : min= 224, max= 996, avg=486.10, stdev=234.42, samples=20 00:20:36.376 lat (msec) : 2=0.14%, 4=1.24%, 10=2.50%, 20=1.77%, 50=16.57% 00:20:36.376 lat (msec) : 100=22.44%, 250=48.02%, 500=7.33% 00:20:36.376 cpu : usr=1.56%, sys=1.57%, ctx=2000, majf=0, minf=1 00:20:36.376 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:36.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.376 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.376 issued rwts: total=0,4925,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.376 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.376 job3: (groupid=0, jobs=1): err= 0: pid=246816: Fri Nov 29 17:02:46 2024 00:20:36.376 write: IOPS=421, BW=105MiB/s (111MB/s)(1074MiB/10187msec); 0 zone resets 00:20:36.376 slat (usec): min=15, max=65604, avg=1716.11, stdev=4435.51 00:20:36.376 clat (usec): min=969, max=440425, avg=149997.80, stdev=74488.19 00:20:36.376 lat (usec): min=1011, max=440493, avg=151713.92, stdev=75496.00 00:20:36.376 clat percentiles (msec): 00:20:36.376 | 1.00th=[ 8], 5.00th=[ 26], 10.00th=[ 47], 20.00th=[ 89], 00:20:36.376 | 30.00th=[ 116], 40.00th=[ 133], 50.00th=[ 142], 60.00th=[ 161], 00:20:36.376 | 70.00th=[ 182], 80.00th=[ 213], 90.00th=[ 247], 95.00th=[ 284], 00:20:36.376 | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 422], 99.95th=[ 435], 00:20:36.376 | 99.99th=[ 443] 00:20:36.376 bw ( KiB/s): min=55185, max=163840, per=7.86%, avg=108327.75, stdev=34209.72, samples=20 00:20:36.376 iops : min= 215, max= 640, avg=423.05, stdev=133.65, samples=20 00:20:36.376 lat (usec) : 1000=0.02% 00:20:36.376 lat (msec) : 2=0.23%, 4=0.28%, 10=0.68%, 20=2.21%, 50=7.50% 00:20:36.376 lat (msec) : 100=11.73%, 250=67.85%, 500=9.50% 00:20:36.376 cpu : usr=1.52%, sys=1.34%, ctx=2265, majf=0, minf=1 00:20:36.376 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:20:36.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.376 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.377 issued rwts: total=0,4295,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.377 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.377 job4: (groupid=0, jobs=1): err= 0: pid=246829: Fri Nov 29 17:02:46 2024 00:20:36.377 write: IOPS=376, BW=94.2MiB/s (98.7MB/s)(954MiB/10133msec); 0 zone resets 00:20:36.377 slat (usec): min=20, max=95567, avg=2191.24, stdev=5962.28 00:20:36.377 clat (usec): min=722, max=406430, avg=167557.36, stdev=84881.04 00:20:36.377 lat (usec): min=749, max=406536, avg=169748.60, stdev=86123.72 00:20:36.377 clat percentiles (msec): 00:20:36.377 | 1.00th=[ 5], 5.00th=[ 26], 10.00th=[ 40], 20.00th=[ 79], 00:20:36.377 | 30.00th=[ 120], 40.00th=[ 161], 50.00th=[ 184], 60.00th=[ 205], 00:20:36.377 | 70.00th=[ 222], 80.00th=[ 241], 90.00th=[ 266], 95.00th=[ 284], 00:20:36.377 | 99.00th=[ 363], 99.50th=[ 384], 99.90th=[ 401], 99.95th=[ 405], 00:20:36.377 | 99.99th=[ 405] 00:20:36.377 bw ( KiB/s): min=59784, max=202752, per=6.97%, avg=96086.45, stdev=37733.92, samples=20 00:20:36.377 iops : min= 233, max= 792, avg=375.25, stdev=147.46, samples=20 00:20:36.377 lat (usec) : 750=0.05%, 1000=0.13% 00:20:36.377 lat (msec) : 2=0.31%, 4=0.50%, 10=0.79%, 20=2.07%, 50=10.37% 00:20:36.377 lat (msec) : 100=10.87%, 250=59.00%, 500=15.90% 00:20:36.377 cpu : usr=1.11%, sys=1.41%, ctx=1799, majf=0, minf=1 00:20:36.377 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.3% 00:20:36.377 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.377 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.377 issued rwts: total=0,3817,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.377 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.377 job5: (groupid=0, jobs=1): err= 0: pid=246848: Fri Nov 29 17:02:46 2024 00:20:36.377 write: IOPS=603, BW=151MiB/s (158MB/s)(1517MiB/10059msec); 0 zone resets 00:20:36.377 slat (usec): min=24, max=67956, avg=1138.94, stdev=3404.70 00:20:36.377 clat (msec): min=3, max=340, avg=104.75, stdev=71.39 00:20:36.377 lat (msec): min=3, max=340, avg=105.88, stdev=71.96 00:20:36.377 clat percentiles (msec): 00:20:36.377 | 1.00th=[ 22], 5.00th=[ 38], 10.00th=[ 39], 20.00th=[ 41], 00:20:36.377 | 30.00th=[ 42], 40.00th=[ 57], 50.00th=[ 83], 60.00th=[ 116], 00:20:36.377 | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 218], 95.00th=[ 247], 00:20:36.377 | 99.00th=[ 300], 99.50th=[ 313], 99.90th=[ 326], 99.95th=[ 330], 00:20:36.377 | 99.99th=[ 342] 00:20:36.377 bw ( KiB/s): min=63488, max=408782, per=11.15%, avg=153627.20, stdev=96269.93, samples=20 00:20:36.377 iops : min= 248, max= 1596, avg=600.05, stdev=375.95, samples=20 00:20:36.377 lat (msec) : 4=0.03%, 10=0.08%, 20=0.79%, 50=36.76%, 100=17.41% 00:20:36.377 lat (msec) : 250=40.29%, 500=4.63% 00:20:36.377 cpu : usr=1.79%, sys=2.01%, ctx=2590, majf=0, minf=1 00:20:36.377 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:36.377 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.377 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.377 issued rwts: total=0,6066,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.377 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.377 job6: (groupid=0, jobs=1): err= 0: pid=246849: Fri Nov 29 17:02:46 2024 00:20:36.377 write: IOPS=374, BW=93.7MiB/s (98.3MB/s)(955MiB/10188msec); 0 zone resets 00:20:36.377 slat (usec): min=26, max=194183, avg=2303.35, stdev=6143.69 00:20:36.377 clat (usec): min=716, max=410353, avg=168322.98, stdev=76470.35 00:20:36.377 lat (usec): min=780, max=410394, avg=170626.33, stdev=77479.03 00:20:36.377 clat percentiles (msec): 00:20:36.377 | 1.00th=[ 26], 5.00th=[ 46], 10.00th=[ 63], 20.00th=[ 96], 00:20:36.377 | 30.00th=[ 120], 40.00th=[ 148], 50.00th=[ 174], 60.00th=[ 199], 00:20:36.377 | 70.00th=[ 218], 80.00th=[ 232], 90.00th=[ 255], 95.00th=[ 296], 00:20:36.377 | 99.00th=[ 347], 99.50th=[ 368], 99.90th=[ 405], 99.95th=[ 409], 00:20:36.377 | 99.99th=[ 409] 00:20:36.377 bw ( KiB/s): min=55296, max=192384, per=6.98%, avg=96150.85, stdev=38293.61, samples=20 00:20:36.377 iops : min= 216, max= 751, avg=375.50, stdev=149.56, samples=20 00:20:36.377 lat (usec) : 750=0.03%, 1000=0.05% 00:20:36.377 lat (msec) : 4=0.03%, 10=0.31%, 20=0.24%, 50=5.50%, 100=15.74% 00:20:36.377 lat (msec) : 250=65.57%, 500=12.54% 00:20:36.377 cpu : usr=1.26%, sys=1.26%, ctx=1443, majf=0, minf=1 00:20:36.377 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:20:36.377 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.377 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.377 issued rwts: total=0,3819,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.377 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.377 job7: (groupid=0, jobs=1): err= 0: pid=246850: Fri Nov 29 17:02:46 2024 00:20:36.377 write: IOPS=438, BW=110MiB/s (115MB/s)(1117MiB/10190msec); 0 zone resets 00:20:36.377 slat (usec): min=15, max=42034, avg=1491.79, stdev=4053.51 00:20:36.377 clat (msec): min=2, max=497, avg=144.45, stdev=79.88 00:20:36.377 lat (msec): min=3, max=497, avg=145.95, stdev=80.78 00:20:36.377 clat percentiles (msec): 00:20:36.377 | 1.00th=[ 10], 5.00th=[ 26], 10.00th=[ 43], 20.00th=[ 56], 00:20:36.377 | 30.00th=[ 86], 40.00th=[ 132], 50.00th=[ 159], 60.00th=[ 174], 00:20:36.377 | 70.00th=[ 186], 80.00th=[ 207], 90.00th=[ 241], 95.00th=[ 275], 00:20:36.377 | 99.00th=[ 330], 99.50th=[ 388], 99.90th=[ 481], 99.95th=[ 481], 00:20:36.377 | 99.99th=[ 498] 00:20:36.377 bw ( KiB/s): min=55808, max=205312, per=8.18%, avg=112691.55, stdev=45325.49, samples=20 00:20:36.377 iops : min= 218, max= 802, avg=440.15, stdev=177.09, samples=20 00:20:36.377 lat (msec) : 4=0.11%, 10=0.99%, 20=2.78%, 50=9.94%, 100=21.45% 00:20:36.377 lat (msec) : 250=56.87%, 500=7.86% 00:20:36.377 cpu : usr=1.43%, sys=1.51%, ctx=2515, majf=0, minf=1 00:20:36.377 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:36.377 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.377 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.377 issued rwts: total=0,4466,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.377 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.377 job8: (groupid=0, jobs=1): err= 0: pid=246851: Fri Nov 29 17:02:46 2024 00:20:36.377 write: IOPS=643, BW=161MiB/s (169MB/s)(1636MiB/10168msec); 0 zone resets 00:20:36.377 slat (usec): min=14, max=71256, avg=1241.83, stdev=3491.52 00:20:36.377 clat (usec): min=863, max=447304, avg=98176.69, stdev=78208.13 00:20:36.377 lat (usec): min=895, max=463543, avg=99418.53, stdev=79177.14 00:20:36.377 clat percentiles (msec): 00:20:36.377 | 1.00th=[ 5], 5.00th=[ 19], 10.00th=[ 29], 20.00th=[ 40], 00:20:36.377 | 30.00th=[ 42], 40.00th=[ 43], 50.00th=[ 72], 60.00th=[ 100], 00:20:36.377 | 70.00th=[ 124], 80.00th=[ 163], 90.00th=[ 213], 95.00th=[ 255], 00:20:36.377 | 99.00th=[ 330], 99.50th=[ 363], 99.90th=[ 430], 99.95th=[ 447], 00:20:36.377 | 99.99th=[ 447] 00:20:36.377 bw ( KiB/s): min=63488, max=401117, per=12.04%, avg=165822.25, stdev=104036.05, samples=20 00:20:36.377 iops : min= 248, max= 1566, avg=647.70, stdev=406.29, samples=20 00:20:36.377 lat (usec) : 1000=0.02% 00:20:36.377 lat (msec) : 2=0.23%, 4=0.67%, 10=1.56%, 20=2.90%, 50=39.30% 00:20:36.377 lat (msec) : 100=15.59%, 250=34.58%, 500=5.15% 00:20:36.377 cpu : usr=1.88%, sys=1.95%, ctx=2844, majf=0, minf=1 00:20:36.377 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:36.377 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.377 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.377 issued rwts: total=0,6542,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.377 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.377 job9: (groupid=0, jobs=1): err= 0: pid=246852: Fri Nov 29 17:02:46 2024 00:20:36.377 write: IOPS=487, BW=122MiB/s (128MB/s)(1235MiB/10135msec); 0 zone resets 00:20:36.377 slat (usec): min=17, max=68485, avg=1698.49, stdev=4609.40 00:20:36.377 clat (usec): min=1390, max=348713, avg=129512.17, stdev=89269.72 00:20:36.377 lat (usec): min=1546, max=348773, avg=131210.66, stdev=90541.41 00:20:36.377 clat percentiles (msec): 00:20:36.377 | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 15], 20.00th=[ 36], 00:20:36.377 | 30.00th=[ 57], 40.00th=[ 88], 50.00th=[ 136], 60.00th=[ 165], 00:20:36.377 | 70.00th=[ 178], 80.00th=[ 213], 90.00th=[ 251], 95.00th=[ 292], 00:20:36.377 | 99.00th=[ 330], 99.50th=[ 338], 99.90th=[ 347], 99.95th=[ 351], 00:20:36.377 | 99.99th=[ 351] 00:20:36.377 bw ( KiB/s): min=55296, max=249344, per=9.06%, avg=124861.95, stdev=61415.26, samples=20 00:20:36.377 iops : min= 216, max= 974, avg=487.70, stdev=239.94, samples=20 00:20:36.377 lat (msec) : 2=0.12%, 4=1.36%, 10=4.88%, 20=6.62%, 50=15.12% 00:20:36.377 lat (msec) : 100=13.66%, 250=48.21%, 500=10.04% 00:20:36.377 cpu : usr=1.69%, sys=1.51%, ctx=2515, majf=0, minf=1 00:20:36.377 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:36.377 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.377 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.377 issued rwts: total=0,4941,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.377 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.377 job10: (groupid=0, jobs=1): err= 0: pid=246853: Fri Nov 29 17:02:46 2024 00:20:36.377 write: IOPS=500, BW=125MiB/s (131MB/s)(1265MiB/10113msec); 0 zone resets 00:20:36.377 slat (usec): min=23, max=102506, avg=1578.08, stdev=4295.16 00:20:36.377 clat (usec): min=1723, max=366863, avg=126278.23, stdev=78204.17 00:20:36.377 lat (usec): min=1790, max=366894, avg=127856.31, stdev=79316.80 00:20:36.377 clat percentiles (msec): 00:20:36.377 | 1.00th=[ 13], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 41], 00:20:36.377 | 30.00th=[ 44], 40.00th=[ 103], 50.00th=[ 131], 60.00th=[ 159], 00:20:36.377 | 70.00th=[ 176], 80.00th=[ 197], 90.00th=[ 230], 95.00th=[ 249], 00:20:36.377 | 99.00th=[ 309], 99.50th=[ 338], 99.90th=[ 368], 99.95th=[ 368], 00:20:36.377 | 99.99th=[ 368] 00:20:36.377 bw ( KiB/s): min=63488, max=393728, per=9.28%, avg=127916.65, stdev=83523.42, samples=20 00:20:36.377 iops : min= 248, max= 1538, avg=499.65, stdev=326.28, samples=20 00:20:36.377 lat (msec) : 2=0.02%, 4=0.16%, 10=0.43%, 20=1.23%, 50=30.71% 00:20:36.377 lat (msec) : 100=7.19%, 250=55.83%, 500=4.43% 00:20:36.377 cpu : usr=1.60%, sys=1.74%, ctx=2458, majf=0, minf=1 00:20:36.377 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:36.377 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:36.377 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:36.377 issued rwts: total=0,5060,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:36.377 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:36.377 00:20:36.378 Run status group 0 (all jobs): 00:20:36.378 WRITE: bw=1345MiB/s (1411MB/s), 93.7MiB/s-161MiB/s (98.3MB/s-169MB/s), io=13.4GiB (14.4GB), run=10059-10190msec 00:20:36.378 00:20:36.378 Disk stats (read/write): 00:20:36.378 nvme0n1: ios=49/11747, merge=0/0, ticks=112/1249154, in_queue=1249266, util=98.07% 00:20:36.378 nvme10n1: ios=37/9769, merge=0/0, ticks=205/1211404, in_queue=1211609, util=97.89% 00:20:36.378 nvme1n1: ios=48/9670, merge=0/0, ticks=1901/1205771, in_queue=1207672, util=100.00% 00:20:36.378 nvme2n1: ios=4/8577, merge=0/0, ticks=168/1245594, in_queue=1245762, util=97.87% 00:20:36.378 nvme3n1: ios=43/7458, merge=0/0, ticks=2848/1193318, in_queue=1196166, util=100.00% 00:20:36.378 nvme4n1: ios=48/11881, merge=0/0, ticks=2892/1215543, in_queue=1218435, util=100.00% 00:20:36.378 nvme5n1: ios=44/7624, merge=0/0, ticks=2068/1211192, in_queue=1213260, util=100.00% 00:20:36.378 nvme6n1: ios=0/8917, merge=0/0, ticks=0/1249848, in_queue=1249848, util=98.51% 00:20:36.378 nvme7n1: ios=0/12776, merge=0/0, ticks=0/1202999, in_queue=1202999, util=98.74% 00:20:36.378 nvme8n1: ios=0/9702, merge=0/0, ticks=0/1209329, in_queue=1209329, util=98.97% 00:20:36.378 nvme9n1: ios=0/9830, merge=0/0, ticks=0/1211562, in_queue=1211562, util=99.09% 00:20:36.378 17:02:46 -- target/multiconnection.sh@36 -- # sync 00:20:36.378 17:02:46 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:36.378 17:02:46 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.378 17:02:46 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:36.378 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:36.378 17:02:46 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:36.378 17:02:46 -- common/autotest_common.sh@1208 -- # local i=0 00:20:36.378 17:02:46 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:36.378 17:02:46 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:36.378 17:02:46 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:36.378 17:02:46 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:36.378 17:02:46 -- common/autotest_common.sh@1220 -- # return 0 00:20:36.378 17:02:46 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:36.378 17:02:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.378 17:02:46 -- common/autotest_common.sh@10 -- # set +x 00:20:36.378 17:02:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.378 17:02:46 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.378 17:02:46 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:36.378 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:36.378 17:02:47 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:36.378 17:02:47 -- common/autotest_common.sh@1208 -- # local i=0 00:20:36.378 17:02:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:36.378 17:02:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:36.378 17:02:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:36.378 17:02:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:36.378 17:02:47 -- common/autotest_common.sh@1220 -- # return 0 00:20:36.378 17:02:47 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:36.378 17:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.378 17:02:47 -- common/autotest_common.sh@10 -- # set +x 00:20:36.378 17:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.378 17:02:47 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.378 17:02:47 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:36.378 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:36.378 17:02:47 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:36.378 17:02:47 -- common/autotest_common.sh@1208 -- # local i=0 00:20:36.378 17:02:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:36.378 17:02:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:36.378 17:02:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:36.378 17:02:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:36.378 17:02:47 -- common/autotest_common.sh@1220 -- # return 0 00:20:36.378 17:02:47 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:36.378 17:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.378 17:02:47 -- common/autotest_common.sh@10 -- # set +x 00:20:36.378 17:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.378 17:02:47 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.378 17:02:47 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:36.378 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:36.378 17:02:47 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:36.378 17:02:47 -- common/autotest_common.sh@1208 -- # local i=0 00:20:36.378 17:02:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:36.378 17:02:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:36.378 17:02:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:36.378 17:02:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:36.378 17:02:47 -- common/autotest_common.sh@1220 -- # return 0 00:20:36.378 17:02:47 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:36.378 17:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.378 17:02:47 -- common/autotest_common.sh@10 -- # set +x 00:20:36.378 17:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.378 17:02:47 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.378 17:02:47 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:36.636 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:36.636 17:02:47 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:36.636 17:02:47 -- common/autotest_common.sh@1208 -- # local i=0 00:20:36.636 17:02:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:36.636 17:02:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:36.636 17:02:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:36.636 17:02:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:36.636 17:02:47 -- common/autotest_common.sh@1220 -- # return 0 00:20:36.636 17:02:47 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:36.636 17:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.636 17:02:47 -- common/autotest_common.sh@10 -- # set +x 00:20:36.636 17:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.636 17:02:47 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.636 17:02:47 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:36.636 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:36.636 17:02:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:36.636 17:02:48 -- common/autotest_common.sh@1208 -- # local i=0 00:20:36.636 17:02:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:36.636 17:02:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:36.636 17:02:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:36.636 17:02:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:36.636 17:02:48 -- common/autotest_common.sh@1220 -- # return 0 00:20:36.636 17:02:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:36.636 17:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.636 17:02:48 -- common/autotest_common.sh@10 -- # set +x 00:20:36.636 17:02:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.636 17:02:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.636 17:02:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:36.894 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:36.894 17:02:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:36.894 17:02:48 -- common/autotest_common.sh@1208 -- # local i=0 00:20:36.894 17:02:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:36.894 17:02:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:36.894 17:02:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:36.894 17:02:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:36.894 17:02:48 -- common/autotest_common.sh@1220 -- # return 0 00:20:36.894 17:02:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:36.894 17:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.894 17:02:48 -- common/autotest_common.sh@10 -- # set +x 00:20:36.894 17:02:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.894 17:02:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.894 17:02:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:37.152 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:37.152 17:02:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:37.152 17:02:48 -- common/autotest_common.sh@1208 -- # local i=0 00:20:37.152 17:02:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:37.152 17:02:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:37.152 17:02:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:37.152 17:02:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:37.152 17:02:48 -- common/autotest_common.sh@1220 -- # return 0 00:20:37.152 17:02:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:37.152 17:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.152 17:02:48 -- common/autotest_common.sh@10 -- # set +x 00:20:37.152 17:02:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.152 17:02:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:37.152 17:02:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:37.152 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:37.152 17:02:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:37.152 17:02:48 -- common/autotest_common.sh@1208 -- # local i=0 00:20:37.152 17:02:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:37.152 17:02:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:37.152 17:02:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:37.152 17:02:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:37.152 17:02:48 -- common/autotest_common.sh@1220 -- # return 0 00:20:37.152 17:02:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:37.152 17:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.152 17:02:48 -- common/autotest_common.sh@10 -- # set +x 00:20:37.152 17:02:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.152 17:02:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:37.152 17:02:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:37.410 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:37.410 17:02:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:37.410 17:02:48 -- common/autotest_common.sh@1208 -- # local i=0 00:20:37.410 17:02:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:37.410 17:02:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:37.410 17:02:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:37.410 17:02:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:37.410 17:02:48 -- common/autotest_common.sh@1220 -- # return 0 00:20:37.410 17:02:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:37.410 17:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.410 17:02:48 -- common/autotest_common.sh@10 -- # set +x 00:20:37.410 17:02:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.410 17:02:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:37.410 17:02:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:37.410 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:37.410 17:02:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:37.410 17:02:48 -- common/autotest_common.sh@1208 -- # local i=0 00:20:37.410 17:02:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:37.410 17:02:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:37.410 17:02:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:37.410 17:02:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:37.410 17:02:48 -- common/autotest_common.sh@1220 -- # return 0 00:20:37.410 17:02:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:37.410 17:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.410 17:02:48 -- common/autotest_common.sh@10 -- # set +x 00:20:37.410 17:02:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.410 17:02:48 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:37.410 17:02:48 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:37.410 17:02:48 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:37.410 17:02:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:37.410 17:02:48 -- nvmf/common.sh@116 -- # sync 00:20:37.410 17:02:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:37.410 17:02:48 -- nvmf/common.sh@119 -- # set +e 00:20:37.410 17:02:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:37.410 17:02:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:37.410 rmmod nvme_tcp 00:20:37.410 rmmod nvme_fabrics 00:20:37.410 rmmod nvme_keyring 00:20:37.410 17:02:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:37.410 17:02:48 -- nvmf/common.sh@123 -- # set -e 00:20:37.410 17:02:48 -- nvmf/common.sh@124 -- # return 0 00:20:37.410 17:02:48 -- nvmf/common.sh@477 -- # '[' -n 241107 ']' 00:20:37.410 17:02:48 -- nvmf/common.sh@478 -- # killprocess 241107 00:20:37.410 17:02:48 -- common/autotest_common.sh@936 -- # '[' -z 241107 ']' 00:20:37.410 17:02:48 -- common/autotest_common.sh@940 -- # kill -0 241107 00:20:37.410 17:02:48 -- common/autotest_common.sh@941 -- # uname 00:20:37.410 17:02:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:37.410 17:02:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 241107 00:20:37.410 17:02:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:37.410 17:02:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:37.410 17:02:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 241107' 00:20:37.410 killing process with pid 241107 00:20:37.410 17:02:48 -- common/autotest_common.sh@955 -- # kill 241107 00:20:37.410 17:02:48 -- common/autotest_common.sh@960 -- # wait 241107 00:20:37.977 17:02:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:37.977 17:02:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:37.977 17:02:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:37.977 17:02:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:37.977 17:02:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:37.977 17:02:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:37.977 17:02:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:37.977 17:02:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:40.514 17:02:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:40.514 00:20:40.514 real 1m1.473s 00:20:40.514 user 3m25.504s 00:20:40.514 sys 0m24.329s 00:20:40.514 17:02:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:40.514 17:02:51 -- common/autotest_common.sh@10 -- # set +x 00:20:40.514 ************************************ 00:20:40.514 END TEST nvmf_multiconnection 00:20:40.514 ************************************ 00:20:40.514 17:02:51 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:40.514 17:02:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:40.514 17:02:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:40.514 17:02:51 -- common/autotest_common.sh@10 -- # set +x 00:20:40.514 ************************************ 00:20:40.514 START TEST nvmf_initiator_timeout 00:20:40.514 ************************************ 00:20:40.514 17:02:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:40.514 * Looking for test storage... 00:20:40.514 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:40.514 17:02:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:40.514 17:02:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:40.514 17:02:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:40.514 17:02:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:40.514 17:02:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:40.514 17:02:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:40.514 17:02:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:40.514 17:02:51 -- scripts/common.sh@335 -- # IFS=.-: 00:20:40.514 17:02:51 -- scripts/common.sh@335 -- # read -ra ver1 00:20:40.514 17:02:51 -- scripts/common.sh@336 -- # IFS=.-: 00:20:40.514 17:02:51 -- scripts/common.sh@336 -- # read -ra ver2 00:20:40.514 17:02:51 -- scripts/common.sh@337 -- # local 'op=<' 00:20:40.514 17:02:51 -- scripts/common.sh@339 -- # ver1_l=2 00:20:40.514 17:02:51 -- scripts/common.sh@340 -- # ver2_l=1 00:20:40.514 17:02:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:40.514 17:02:51 -- scripts/common.sh@343 -- # case "$op" in 00:20:40.514 17:02:51 -- scripts/common.sh@344 -- # : 1 00:20:40.514 17:02:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:40.514 17:02:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:40.514 17:02:51 -- scripts/common.sh@364 -- # decimal 1 00:20:40.514 17:02:51 -- scripts/common.sh@352 -- # local d=1 00:20:40.514 17:02:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:40.514 17:02:51 -- scripts/common.sh@354 -- # echo 1 00:20:40.514 17:02:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:40.514 17:02:51 -- scripts/common.sh@365 -- # decimal 2 00:20:40.514 17:02:51 -- scripts/common.sh@352 -- # local d=2 00:20:40.514 17:02:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:40.514 17:02:51 -- scripts/common.sh@354 -- # echo 2 00:20:40.514 17:02:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:40.514 17:02:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:40.514 17:02:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:40.514 17:02:51 -- scripts/common.sh@367 -- # return 0 00:20:40.514 17:02:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:40.514 17:02:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:40.514 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.514 --rc genhtml_branch_coverage=1 00:20:40.514 --rc genhtml_function_coverage=1 00:20:40.514 --rc genhtml_legend=1 00:20:40.514 --rc geninfo_all_blocks=1 00:20:40.514 --rc geninfo_unexecuted_blocks=1 00:20:40.514 00:20:40.514 ' 00:20:40.514 17:02:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:40.514 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.514 --rc genhtml_branch_coverage=1 00:20:40.514 --rc genhtml_function_coverage=1 00:20:40.514 --rc genhtml_legend=1 00:20:40.514 --rc geninfo_all_blocks=1 00:20:40.514 --rc geninfo_unexecuted_blocks=1 00:20:40.514 00:20:40.514 ' 00:20:40.514 17:02:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:40.514 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.514 --rc genhtml_branch_coverage=1 00:20:40.514 --rc genhtml_function_coverage=1 00:20:40.514 --rc genhtml_legend=1 00:20:40.514 --rc geninfo_all_blocks=1 00:20:40.514 --rc geninfo_unexecuted_blocks=1 00:20:40.514 00:20:40.514 ' 00:20:40.514 17:02:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:40.514 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.514 --rc genhtml_branch_coverage=1 00:20:40.514 --rc genhtml_function_coverage=1 00:20:40.514 --rc genhtml_legend=1 00:20:40.514 --rc geninfo_all_blocks=1 00:20:40.514 --rc geninfo_unexecuted_blocks=1 00:20:40.514 00:20:40.514 ' 00:20:40.514 17:02:51 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:40.514 17:02:51 -- nvmf/common.sh@7 -- # uname -s 00:20:40.514 17:02:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:40.514 17:02:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:40.514 17:02:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:40.514 17:02:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:40.514 17:02:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:40.514 17:02:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:40.514 17:02:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:40.514 17:02:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:40.514 17:02:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:40.514 17:02:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:40.514 17:02:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:40.514 17:02:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:40.515 17:02:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:40.515 17:02:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:40.515 17:02:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:40.515 17:02:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:40.515 17:02:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:40.515 17:02:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:40.515 17:02:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:40.515 17:02:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.515 17:02:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.515 17:02:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.515 17:02:51 -- paths/export.sh@5 -- # export PATH 00:20:40.515 17:02:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.515 17:02:51 -- nvmf/common.sh@46 -- # : 0 00:20:40.515 17:02:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:40.515 17:02:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:40.515 17:02:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:40.515 17:02:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:40.515 17:02:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:40.515 17:02:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:40.515 17:02:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:40.515 17:02:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:40.515 17:02:51 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:40.515 17:02:51 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:40.515 17:02:51 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:40.515 17:02:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:40.515 17:02:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:40.515 17:02:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:40.515 17:02:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:40.515 17:02:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:40.515 17:02:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:40.515 17:02:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:40.515 17:02:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:40.515 17:02:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:40.515 17:02:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:40.515 17:02:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:40.515 17:02:51 -- common/autotest_common.sh@10 -- # set +x 00:20:42.420 17:02:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:42.420 17:02:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:42.420 17:02:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:42.420 17:02:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:42.420 17:02:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:42.420 17:02:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:42.420 17:02:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:42.420 17:02:53 -- nvmf/common.sh@294 -- # net_devs=() 00:20:42.420 17:02:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:42.420 17:02:53 -- nvmf/common.sh@295 -- # e810=() 00:20:42.420 17:02:53 -- nvmf/common.sh@295 -- # local -ga e810 00:20:42.420 17:02:53 -- nvmf/common.sh@296 -- # x722=() 00:20:42.420 17:02:53 -- nvmf/common.sh@296 -- # local -ga x722 00:20:42.420 17:02:53 -- nvmf/common.sh@297 -- # mlx=() 00:20:42.420 17:02:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:42.420 17:02:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:42.420 17:02:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:42.420 17:02:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:42.420 17:02:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:42.421 17:02:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:42.421 17:02:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:42.421 17:02:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:42.421 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:42.421 17:02:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:42.421 17:02:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:42.421 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:42.421 17:02:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:42.421 17:02:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:42.421 17:02:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:42.421 17:02:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:42.421 17:02:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:42.421 17:02:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:42.421 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:42.421 17:02:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:42.421 17:02:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:42.421 17:02:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:42.421 17:02:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:42.421 17:02:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:42.421 17:02:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:42.421 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:42.421 17:02:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:42.421 17:02:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:42.421 17:02:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:42.421 17:02:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:42.421 17:02:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:42.421 17:02:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:42.421 17:02:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:42.421 17:02:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:42.421 17:02:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:42.421 17:02:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:42.421 17:02:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:42.421 17:02:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:42.421 17:02:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:42.421 17:02:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:42.421 17:02:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:42.421 17:02:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:42.421 17:02:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:42.421 17:02:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:42.680 17:02:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:42.680 17:02:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:42.680 17:02:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:42.680 17:02:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:42.680 17:02:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:42.680 17:02:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:42.680 17:02:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:42.680 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:42.680 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:20:42.680 00:20:42.680 --- 10.0.0.2 ping statistics --- 00:20:42.680 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:42.680 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:20:42.680 17:02:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:42.680 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:42.680 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.048 ms 00:20:42.680 00:20:42.680 --- 10.0.0.1 ping statistics --- 00:20:42.680 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:42.680 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:20:42.680 17:02:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:42.680 17:02:53 -- nvmf/common.sh@410 -- # return 0 00:20:42.680 17:02:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:42.680 17:02:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:42.680 17:02:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:42.680 17:02:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:42.680 17:02:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:42.680 17:02:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:42.680 17:02:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:42.680 17:02:53 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:42.680 17:02:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:42.680 17:02:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:42.680 17:02:53 -- common/autotest_common.sh@10 -- # set +x 00:20:42.680 17:02:53 -- nvmf/common.sh@469 -- # nvmfpid=250251 00:20:42.680 17:02:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:42.680 17:02:53 -- nvmf/common.sh@470 -- # waitforlisten 250251 00:20:42.680 17:02:53 -- common/autotest_common.sh@829 -- # '[' -z 250251 ']' 00:20:42.680 17:02:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:42.680 17:02:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:42.680 17:02:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:42.680 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:42.680 17:02:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:42.680 17:02:53 -- common/autotest_common.sh@10 -- # set +x 00:20:42.680 [2024-11-29 17:02:54.010055] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:42.680 [2024-11-29 17:02:54.010141] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:42.680 EAL: No free 2048 kB hugepages reported on node 1 00:20:42.680 [2024-11-29 17:02:54.075444] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:42.939 [2024-11-29 17:02:54.183111] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:42.939 [2024-11-29 17:02:54.183266] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:42.939 [2024-11-29 17:02:54.183283] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:42.939 [2024-11-29 17:02:54.183295] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:42.939 [2024-11-29 17:02:54.183355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:42.939 [2024-11-29 17:02:54.183416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:42.939 [2024-11-29 17:02:54.183481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:42.939 [2024-11-29 17:02:54.183483] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:43.874 17:02:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:43.874 17:02:55 -- common/autotest_common.sh@862 -- # return 0 00:20:43.874 17:02:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:43.874 17:02:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:43.874 17:02:55 -- common/autotest_common.sh@10 -- # set +x 00:20:43.875 17:02:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:43.875 17:02:55 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:43.875 17:02:55 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:43.875 17:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.875 17:02:55 -- common/autotest_common.sh@10 -- # set +x 00:20:43.875 Malloc0 00:20:43.875 17:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.875 17:02:55 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:43.875 17:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.875 17:02:55 -- common/autotest_common.sh@10 -- # set +x 00:20:43.875 Delay0 00:20:43.875 17:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.875 17:02:55 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:43.875 17:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.875 17:02:55 -- common/autotest_common.sh@10 -- # set +x 00:20:43.875 [2024-11-29 17:02:55.102142] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:43.875 17:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.875 17:02:55 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:43.875 17:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.875 17:02:55 -- common/autotest_common.sh@10 -- # set +x 00:20:43.875 17:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.875 17:02:55 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:43.875 17:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.875 17:02:55 -- common/autotest_common.sh@10 -- # set +x 00:20:43.875 17:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.875 17:02:55 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:43.875 17:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.875 17:02:55 -- common/autotest_common.sh@10 -- # set +x 00:20:43.875 [2024-11-29 17:02:55.130471] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:43.875 17:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.875 17:02:55 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:44.442 17:02:55 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:44.442 17:02:55 -- common/autotest_common.sh@1187 -- # local i=0 00:20:44.442 17:02:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:44.442 17:02:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:44.442 17:02:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:46.340 17:02:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:46.340 17:02:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:46.340 17:02:57 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:46.340 17:02:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:46.340 17:02:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:46.340 17:02:57 -- common/autotest_common.sh@1197 -- # return 0 00:20:46.340 17:02:57 -- target/initiator_timeout.sh@35 -- # fio_pid=250703 00:20:46.340 17:02:57 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:46.340 17:02:57 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:46.340 [global] 00:20:46.340 thread=1 00:20:46.340 invalidate=1 00:20:46.340 rw=write 00:20:46.340 time_based=1 00:20:46.340 runtime=60 00:20:46.340 ioengine=libaio 00:20:46.340 direct=1 00:20:46.340 bs=4096 00:20:46.340 iodepth=1 00:20:46.340 norandommap=0 00:20:46.340 numjobs=1 00:20:46.340 00:20:46.340 verify_dump=1 00:20:46.340 verify_backlog=512 00:20:46.340 verify_state_save=0 00:20:46.340 do_verify=1 00:20:46.340 verify=crc32c-intel 00:20:46.340 [job0] 00:20:46.340 filename=/dev/nvme0n1 00:20:46.597 Could not set queue depth (nvme0n1) 00:20:46.597 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:46.597 fio-3.35 00:20:46.597 Starting 1 thread 00:20:49.874 17:03:00 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:49.874 17:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:49.874 17:03:00 -- common/autotest_common.sh@10 -- # set +x 00:20:49.874 true 00:20:49.874 17:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:49.874 17:03:00 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:49.874 17:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:49.874 17:03:00 -- common/autotest_common.sh@10 -- # set +x 00:20:49.874 true 00:20:49.874 17:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:49.874 17:03:00 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:49.874 17:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:49.874 17:03:00 -- common/autotest_common.sh@10 -- # set +x 00:20:49.874 true 00:20:49.874 17:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:49.874 17:03:00 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:49.874 17:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:49.874 17:03:00 -- common/autotest_common.sh@10 -- # set +x 00:20:49.874 true 00:20:49.874 17:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:49.874 17:03:00 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:52.398 17:03:03 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:52.398 17:03:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:52.398 17:03:03 -- common/autotest_common.sh@10 -- # set +x 00:20:52.398 true 00:20:52.398 17:03:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:52.398 17:03:03 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:52.398 17:03:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:52.398 17:03:03 -- common/autotest_common.sh@10 -- # set +x 00:20:52.398 true 00:20:52.398 17:03:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:52.398 17:03:03 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:52.398 17:03:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:52.398 17:03:03 -- common/autotest_common.sh@10 -- # set +x 00:20:52.398 true 00:20:52.398 17:03:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:52.398 17:03:03 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:52.398 17:03:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:52.398 17:03:03 -- common/autotest_common.sh@10 -- # set +x 00:20:52.398 true 00:20:52.398 17:03:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:52.398 17:03:03 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:52.398 17:03:03 -- target/initiator_timeout.sh@54 -- # wait 250703 00:21:48.598 00:21:48.598 job0: (groupid=0, jobs=1): err= 0: pid=250867: Fri Nov 29 17:03:58 2024 00:21:48.598 read: IOPS=89, BW=357KiB/s (365kB/s)(20.9MiB/60040msec) 00:21:48.598 slat (nsec): min=4101, max=68360, avg=11442.75, stdev=8647.14 00:21:48.598 clat (usec): min=189, max=41315k, avg=10979.84, stdev=564637.68 00:21:48.598 lat (usec): min=198, max=41315k, avg=10991.28, stdev=564637.76 00:21:48.598 clat percentiles (usec): 00:21:48.598 | 1.00th=[ 204], 5.00th=[ 210], 10.00th=[ 217], 00:21:48.598 | 20.00th=[ 225], 30.00th=[ 235], 40.00th=[ 243], 00:21:48.598 | 50.00th=[ 249], 60.00th=[ 255], 70.00th=[ 265], 00:21:48.598 | 80.00th=[ 285], 90.00th=[ 469], 95.00th=[ 41157], 00:21:48.598 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 41681], 00:21:48.598 | 99.95th=[ 42730], 99.99th=[17112761] 00:21:48.598 write: IOPS=93, BW=375KiB/s (384kB/s)(22.0MiB/60040msec); 0 zone resets 00:21:48.598 slat (nsec): min=5431, max=77026, avg=11185.57, stdev=6380.96 00:21:48.598 clat (usec): min=155, max=829, avg=192.13, stdev=37.81 00:21:48.598 lat (usec): min=161, max=837, avg=203.32, stdev=39.80 00:21:48.598 clat percentiles (usec): 00:21:48.598 | 1.00th=[ 163], 5.00th=[ 167], 10.00th=[ 172], 20.00th=[ 176], 00:21:48.598 | 30.00th=[ 180], 40.00th=[ 184], 50.00th=[ 186], 60.00th=[ 190], 00:21:48.598 | 70.00th=[ 196], 80.00th=[ 202], 90.00th=[ 215], 95.00th=[ 229], 00:21:48.598 | 99.00th=[ 285], 99.50th=[ 314], 99.90th=[ 791], 99.95th=[ 807], 00:21:48.598 | 99.99th=[ 832] 00:21:48.598 bw ( KiB/s): min= 4096, max=10528, per=100.00%, avg=6436.57, stdev=2762.85, samples=7 00:21:48.598 iops : min= 1024, max= 2632, avg=1609.14, stdev=690.71, samples=7 00:21:48.598 lat (usec) : 250=75.67%, 500=19.76%, 750=0.89%, 1000=0.07% 00:21:48.598 lat (msec) : 50=3.60%, >=2000=0.01% 00:21:48.598 cpu : usr=0.12%, sys=0.26%, ctx=10987, majf=0, minf=1 00:21:48.598 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:48.598 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:48.598 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:48.598 issued rwts: total=5355,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:48.598 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:48.598 00:21:48.598 Run status group 0 (all jobs): 00:21:48.598 READ: bw=357KiB/s (365kB/s), 357KiB/s-357KiB/s (365kB/s-365kB/s), io=20.9MiB (21.9MB), run=60040-60040msec 00:21:48.598 WRITE: bw=375KiB/s (384kB/s), 375KiB/s-375KiB/s (384kB/s-384kB/s), io=22.0MiB (23.1MB), run=60040-60040msec 00:21:48.598 00:21:48.598 Disk stats (read/write): 00:21:48.598 nvme0n1: ios=5450/5632, merge=0/0, ticks=18508/1013, in_queue=19521, util=99.70% 00:21:48.598 17:03:58 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:48.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:48.598 17:03:58 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:48.598 17:03:58 -- common/autotest_common.sh@1208 -- # local i=0 00:21:48.598 17:03:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:48.598 17:03:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:48.598 17:03:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:48.598 17:03:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:48.598 17:03:58 -- common/autotest_common.sh@1220 -- # return 0 00:21:48.598 17:03:58 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:48.598 17:03:58 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:48.598 nvmf hotplug test: fio successful as expected 00:21:48.598 17:03:58 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:48.598 17:03:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.598 17:03:58 -- common/autotest_common.sh@10 -- # set +x 00:21:48.598 17:03:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.598 17:03:58 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:48.598 17:03:58 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:48.598 17:03:58 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:48.598 17:03:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:48.598 17:03:58 -- nvmf/common.sh@116 -- # sync 00:21:48.598 17:03:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:48.598 17:03:58 -- nvmf/common.sh@119 -- # set +e 00:21:48.598 17:03:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:48.598 17:03:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:48.598 rmmod nvme_tcp 00:21:48.598 rmmod nvme_fabrics 00:21:48.598 rmmod nvme_keyring 00:21:48.598 17:03:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:48.598 17:03:58 -- nvmf/common.sh@123 -- # set -e 00:21:48.598 17:03:58 -- nvmf/common.sh@124 -- # return 0 00:21:48.598 17:03:58 -- nvmf/common.sh@477 -- # '[' -n 250251 ']' 00:21:48.598 17:03:58 -- nvmf/common.sh@478 -- # killprocess 250251 00:21:48.598 17:03:58 -- common/autotest_common.sh@936 -- # '[' -z 250251 ']' 00:21:48.598 17:03:58 -- common/autotest_common.sh@940 -- # kill -0 250251 00:21:48.598 17:03:58 -- common/autotest_common.sh@941 -- # uname 00:21:48.598 17:03:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:48.598 17:03:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 250251 00:21:48.598 17:03:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:48.598 17:03:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:48.598 17:03:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 250251' 00:21:48.598 killing process with pid 250251 00:21:48.598 17:03:58 -- common/autotest_common.sh@955 -- # kill 250251 00:21:48.598 17:03:58 -- common/autotest_common.sh@960 -- # wait 250251 00:21:48.598 17:03:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:48.598 17:03:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:48.598 17:03:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:48.598 17:03:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:48.598 17:03:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:48.598 17:03:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:48.598 17:03:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:48.598 17:03:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:49.533 17:04:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:49.533 00:21:49.533 real 1m9.301s 00:21:49.533 user 4m14.533s 00:21:49.533 sys 0m6.644s 00:21:49.533 17:04:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:49.533 17:04:00 -- common/autotest_common.sh@10 -- # set +x 00:21:49.533 ************************************ 00:21:49.533 END TEST nvmf_initiator_timeout 00:21:49.533 ************************************ 00:21:49.533 17:04:00 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:49.533 17:04:00 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:49.533 17:04:00 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:49.533 17:04:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:49.533 17:04:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.432 17:04:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:51.432 17:04:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:51.432 17:04:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:51.432 17:04:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:51.432 17:04:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:51.432 17:04:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:51.432 17:04:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:51.432 17:04:02 -- nvmf/common.sh@294 -- # net_devs=() 00:21:51.432 17:04:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:51.432 17:04:02 -- nvmf/common.sh@295 -- # e810=() 00:21:51.432 17:04:02 -- nvmf/common.sh@295 -- # local -ga e810 00:21:51.432 17:04:02 -- nvmf/common.sh@296 -- # x722=() 00:21:51.432 17:04:02 -- nvmf/common.sh@296 -- # local -ga x722 00:21:51.432 17:04:02 -- nvmf/common.sh@297 -- # mlx=() 00:21:51.432 17:04:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:51.432 17:04:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:51.432 17:04:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:51.432 17:04:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:51.432 17:04:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:51.432 17:04:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:51.432 17:04:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:51.432 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:51.432 17:04:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:51.432 17:04:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:51.432 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:51.432 17:04:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:51.432 17:04:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:51.432 17:04:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:51.432 17:04:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:51.432 17:04:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:51.432 17:04:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:51.432 17:04:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:51.432 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:51.432 17:04:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:51.432 17:04:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:51.432 17:04:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:51.432 17:04:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:51.432 17:04:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:51.432 17:04:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:51.432 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:51.432 17:04:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:51.432 17:04:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:51.432 17:04:02 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:51.432 17:04:02 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:51.432 17:04:02 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:51.432 17:04:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:51.432 17:04:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:51.432 17:04:02 -- common/autotest_common.sh@10 -- # set +x 00:21:51.432 ************************************ 00:21:51.432 START TEST nvmf_perf_adq 00:21:51.432 ************************************ 00:21:51.432 17:04:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:51.691 * Looking for test storage... 00:21:51.691 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:51.691 17:04:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:51.691 17:04:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:51.691 17:04:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:51.691 17:04:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:51.691 17:04:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:51.691 17:04:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:51.692 17:04:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:51.692 17:04:02 -- scripts/common.sh@335 -- # IFS=.-: 00:21:51.692 17:04:02 -- scripts/common.sh@335 -- # read -ra ver1 00:21:51.692 17:04:02 -- scripts/common.sh@336 -- # IFS=.-: 00:21:51.692 17:04:02 -- scripts/common.sh@336 -- # read -ra ver2 00:21:51.692 17:04:02 -- scripts/common.sh@337 -- # local 'op=<' 00:21:51.692 17:04:02 -- scripts/common.sh@339 -- # ver1_l=2 00:21:51.692 17:04:02 -- scripts/common.sh@340 -- # ver2_l=1 00:21:51.692 17:04:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:51.692 17:04:02 -- scripts/common.sh@343 -- # case "$op" in 00:21:51.692 17:04:02 -- scripts/common.sh@344 -- # : 1 00:21:51.692 17:04:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:51.692 17:04:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:51.692 17:04:02 -- scripts/common.sh@364 -- # decimal 1 00:21:51.692 17:04:02 -- scripts/common.sh@352 -- # local d=1 00:21:51.692 17:04:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:51.692 17:04:02 -- scripts/common.sh@354 -- # echo 1 00:21:51.692 17:04:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:51.692 17:04:02 -- scripts/common.sh@365 -- # decimal 2 00:21:51.692 17:04:02 -- scripts/common.sh@352 -- # local d=2 00:21:51.692 17:04:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:51.692 17:04:02 -- scripts/common.sh@354 -- # echo 2 00:21:51.692 17:04:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:51.692 17:04:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:51.692 17:04:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:51.692 17:04:02 -- scripts/common.sh@367 -- # return 0 00:21:51.692 17:04:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:51.692 17:04:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:51.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:51.692 --rc genhtml_branch_coverage=1 00:21:51.692 --rc genhtml_function_coverage=1 00:21:51.692 --rc genhtml_legend=1 00:21:51.692 --rc geninfo_all_blocks=1 00:21:51.692 --rc geninfo_unexecuted_blocks=1 00:21:51.692 00:21:51.692 ' 00:21:51.692 17:04:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:51.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:51.692 --rc genhtml_branch_coverage=1 00:21:51.692 --rc genhtml_function_coverage=1 00:21:51.692 --rc genhtml_legend=1 00:21:51.692 --rc geninfo_all_blocks=1 00:21:51.692 --rc geninfo_unexecuted_blocks=1 00:21:51.692 00:21:51.692 ' 00:21:51.692 17:04:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:51.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:51.692 --rc genhtml_branch_coverage=1 00:21:51.692 --rc genhtml_function_coverage=1 00:21:51.692 --rc genhtml_legend=1 00:21:51.692 --rc geninfo_all_blocks=1 00:21:51.692 --rc geninfo_unexecuted_blocks=1 00:21:51.692 00:21:51.692 ' 00:21:51.692 17:04:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:51.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:51.692 --rc genhtml_branch_coverage=1 00:21:51.692 --rc genhtml_function_coverage=1 00:21:51.692 --rc genhtml_legend=1 00:21:51.692 --rc geninfo_all_blocks=1 00:21:51.692 --rc geninfo_unexecuted_blocks=1 00:21:51.692 00:21:51.692 ' 00:21:51.692 17:04:02 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:51.692 17:04:02 -- nvmf/common.sh@7 -- # uname -s 00:21:51.692 17:04:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:51.692 17:04:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:51.692 17:04:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:51.692 17:04:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:51.692 17:04:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:51.692 17:04:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:51.692 17:04:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:51.692 17:04:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:51.692 17:04:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:51.692 17:04:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:51.692 17:04:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:51.692 17:04:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:51.692 17:04:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:51.692 17:04:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:51.692 17:04:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:51.692 17:04:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:51.692 17:04:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:51.692 17:04:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:51.692 17:04:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:51.692 17:04:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:51.692 17:04:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:51.692 17:04:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:51.692 17:04:02 -- paths/export.sh@5 -- # export PATH 00:21:51.692 17:04:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:51.692 17:04:02 -- nvmf/common.sh@46 -- # : 0 00:21:51.692 17:04:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:51.692 17:04:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:51.692 17:04:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:51.692 17:04:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:51.692 17:04:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:51.692 17:04:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:51.692 17:04:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:51.692 17:04:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:51.692 17:04:02 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:51.692 17:04:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:51.692 17:04:02 -- common/autotest_common.sh@10 -- # set +x 00:21:54.226 17:04:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:54.226 17:04:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:54.226 17:04:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:54.226 17:04:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:54.226 17:04:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:54.226 17:04:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:54.226 17:04:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:54.226 17:04:05 -- nvmf/common.sh@294 -- # net_devs=() 00:21:54.226 17:04:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:54.226 17:04:05 -- nvmf/common.sh@295 -- # e810=() 00:21:54.226 17:04:05 -- nvmf/common.sh@295 -- # local -ga e810 00:21:54.226 17:04:05 -- nvmf/common.sh@296 -- # x722=() 00:21:54.226 17:04:05 -- nvmf/common.sh@296 -- # local -ga x722 00:21:54.226 17:04:05 -- nvmf/common.sh@297 -- # mlx=() 00:21:54.226 17:04:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:54.226 17:04:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:54.226 17:04:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:54.226 17:04:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:54.226 17:04:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:54.226 17:04:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:54.226 17:04:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:54.226 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:54.226 17:04:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:54.226 17:04:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:54.226 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:54.226 17:04:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:54.226 17:04:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:54.226 17:04:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:54.226 17:04:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.226 17:04:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:54.226 17:04:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.226 17:04:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:54.226 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:54.226 17:04:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.226 17:04:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:54.226 17:04:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.226 17:04:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:54.226 17:04:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.226 17:04:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:54.226 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:54.226 17:04:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.226 17:04:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:54.226 17:04:05 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:54.226 17:04:05 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:54.226 17:04:05 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:54.226 17:04:05 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:54.226 17:04:05 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:54.485 17:04:05 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:58.668 17:04:09 -- target/perf_adq.sh@54 -- # sleep 5 00:22:03.940 17:04:14 -- target/perf_adq.sh@67 -- # nvmftestinit 00:22:03.940 17:04:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:03.940 17:04:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:03.940 17:04:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:03.940 17:04:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:03.940 17:04:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:03.940 17:04:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:03.940 17:04:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:03.940 17:04:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:03.940 17:04:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:03.940 17:04:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:03.940 17:04:14 -- common/autotest_common.sh@10 -- # set +x 00:22:03.940 17:04:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:03.940 17:04:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:03.940 17:04:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:03.940 17:04:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:03.940 17:04:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:03.940 17:04:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:03.940 17:04:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:03.940 17:04:14 -- nvmf/common.sh@294 -- # net_devs=() 00:22:03.940 17:04:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:03.940 17:04:14 -- nvmf/common.sh@295 -- # e810=() 00:22:03.940 17:04:14 -- nvmf/common.sh@295 -- # local -ga e810 00:22:03.940 17:04:14 -- nvmf/common.sh@296 -- # x722=() 00:22:03.940 17:04:14 -- nvmf/common.sh@296 -- # local -ga x722 00:22:03.940 17:04:14 -- nvmf/common.sh@297 -- # mlx=() 00:22:03.940 17:04:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:03.940 17:04:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:03.940 17:04:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:03.940 17:04:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:03.940 17:04:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:03.940 17:04:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:03.940 17:04:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:03.940 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:03.940 17:04:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:03.940 17:04:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:03.940 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:03.940 17:04:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:03.940 17:04:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:03.940 17:04:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:03.940 17:04:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:03.940 17:04:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:03.940 17:04:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:03.940 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:03.940 17:04:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:03.940 17:04:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:03.940 17:04:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:03.940 17:04:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:03.940 17:04:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:03.940 17:04:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:03.940 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:03.940 17:04:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:03.940 17:04:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:03.940 17:04:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:03.940 17:04:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:03.940 17:04:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:03.940 17:04:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:03.941 17:04:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:03.941 17:04:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:03.941 17:04:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:03.941 17:04:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:03.941 17:04:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:03.941 17:04:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:03.941 17:04:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:03.941 17:04:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:03.941 17:04:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:03.941 17:04:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:03.941 17:04:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:03.941 17:04:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:03.941 17:04:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:03.941 17:04:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:03.941 17:04:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:03.941 17:04:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:03.941 17:04:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:03.941 17:04:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:03.941 17:04:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:03.941 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:03.941 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:22:03.941 00:22:03.941 --- 10.0.0.2 ping statistics --- 00:22:03.941 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:03.941 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:22:03.941 17:04:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:03.941 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:03.941 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:22:03.941 00:22:03.941 --- 10.0.0.1 ping statistics --- 00:22:03.941 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:03.941 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:22:03.941 17:04:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:03.941 17:04:14 -- nvmf/common.sh@410 -- # return 0 00:22:03.941 17:04:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:03.941 17:04:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:03.941 17:04:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:03.941 17:04:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:03.941 17:04:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:03.941 17:04:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:03.941 17:04:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:03.941 17:04:14 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:03.941 17:04:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:03.941 17:04:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:03.941 17:04:14 -- common/autotest_common.sh@10 -- # set +x 00:22:03.941 17:04:14 -- nvmf/common.sh@469 -- # nvmfpid=263591 00:22:03.941 17:04:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:03.941 17:04:14 -- nvmf/common.sh@470 -- # waitforlisten 263591 00:22:03.941 17:04:14 -- common/autotest_common.sh@829 -- # '[' -z 263591 ']' 00:22:03.941 17:04:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:03.941 17:04:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:03.941 17:04:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:03.941 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:03.941 17:04:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:03.941 17:04:14 -- common/autotest_common.sh@10 -- # set +x 00:22:03.941 [2024-11-29 17:04:14.749676] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:03.941 [2024-11-29 17:04:14.749765] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:03.941 EAL: No free 2048 kB hugepages reported on node 1 00:22:03.941 [2024-11-29 17:04:14.817988] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:03.941 [2024-11-29 17:04:14.936620] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:03.941 [2024-11-29 17:04:14.936798] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:03.941 [2024-11-29 17:04:14.936818] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:03.941 [2024-11-29 17:04:14.936833] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:03.941 [2024-11-29 17:04:14.936930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:03.941 [2024-11-29 17:04:14.936989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:03.941 [2024-11-29 17:04:14.937021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:03.941 [2024-11-29 17:04:14.937027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:04.505 17:04:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:04.505 17:04:15 -- common/autotest_common.sh@862 -- # return 0 00:22:04.505 17:04:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:04.505 17:04:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:04.505 17:04:15 -- common/autotest_common.sh@10 -- # set +x 00:22:04.505 17:04:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:04.505 17:04:15 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:22:04.505 17:04:15 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:22:04.505 17:04:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.505 17:04:15 -- common/autotest_common.sh@10 -- # set +x 00:22:04.505 17:04:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.505 17:04:15 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:04.505 17:04:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.505 17:04:15 -- common/autotest_common.sh@10 -- # set +x 00:22:04.505 17:04:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.505 17:04:15 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:22:04.505 17:04:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.505 17:04:15 -- common/autotest_common.sh@10 -- # set +x 00:22:04.505 [2024-11-29 17:04:15.856621] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:04.505 17:04:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.505 17:04:15 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:04.505 17:04:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.505 17:04:15 -- common/autotest_common.sh@10 -- # set +x 00:22:04.505 Malloc1 00:22:04.505 17:04:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.505 17:04:15 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:04.505 17:04:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.505 17:04:15 -- common/autotest_common.sh@10 -- # set +x 00:22:04.505 17:04:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.505 17:04:15 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:04.505 17:04:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.505 17:04:15 -- common/autotest_common.sh@10 -- # set +x 00:22:04.505 17:04:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.505 17:04:15 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:04.505 17:04:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.505 17:04:15 -- common/autotest_common.sh@10 -- # set +x 00:22:04.505 [2024-11-29 17:04:15.907475] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:04.505 17:04:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.505 17:04:15 -- target/perf_adq.sh@73 -- # perfpid=263750 00:22:04.505 17:04:15 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:04.505 17:04:15 -- target/perf_adq.sh@74 -- # sleep 2 00:22:04.761 EAL: No free 2048 kB hugepages reported on node 1 00:22:06.656 17:04:17 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:22:06.656 17:04:17 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:22:06.656 17:04:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:06.656 17:04:17 -- target/perf_adq.sh@76 -- # wc -l 00:22:06.656 17:04:17 -- common/autotest_common.sh@10 -- # set +x 00:22:06.656 17:04:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:06.656 17:04:17 -- target/perf_adq.sh@76 -- # count=4 00:22:06.656 17:04:17 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:22:06.656 17:04:17 -- target/perf_adq.sh@81 -- # wait 263750 00:22:14.763 Initializing NVMe Controllers 00:22:14.763 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:14.763 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:14.763 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:14.763 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:14.763 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:14.763 Initialization complete. Launching workers. 00:22:14.763 ======================================================== 00:22:14.763 Latency(us) 00:22:14.763 Device Information : IOPS MiB/s Average min max 00:22:14.763 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11178.46 43.67 5727.15 1549.98 9675.74 00:22:14.763 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11391.44 44.50 5618.82 1487.91 9509.66 00:22:14.763 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11280.55 44.06 5674.53 1157.87 9243.50 00:22:14.763 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11098.06 43.35 5767.87 1442.50 9306.94 00:22:14.763 ======================================================== 00:22:14.763 Total : 44948.51 175.58 5696.55 1157.87 9675.74 00:22:14.763 00:22:14.763 17:04:26 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:14.763 17:04:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:14.763 17:04:26 -- nvmf/common.sh@116 -- # sync 00:22:14.763 17:04:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:14.763 17:04:26 -- nvmf/common.sh@119 -- # set +e 00:22:14.763 17:04:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:14.763 17:04:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:14.763 rmmod nvme_tcp 00:22:14.763 rmmod nvme_fabrics 00:22:14.763 rmmod nvme_keyring 00:22:14.763 17:04:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:14.763 17:04:26 -- nvmf/common.sh@123 -- # set -e 00:22:14.763 17:04:26 -- nvmf/common.sh@124 -- # return 0 00:22:14.763 17:04:26 -- nvmf/common.sh@477 -- # '[' -n 263591 ']' 00:22:14.763 17:04:26 -- nvmf/common.sh@478 -- # killprocess 263591 00:22:14.763 17:04:26 -- common/autotest_common.sh@936 -- # '[' -z 263591 ']' 00:22:14.763 17:04:26 -- common/autotest_common.sh@940 -- # kill -0 263591 00:22:14.763 17:04:26 -- common/autotest_common.sh@941 -- # uname 00:22:14.763 17:04:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:14.763 17:04:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 263591 00:22:14.763 17:04:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:14.763 17:04:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:14.763 17:04:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 263591' 00:22:14.763 killing process with pid 263591 00:22:14.763 17:04:26 -- common/autotest_common.sh@955 -- # kill 263591 00:22:14.763 17:04:26 -- common/autotest_common.sh@960 -- # wait 263591 00:22:15.022 17:04:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:15.022 17:04:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:15.022 17:04:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:15.022 17:04:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:15.022 17:04:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:15.022 17:04:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.022 17:04:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.022 17:04:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.557 17:04:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:17.557 17:04:28 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:17.557 17:04:28 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:18.124 17:04:29 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:20.653 17:04:31 -- target/perf_adq.sh@54 -- # sleep 5 00:22:25.924 17:04:36 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:25.924 17:04:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:25.924 17:04:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:25.924 17:04:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:25.924 17:04:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:25.924 17:04:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:25.924 17:04:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:25.924 17:04:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:25.924 17:04:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:25.924 17:04:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:25.924 17:04:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:25.924 17:04:36 -- common/autotest_common.sh@10 -- # set +x 00:22:25.924 17:04:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:25.924 17:04:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:25.924 17:04:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:25.924 17:04:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:25.924 17:04:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:25.924 17:04:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:25.924 17:04:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:25.924 17:04:36 -- nvmf/common.sh@294 -- # net_devs=() 00:22:25.924 17:04:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:25.924 17:04:36 -- nvmf/common.sh@295 -- # e810=() 00:22:25.924 17:04:36 -- nvmf/common.sh@295 -- # local -ga e810 00:22:25.924 17:04:36 -- nvmf/common.sh@296 -- # x722=() 00:22:25.924 17:04:36 -- nvmf/common.sh@296 -- # local -ga x722 00:22:25.924 17:04:36 -- nvmf/common.sh@297 -- # mlx=() 00:22:25.924 17:04:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:25.924 17:04:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:25.924 17:04:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:25.924 17:04:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:25.924 17:04:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:25.924 17:04:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:25.924 17:04:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:25.924 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:25.924 17:04:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:25.924 17:04:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:25.924 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:25.924 17:04:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:25.924 17:04:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:25.924 17:04:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:25.924 17:04:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:25.924 17:04:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:25.924 17:04:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:25.924 17:04:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:25.924 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:25.924 17:04:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:25.924 17:04:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:25.924 17:04:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:25.924 17:04:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:25.925 17:04:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:25.925 17:04:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:25.925 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:25.925 17:04:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:25.925 17:04:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:25.925 17:04:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:25.925 17:04:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:25.925 17:04:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:25.925 17:04:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:25.925 17:04:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:25.925 17:04:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:25.925 17:04:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:25.925 17:04:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:25.925 17:04:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:25.925 17:04:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:25.925 17:04:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:25.925 17:04:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:25.925 17:04:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:25.925 17:04:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:25.925 17:04:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:25.925 17:04:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:25.925 17:04:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:25.925 17:04:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:25.925 17:04:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:25.925 17:04:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:25.925 17:04:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:25.925 17:04:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:25.925 17:04:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:25.925 17:04:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:25.925 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:25.925 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.325 ms 00:22:25.925 00:22:25.925 --- 10.0.0.2 ping statistics --- 00:22:25.925 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:25.925 rtt min/avg/max/mdev = 0.325/0.325/0.325/0.000 ms 00:22:25.925 17:04:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:25.925 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:25.925 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:22:25.925 00:22:25.925 --- 10.0.0.1 ping statistics --- 00:22:25.925 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:25.925 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:22:25.925 17:04:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:25.925 17:04:36 -- nvmf/common.sh@410 -- # return 0 00:22:25.925 17:04:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:25.925 17:04:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:25.925 17:04:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:25.925 17:04:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:25.925 17:04:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:25.925 17:04:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:25.925 17:04:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:25.925 17:04:36 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:25.925 17:04:36 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:25.925 17:04:36 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:25.925 17:04:36 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:25.925 net.core.busy_poll = 1 00:22:25.925 17:04:36 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:25.925 net.core.busy_read = 1 00:22:25.925 17:04:36 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:25.925 17:04:36 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:25.925 17:04:36 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:25.925 17:04:36 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:25.925 17:04:36 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:25.925 17:04:36 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:25.925 17:04:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:25.925 17:04:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:25.925 17:04:36 -- common/autotest_common.sh@10 -- # set +x 00:22:25.925 17:04:36 -- nvmf/common.sh@469 -- # nvmfpid=266477 00:22:25.925 17:04:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:25.925 17:04:36 -- nvmf/common.sh@470 -- # waitforlisten 266477 00:22:25.925 17:04:36 -- common/autotest_common.sh@829 -- # '[' -z 266477 ']' 00:22:25.925 17:04:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:25.925 17:04:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:25.925 17:04:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:25.925 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:25.925 17:04:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:25.925 17:04:36 -- common/autotest_common.sh@10 -- # set +x 00:22:25.925 [2024-11-29 17:04:37.021697] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:25.925 [2024-11-29 17:04:37.021769] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:25.925 EAL: No free 2048 kB hugepages reported on node 1 00:22:25.925 [2024-11-29 17:04:37.090012] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:25.925 [2024-11-29 17:04:37.204626] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:25.925 [2024-11-29 17:04:37.204789] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:25.925 [2024-11-29 17:04:37.204809] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:25.925 [2024-11-29 17:04:37.204824] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:25.925 [2024-11-29 17:04:37.204908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:25.925 [2024-11-29 17:04:37.204995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:25.925 [2024-11-29 17:04:37.205084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:25.925 [2024-11-29 17:04:37.205087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:26.860 17:04:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:26.860 17:04:37 -- common/autotest_common.sh@862 -- # return 0 00:22:26.860 17:04:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:26.860 17:04:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:26.860 17:04:37 -- common/autotest_common.sh@10 -- # set +x 00:22:26.860 17:04:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:26.860 17:04:37 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:26.860 17:04:37 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:26.860 17:04:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.860 17:04:37 -- common/autotest_common.sh@10 -- # set +x 00:22:26.860 17:04:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.860 17:04:37 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:26.860 17:04:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.860 17:04:37 -- common/autotest_common.sh@10 -- # set +x 00:22:26.860 17:04:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.860 17:04:38 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:26.860 17:04:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.860 17:04:38 -- common/autotest_common.sh@10 -- # set +x 00:22:26.860 [2024-11-29 17:04:38.112805] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:26.860 17:04:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.860 17:04:38 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:26.860 17:04:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.860 17:04:38 -- common/autotest_common.sh@10 -- # set +x 00:22:26.860 Malloc1 00:22:26.860 17:04:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.860 17:04:38 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:26.860 17:04:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.860 17:04:38 -- common/autotest_common.sh@10 -- # set +x 00:22:26.860 17:04:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.860 17:04:38 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:26.860 17:04:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.860 17:04:38 -- common/autotest_common.sh@10 -- # set +x 00:22:26.860 17:04:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.860 17:04:38 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:26.860 17:04:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.860 17:04:38 -- common/autotest_common.sh@10 -- # set +x 00:22:26.860 [2024-11-29 17:04:38.164705] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:26.860 17:04:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.860 17:04:38 -- target/perf_adq.sh@94 -- # perfpid=266715 00:22:26.860 17:04:38 -- target/perf_adq.sh@95 -- # sleep 2 00:22:26.860 17:04:38 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:26.860 EAL: No free 2048 kB hugepages reported on node 1 00:22:28.760 17:04:40 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:28.760 17:04:40 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:28.760 17:04:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.760 17:04:40 -- target/perf_adq.sh@97 -- # wc -l 00:22:28.760 17:04:40 -- common/autotest_common.sh@10 -- # set +x 00:22:28.760 17:04:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.018 17:04:40 -- target/perf_adq.sh@97 -- # count=2 00:22:29.018 17:04:40 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:29.018 17:04:40 -- target/perf_adq.sh@103 -- # wait 266715 00:22:37.121 Initializing NVMe Controllers 00:22:37.121 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:37.121 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:37.121 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:37.121 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:37.122 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:37.122 Initialization complete. Launching workers. 00:22:37.122 ======================================================== 00:22:37.122 Latency(us) 00:22:37.122 Device Information : IOPS MiB/s Average min max 00:22:37.122 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4358.80 17.03 14695.71 1787.15 58321.16 00:22:37.122 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5527.20 21.59 11588.96 1217.04 57643.32 00:22:37.122 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 12081.20 47.19 5299.21 1782.89 47257.08 00:22:37.122 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5770.10 22.54 11100.72 1270.93 59195.73 00:22:37.122 ======================================================== 00:22:37.122 Total : 27737.29 108.35 9236.05 1217.04 59195.73 00:22:37.122 00:22:37.122 17:04:48 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:37.122 17:04:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:37.122 17:04:48 -- nvmf/common.sh@116 -- # sync 00:22:37.122 17:04:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:37.122 17:04:48 -- nvmf/common.sh@119 -- # set +e 00:22:37.122 17:04:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:37.122 17:04:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:37.122 rmmod nvme_tcp 00:22:37.122 rmmod nvme_fabrics 00:22:37.122 rmmod nvme_keyring 00:22:37.122 17:04:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:37.122 17:04:48 -- nvmf/common.sh@123 -- # set -e 00:22:37.122 17:04:48 -- nvmf/common.sh@124 -- # return 0 00:22:37.122 17:04:48 -- nvmf/common.sh@477 -- # '[' -n 266477 ']' 00:22:37.122 17:04:48 -- nvmf/common.sh@478 -- # killprocess 266477 00:22:37.122 17:04:48 -- common/autotest_common.sh@936 -- # '[' -z 266477 ']' 00:22:37.122 17:04:48 -- common/autotest_common.sh@940 -- # kill -0 266477 00:22:37.122 17:04:48 -- common/autotest_common.sh@941 -- # uname 00:22:37.122 17:04:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:37.122 17:04:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 266477 00:22:37.122 17:04:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:37.122 17:04:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:37.122 17:04:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 266477' 00:22:37.122 killing process with pid 266477 00:22:37.122 17:04:48 -- common/autotest_common.sh@955 -- # kill 266477 00:22:37.122 17:04:48 -- common/autotest_common.sh@960 -- # wait 266477 00:22:37.381 17:04:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:37.381 17:04:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:37.381 17:04:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:37.381 17:04:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:37.381 17:04:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:37.381 17:04:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:37.382 17:04:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:37.382 17:04:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:40.672 17:04:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:40.672 17:04:51 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:40.672 00:22:40.672 real 0m48.932s 00:22:40.672 user 2m45.634s 00:22:40.672 sys 0m10.715s 00:22:40.672 17:04:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:40.672 17:04:51 -- common/autotest_common.sh@10 -- # set +x 00:22:40.672 ************************************ 00:22:40.672 END TEST nvmf_perf_adq 00:22:40.672 ************************************ 00:22:40.672 17:04:51 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:40.672 17:04:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:40.672 17:04:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:40.672 17:04:51 -- common/autotest_common.sh@10 -- # set +x 00:22:40.672 ************************************ 00:22:40.672 START TEST nvmf_shutdown 00:22:40.672 ************************************ 00:22:40.672 17:04:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:40.672 * Looking for test storage... 00:22:40.672 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:40.672 17:04:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:40.672 17:04:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:40.672 17:04:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:40.672 17:04:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:40.672 17:04:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:40.672 17:04:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:40.672 17:04:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:40.672 17:04:51 -- scripts/common.sh@335 -- # IFS=.-: 00:22:40.672 17:04:51 -- scripts/common.sh@335 -- # read -ra ver1 00:22:40.672 17:04:51 -- scripts/common.sh@336 -- # IFS=.-: 00:22:40.672 17:04:51 -- scripts/common.sh@336 -- # read -ra ver2 00:22:40.672 17:04:51 -- scripts/common.sh@337 -- # local 'op=<' 00:22:40.672 17:04:51 -- scripts/common.sh@339 -- # ver1_l=2 00:22:40.672 17:04:51 -- scripts/common.sh@340 -- # ver2_l=1 00:22:40.672 17:04:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:40.672 17:04:51 -- scripts/common.sh@343 -- # case "$op" in 00:22:40.672 17:04:51 -- scripts/common.sh@344 -- # : 1 00:22:40.672 17:04:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:40.672 17:04:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:40.672 17:04:51 -- scripts/common.sh@364 -- # decimal 1 00:22:40.672 17:04:51 -- scripts/common.sh@352 -- # local d=1 00:22:40.672 17:04:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:40.672 17:04:51 -- scripts/common.sh@354 -- # echo 1 00:22:40.672 17:04:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:40.672 17:04:51 -- scripts/common.sh@365 -- # decimal 2 00:22:40.672 17:04:51 -- scripts/common.sh@352 -- # local d=2 00:22:40.672 17:04:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:40.672 17:04:51 -- scripts/common.sh@354 -- # echo 2 00:22:40.672 17:04:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:40.672 17:04:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:40.672 17:04:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:40.672 17:04:51 -- scripts/common.sh@367 -- # return 0 00:22:40.672 17:04:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:40.672 17:04:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:40.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:40.672 --rc genhtml_branch_coverage=1 00:22:40.672 --rc genhtml_function_coverage=1 00:22:40.672 --rc genhtml_legend=1 00:22:40.672 --rc geninfo_all_blocks=1 00:22:40.672 --rc geninfo_unexecuted_blocks=1 00:22:40.672 00:22:40.672 ' 00:22:40.672 17:04:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:40.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:40.672 --rc genhtml_branch_coverage=1 00:22:40.672 --rc genhtml_function_coverage=1 00:22:40.672 --rc genhtml_legend=1 00:22:40.672 --rc geninfo_all_blocks=1 00:22:40.672 --rc geninfo_unexecuted_blocks=1 00:22:40.672 00:22:40.672 ' 00:22:40.672 17:04:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:40.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:40.672 --rc genhtml_branch_coverage=1 00:22:40.672 --rc genhtml_function_coverage=1 00:22:40.672 --rc genhtml_legend=1 00:22:40.672 --rc geninfo_all_blocks=1 00:22:40.672 --rc geninfo_unexecuted_blocks=1 00:22:40.672 00:22:40.672 ' 00:22:40.672 17:04:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:40.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:40.672 --rc genhtml_branch_coverage=1 00:22:40.672 --rc genhtml_function_coverage=1 00:22:40.672 --rc genhtml_legend=1 00:22:40.672 --rc geninfo_all_blocks=1 00:22:40.672 --rc geninfo_unexecuted_blocks=1 00:22:40.672 00:22:40.672 ' 00:22:40.672 17:04:51 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:40.672 17:04:51 -- nvmf/common.sh@7 -- # uname -s 00:22:40.673 17:04:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:40.673 17:04:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:40.673 17:04:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:40.673 17:04:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:40.673 17:04:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:40.673 17:04:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:40.673 17:04:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:40.673 17:04:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:40.673 17:04:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:40.673 17:04:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:40.673 17:04:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:40.673 17:04:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:40.673 17:04:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:40.673 17:04:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:40.673 17:04:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:40.673 17:04:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:40.673 17:04:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:40.673 17:04:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:40.673 17:04:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:40.673 17:04:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.673 17:04:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.673 17:04:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.673 17:04:51 -- paths/export.sh@5 -- # export PATH 00:22:40.673 17:04:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.673 17:04:51 -- nvmf/common.sh@46 -- # : 0 00:22:40.673 17:04:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:40.673 17:04:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:40.673 17:04:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:40.673 17:04:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:40.673 17:04:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:40.673 17:04:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:40.673 17:04:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:40.673 17:04:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:40.673 17:04:51 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:40.673 17:04:51 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:40.673 17:04:51 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:40.673 17:04:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:40.673 17:04:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:40.673 17:04:51 -- common/autotest_common.sh@10 -- # set +x 00:22:40.673 ************************************ 00:22:40.673 START TEST nvmf_shutdown_tc1 00:22:40.673 ************************************ 00:22:40.673 17:04:51 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:40.673 17:04:51 -- target/shutdown.sh@74 -- # starttarget 00:22:40.673 17:04:51 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:40.673 17:04:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:40.673 17:04:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:40.673 17:04:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:40.673 17:04:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:40.673 17:04:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:40.673 17:04:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:40.673 17:04:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:40.673 17:04:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:40.673 17:04:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:40.673 17:04:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:40.673 17:04:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:40.673 17:04:51 -- common/autotest_common.sh@10 -- # set +x 00:22:43.206 17:04:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:43.206 17:04:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:43.206 17:04:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:43.206 17:04:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:43.206 17:04:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:43.206 17:04:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:43.206 17:04:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:43.206 17:04:54 -- nvmf/common.sh@294 -- # net_devs=() 00:22:43.206 17:04:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:43.206 17:04:54 -- nvmf/common.sh@295 -- # e810=() 00:22:43.206 17:04:54 -- nvmf/common.sh@295 -- # local -ga e810 00:22:43.206 17:04:54 -- nvmf/common.sh@296 -- # x722=() 00:22:43.206 17:04:54 -- nvmf/common.sh@296 -- # local -ga x722 00:22:43.206 17:04:54 -- nvmf/common.sh@297 -- # mlx=() 00:22:43.206 17:04:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:43.206 17:04:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:43.206 17:04:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:43.206 17:04:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:43.206 17:04:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:43.206 17:04:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:43.206 17:04:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:43.206 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:43.206 17:04:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:43.206 17:04:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:43.206 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:43.206 17:04:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:43.206 17:04:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:43.206 17:04:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:43.206 17:04:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:43.206 17:04:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:43.206 17:04:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:43.206 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:43.206 17:04:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:43.206 17:04:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:43.206 17:04:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:43.206 17:04:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:43.206 17:04:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:43.206 17:04:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:43.206 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:43.206 17:04:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:43.206 17:04:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:43.206 17:04:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:43.206 17:04:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:43.206 17:04:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:43.206 17:04:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:43.206 17:04:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:43.206 17:04:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:43.206 17:04:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:43.206 17:04:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:43.206 17:04:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:43.206 17:04:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:43.206 17:04:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:43.206 17:04:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:43.206 17:04:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:43.206 17:04:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:43.206 17:04:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:43.206 17:04:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:43.206 17:04:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:43.206 17:04:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:43.206 17:04:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:43.206 17:04:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:43.206 17:04:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:43.206 17:04:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:43.206 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:43.206 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:22:43.206 00:22:43.206 --- 10.0.0.2 ping statistics --- 00:22:43.206 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:43.206 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:22:43.206 17:04:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:43.206 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:43.206 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:22:43.206 00:22:43.206 --- 10.0.0.1 ping statistics --- 00:22:43.206 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:43.206 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:22:43.206 17:04:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:43.206 17:04:54 -- nvmf/common.sh@410 -- # return 0 00:22:43.206 17:04:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:43.206 17:04:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:43.206 17:04:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:43.206 17:04:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:43.206 17:04:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:43.206 17:04:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:43.206 17:04:54 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:43.206 17:04:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:43.206 17:04:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:43.206 17:04:54 -- common/autotest_common.sh@10 -- # set +x 00:22:43.206 17:04:54 -- nvmf/common.sh@469 -- # nvmfpid=270074 00:22:43.206 17:04:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:43.206 17:04:54 -- nvmf/common.sh@470 -- # waitforlisten 270074 00:22:43.206 17:04:54 -- common/autotest_common.sh@829 -- # '[' -z 270074 ']' 00:22:43.206 17:04:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:43.206 17:04:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:43.206 17:04:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:43.206 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:43.206 17:04:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:43.206 17:04:54 -- common/autotest_common.sh@10 -- # set +x 00:22:43.206 [2024-11-29 17:04:54.287747] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:43.206 [2024-11-29 17:04:54.287842] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:43.206 EAL: No free 2048 kB hugepages reported on node 1 00:22:43.206 [2024-11-29 17:04:54.354510] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:43.207 [2024-11-29 17:04:54.464188] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:43.207 [2024-11-29 17:04:54.464357] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:43.207 [2024-11-29 17:04:54.464375] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:43.207 [2024-11-29 17:04:54.464388] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:43.207 [2024-11-29 17:04:54.464440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:43.207 [2024-11-29 17:04:54.464493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:43.207 [2024-11-29 17:04:54.464542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:43.207 [2024-11-29 17:04:54.464545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:44.139 17:04:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:44.139 17:04:55 -- common/autotest_common.sh@862 -- # return 0 00:22:44.139 17:04:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:44.139 17:04:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:44.139 17:04:55 -- common/autotest_common.sh@10 -- # set +x 00:22:44.139 17:04:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:44.139 17:04:55 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:44.139 17:04:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.139 17:04:55 -- common/autotest_common.sh@10 -- # set +x 00:22:44.139 [2024-11-29 17:04:55.295611] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:44.139 17:04:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.139 17:04:55 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:44.139 17:04:55 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:44.139 17:04:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:44.139 17:04:55 -- common/autotest_common.sh@10 -- # set +x 00:22:44.139 17:04:55 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.139 17:04:55 -- target/shutdown.sh@28 -- # cat 00:22:44.139 17:04:55 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:44.139 17:04:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.139 17:04:55 -- common/autotest_common.sh@10 -- # set +x 00:22:44.139 Malloc1 00:22:44.139 [2024-11-29 17:04:55.384924] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:44.139 Malloc2 00:22:44.139 Malloc3 00:22:44.139 Malloc4 00:22:44.139 Malloc5 00:22:44.396 Malloc6 00:22:44.396 Malloc7 00:22:44.396 Malloc8 00:22:44.396 Malloc9 00:22:44.396 Malloc10 00:22:44.654 17:04:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.654 17:04:55 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:44.654 17:04:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:44.654 17:04:55 -- common/autotest_common.sh@10 -- # set +x 00:22:44.654 17:04:55 -- target/shutdown.sh@78 -- # perfpid=270273 00:22:44.654 17:04:55 -- target/shutdown.sh@79 -- # waitforlisten 270273 /var/tmp/bdevperf.sock 00:22:44.654 17:04:55 -- common/autotest_common.sh@829 -- # '[' -z 270273 ']' 00:22:44.654 17:04:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:44.654 17:04:55 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:44.654 17:04:55 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:44.654 17:04:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:44.654 17:04:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:44.654 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:44.654 17:04:55 -- nvmf/common.sh@520 -- # config=() 00:22:44.654 17:04:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:44.654 17:04:55 -- nvmf/common.sh@520 -- # local subsystem config 00:22:44.654 17:04:55 -- common/autotest_common.sh@10 -- # set +x 00:22:44.654 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.654 { 00:22:44.654 "params": { 00:22:44.654 "name": "Nvme$subsystem", 00:22:44.654 "trtype": "$TEST_TRANSPORT", 00:22:44.654 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.654 "adrfam": "ipv4", 00:22:44.654 "trsvcid": "$NVMF_PORT", 00:22:44.654 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.654 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.654 "hdgst": ${hdgst:-false}, 00:22:44.654 "ddgst": ${ddgst:-false} 00:22:44.654 }, 00:22:44.654 "method": "bdev_nvme_attach_controller" 00:22:44.654 } 00:22:44.654 EOF 00:22:44.654 )") 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.654 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.654 { 00:22:44.654 "params": { 00:22:44.654 "name": "Nvme$subsystem", 00:22:44.654 "trtype": "$TEST_TRANSPORT", 00:22:44.654 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.654 "adrfam": "ipv4", 00:22:44.654 "trsvcid": "$NVMF_PORT", 00:22:44.654 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.654 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.654 "hdgst": ${hdgst:-false}, 00:22:44.654 "ddgst": ${ddgst:-false} 00:22:44.654 }, 00:22:44.654 "method": "bdev_nvme_attach_controller" 00:22:44.654 } 00:22:44.654 EOF 00:22:44.654 )") 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.654 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.654 { 00:22:44.654 "params": { 00:22:44.654 "name": "Nvme$subsystem", 00:22:44.654 "trtype": "$TEST_TRANSPORT", 00:22:44.654 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.654 "adrfam": "ipv4", 00:22:44.654 "trsvcid": "$NVMF_PORT", 00:22:44.654 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.654 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.654 "hdgst": ${hdgst:-false}, 00:22:44.654 "ddgst": ${ddgst:-false} 00:22:44.654 }, 00:22:44.654 "method": "bdev_nvme_attach_controller" 00:22:44.654 } 00:22:44.654 EOF 00:22:44.654 )") 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.654 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.654 { 00:22:44.654 "params": { 00:22:44.654 "name": "Nvme$subsystem", 00:22:44.654 "trtype": "$TEST_TRANSPORT", 00:22:44.654 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.654 "adrfam": "ipv4", 00:22:44.654 "trsvcid": "$NVMF_PORT", 00:22:44.654 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.654 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.654 "hdgst": ${hdgst:-false}, 00:22:44.654 "ddgst": ${ddgst:-false} 00:22:44.654 }, 00:22:44.654 "method": "bdev_nvme_attach_controller" 00:22:44.654 } 00:22:44.654 EOF 00:22:44.654 )") 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.654 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.654 { 00:22:44.654 "params": { 00:22:44.654 "name": "Nvme$subsystem", 00:22:44.654 "trtype": "$TEST_TRANSPORT", 00:22:44.654 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.654 "adrfam": "ipv4", 00:22:44.654 "trsvcid": "$NVMF_PORT", 00:22:44.654 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.654 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.654 "hdgst": ${hdgst:-false}, 00:22:44.654 "ddgst": ${ddgst:-false} 00:22:44.654 }, 00:22:44.654 "method": "bdev_nvme_attach_controller" 00:22:44.654 } 00:22:44.654 EOF 00:22:44.654 )") 00:22:44.654 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.655 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.655 { 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme$subsystem", 00:22:44.655 "trtype": "$TEST_TRANSPORT", 00:22:44.655 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "$NVMF_PORT", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.655 "hdgst": ${hdgst:-false}, 00:22:44.655 "ddgst": ${ddgst:-false} 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 } 00:22:44.655 EOF 00:22:44.655 )") 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.655 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.655 { 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme$subsystem", 00:22:44.655 "trtype": "$TEST_TRANSPORT", 00:22:44.655 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "$NVMF_PORT", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.655 "hdgst": ${hdgst:-false}, 00:22:44.655 "ddgst": ${ddgst:-false} 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 } 00:22:44.655 EOF 00:22:44.655 )") 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.655 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.655 { 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme$subsystem", 00:22:44.655 "trtype": "$TEST_TRANSPORT", 00:22:44.655 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "$NVMF_PORT", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.655 "hdgst": ${hdgst:-false}, 00:22:44.655 "ddgst": ${ddgst:-false} 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 } 00:22:44.655 EOF 00:22:44.655 )") 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.655 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.655 { 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme$subsystem", 00:22:44.655 "trtype": "$TEST_TRANSPORT", 00:22:44.655 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "$NVMF_PORT", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.655 "hdgst": ${hdgst:-false}, 00:22:44.655 "ddgst": ${ddgst:-false} 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 } 00:22:44.655 EOF 00:22:44.655 )") 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.655 17:04:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.655 { 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme$subsystem", 00:22:44.655 "trtype": "$TEST_TRANSPORT", 00:22:44.655 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "$NVMF_PORT", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.655 "hdgst": ${hdgst:-false}, 00:22:44.655 "ddgst": ${ddgst:-false} 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 } 00:22:44.655 EOF 00:22:44.655 )") 00:22:44.655 17:04:55 -- nvmf/common.sh@542 -- # cat 00:22:44.655 17:04:55 -- nvmf/common.sh@544 -- # jq . 00:22:44.655 17:04:55 -- nvmf/common.sh@545 -- # IFS=, 00:22:44.655 17:04:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme1", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 },{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme2", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 },{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme3", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 },{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme4", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 },{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme5", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 },{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme6", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 },{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme7", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 },{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme8", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 },{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme9", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 },{ 00:22:44.655 "params": { 00:22:44.655 "name": "Nvme10", 00:22:44.655 "trtype": "tcp", 00:22:44.655 "traddr": "10.0.0.2", 00:22:44.655 "adrfam": "ipv4", 00:22:44.655 "trsvcid": "4420", 00:22:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:44.655 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:44.655 "hdgst": false, 00:22:44.655 "ddgst": false 00:22:44.655 }, 00:22:44.655 "method": "bdev_nvme_attach_controller" 00:22:44.655 }' 00:22:44.655 [2024-11-29 17:04:55.896142] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:44.655 [2024-11-29 17:04:55.896221] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:44.655 EAL: No free 2048 kB hugepages reported on node 1 00:22:44.655 [2024-11-29 17:04:55.958611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:44.655 [2024-11-29 17:04:56.066684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:46.553 17:04:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:46.553 17:04:57 -- common/autotest_common.sh@862 -- # return 0 00:22:46.553 17:04:57 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:46.553 17:04:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.553 17:04:57 -- common/autotest_common.sh@10 -- # set +x 00:22:46.553 17:04:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.553 17:04:57 -- target/shutdown.sh@83 -- # kill -9 270273 00:22:46.553 17:04:57 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:46.553 17:04:57 -- target/shutdown.sh@87 -- # sleep 1 00:22:47.486 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 270273 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:47.486 17:04:58 -- target/shutdown.sh@88 -- # kill -0 270074 00:22:47.486 17:04:58 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:47.486 17:04:58 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:47.486 17:04:58 -- nvmf/common.sh@520 -- # config=() 00:22:47.486 17:04:58 -- nvmf/common.sh@520 -- # local subsystem config 00:22:47.486 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.486 { 00:22:47.486 "params": { 00:22:47.486 "name": "Nvme$subsystem", 00:22:47.486 "trtype": "$TEST_TRANSPORT", 00:22:47.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.486 "adrfam": "ipv4", 00:22:47.486 "trsvcid": "$NVMF_PORT", 00:22:47.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.486 "hdgst": ${hdgst:-false}, 00:22:47.486 "ddgst": ${ddgst:-false} 00:22:47.486 }, 00:22:47.486 "method": "bdev_nvme_attach_controller" 00:22:47.486 } 00:22:47.486 EOF 00:22:47.486 )") 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.486 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.486 { 00:22:47.486 "params": { 00:22:47.486 "name": "Nvme$subsystem", 00:22:47.486 "trtype": "$TEST_TRANSPORT", 00:22:47.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.486 "adrfam": "ipv4", 00:22:47.486 "trsvcid": "$NVMF_PORT", 00:22:47.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.486 "hdgst": ${hdgst:-false}, 00:22:47.486 "ddgst": ${ddgst:-false} 00:22:47.486 }, 00:22:47.486 "method": "bdev_nvme_attach_controller" 00:22:47.486 } 00:22:47.486 EOF 00:22:47.486 )") 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.486 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.486 { 00:22:47.486 "params": { 00:22:47.486 "name": "Nvme$subsystem", 00:22:47.486 "trtype": "$TEST_TRANSPORT", 00:22:47.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.486 "adrfam": "ipv4", 00:22:47.486 "trsvcid": "$NVMF_PORT", 00:22:47.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.486 "hdgst": ${hdgst:-false}, 00:22:47.486 "ddgst": ${ddgst:-false} 00:22:47.486 }, 00:22:47.486 "method": "bdev_nvme_attach_controller" 00:22:47.486 } 00:22:47.486 EOF 00:22:47.486 )") 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.486 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.486 { 00:22:47.486 "params": { 00:22:47.486 "name": "Nvme$subsystem", 00:22:47.486 "trtype": "$TEST_TRANSPORT", 00:22:47.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.486 "adrfam": "ipv4", 00:22:47.486 "trsvcid": "$NVMF_PORT", 00:22:47.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.486 "hdgst": ${hdgst:-false}, 00:22:47.486 "ddgst": ${ddgst:-false} 00:22:47.486 }, 00:22:47.486 "method": "bdev_nvme_attach_controller" 00:22:47.486 } 00:22:47.486 EOF 00:22:47.486 )") 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.486 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.486 { 00:22:47.486 "params": { 00:22:47.486 "name": "Nvme$subsystem", 00:22:47.486 "trtype": "$TEST_TRANSPORT", 00:22:47.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.486 "adrfam": "ipv4", 00:22:47.486 "trsvcid": "$NVMF_PORT", 00:22:47.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.486 "hdgst": ${hdgst:-false}, 00:22:47.486 "ddgst": ${ddgst:-false} 00:22:47.486 }, 00:22:47.486 "method": "bdev_nvme_attach_controller" 00:22:47.486 } 00:22:47.486 EOF 00:22:47.486 )") 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.486 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.486 { 00:22:47.486 "params": { 00:22:47.486 "name": "Nvme$subsystem", 00:22:47.486 "trtype": "$TEST_TRANSPORT", 00:22:47.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.486 "adrfam": "ipv4", 00:22:47.486 "trsvcid": "$NVMF_PORT", 00:22:47.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.486 "hdgst": ${hdgst:-false}, 00:22:47.486 "ddgst": ${ddgst:-false} 00:22:47.486 }, 00:22:47.486 "method": "bdev_nvme_attach_controller" 00:22:47.486 } 00:22:47.486 EOF 00:22:47.486 )") 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.486 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.486 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.486 { 00:22:47.486 "params": { 00:22:47.486 "name": "Nvme$subsystem", 00:22:47.486 "trtype": "$TEST_TRANSPORT", 00:22:47.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.486 "adrfam": "ipv4", 00:22:47.486 "trsvcid": "$NVMF_PORT", 00:22:47.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.486 "hdgst": ${hdgst:-false}, 00:22:47.486 "ddgst": ${ddgst:-false} 00:22:47.486 }, 00:22:47.486 "method": "bdev_nvme_attach_controller" 00:22:47.487 } 00:22:47.487 EOF 00:22:47.487 )") 00:22:47.487 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.487 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.487 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.487 { 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme$subsystem", 00:22:47.487 "trtype": "$TEST_TRANSPORT", 00:22:47.487 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "$NVMF_PORT", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.487 "hdgst": ${hdgst:-false}, 00:22:47.487 "ddgst": ${ddgst:-false} 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 } 00:22:47.487 EOF 00:22:47.487 )") 00:22:47.487 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.487 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.487 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.487 { 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme$subsystem", 00:22:47.487 "trtype": "$TEST_TRANSPORT", 00:22:47.487 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "$NVMF_PORT", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.487 "hdgst": ${hdgst:-false}, 00:22:47.487 "ddgst": ${ddgst:-false} 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 } 00:22:47.487 EOF 00:22:47.487 )") 00:22:47.487 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.487 17:04:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.487 17:04:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.487 { 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme$subsystem", 00:22:47.487 "trtype": "$TEST_TRANSPORT", 00:22:47.487 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "$NVMF_PORT", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.487 "hdgst": ${hdgst:-false}, 00:22:47.487 "ddgst": ${ddgst:-false} 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 } 00:22:47.487 EOF 00:22:47.487 )") 00:22:47.487 17:04:58 -- nvmf/common.sh@542 -- # cat 00:22:47.487 17:04:58 -- nvmf/common.sh@544 -- # jq . 00:22:47.487 17:04:58 -- nvmf/common.sh@545 -- # IFS=, 00:22:47.487 17:04:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme1", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 },{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme2", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 },{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme3", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 },{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme4", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 },{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme5", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 },{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme6", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 },{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme7", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 },{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme8", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 },{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme9", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 },{ 00:22:47.487 "params": { 00:22:47.487 "name": "Nvme10", 00:22:47.487 "trtype": "tcp", 00:22:47.487 "traddr": "10.0.0.2", 00:22:47.487 "adrfam": "ipv4", 00:22:47.487 "trsvcid": "4420", 00:22:47.487 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:47.487 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:47.487 "hdgst": false, 00:22:47.487 "ddgst": false 00:22:47.487 }, 00:22:47.487 "method": "bdev_nvme_attach_controller" 00:22:47.487 }' 00:22:47.487 [2024-11-29 17:04:58.699145] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:47.487 [2024-11-29 17:04:58.699228] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid270704 ] 00:22:47.487 EAL: No free 2048 kB hugepages reported on node 1 00:22:47.487 [2024-11-29 17:04:58.765412] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:47.487 [2024-11-29 17:04:58.877105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:48.859 Running I/O for 1 seconds... 00:22:49.792 00:22:49.792 Latency(us) 00:22:49.792 [2024-11-29T16:05:01.223Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme1n1 : 1.08 400.75 25.05 0.00 0.00 157034.39 17282.09 123498.95 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme2n1 : 1.10 396.10 24.76 0.00 0.00 157207.32 19223.89 129712.73 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme3n1 : 1.08 400.29 25.02 0.00 0.00 154878.04 17185.00 120392.06 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme4n1 : 1.09 399.64 24.98 0.00 0.00 154105.35 16214.09 115731.72 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme5n1 : 1.09 397.80 24.86 0.00 0.00 153365.54 19418.07 115731.72 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme6n1 : 1.10 394.50 24.66 0.00 0.00 153667.99 18544.26 121168.78 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme7n1 : 1.10 392.99 24.56 0.00 0.00 153640.93 15049.01 122722.23 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme8n1 : 1.11 392.29 24.52 0.00 0.00 153124.99 12379.02 124275.67 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme9n1 : 1.11 391.51 24.47 0.00 0.00 152534.28 10388.67 126605.84 00:22:49.792 [2024-11-29T16:05:01.223Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.792 Verification LBA range: start 0x0 length 0x400 00:22:49.792 Nvme10n1 : 1.11 390.71 24.42 0.00 0.00 152033.17 8107.05 128936.01 00:22:49.792 [2024-11-29T16:05:01.223Z] =================================================================================================================== 00:22:49.792 [2024-11-29T16:05:01.223Z] Total : 3956.60 247.29 0.00 0.00 154159.20 8107.05 129712.73 00:22:50.050 17:05:01 -- target/shutdown.sh@93 -- # stoptarget 00:22:50.050 17:05:01 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:50.050 17:05:01 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:50.050 17:05:01 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:50.050 17:05:01 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:50.050 17:05:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:50.050 17:05:01 -- nvmf/common.sh@116 -- # sync 00:22:50.050 17:05:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:50.050 17:05:01 -- nvmf/common.sh@119 -- # set +e 00:22:50.050 17:05:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:50.050 17:05:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:50.050 rmmod nvme_tcp 00:22:50.050 rmmod nvme_fabrics 00:22:50.050 rmmod nvme_keyring 00:22:50.050 17:05:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:50.050 17:05:01 -- nvmf/common.sh@123 -- # set -e 00:22:50.050 17:05:01 -- nvmf/common.sh@124 -- # return 0 00:22:50.050 17:05:01 -- nvmf/common.sh@477 -- # '[' -n 270074 ']' 00:22:50.050 17:05:01 -- nvmf/common.sh@478 -- # killprocess 270074 00:22:50.050 17:05:01 -- common/autotest_common.sh@936 -- # '[' -z 270074 ']' 00:22:50.050 17:05:01 -- common/autotest_common.sh@940 -- # kill -0 270074 00:22:50.050 17:05:01 -- common/autotest_common.sh@941 -- # uname 00:22:50.050 17:05:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:50.050 17:05:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 270074 00:22:50.308 17:05:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:50.308 17:05:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:50.308 17:05:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 270074' 00:22:50.308 killing process with pid 270074 00:22:50.308 17:05:01 -- common/autotest_common.sh@955 -- # kill 270074 00:22:50.308 17:05:01 -- common/autotest_common.sh@960 -- # wait 270074 00:22:50.874 17:05:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:50.874 17:05:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:50.874 17:05:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:50.874 17:05:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:50.874 17:05:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:50.874 17:05:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:50.874 17:05:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:50.874 17:05:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:52.778 17:05:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:52.778 00:22:52.778 real 0m12.095s 00:22:52.778 user 0m34.742s 00:22:52.778 sys 0m3.291s 00:22:52.778 17:05:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:52.778 17:05:04 -- common/autotest_common.sh@10 -- # set +x 00:22:52.778 ************************************ 00:22:52.778 END TEST nvmf_shutdown_tc1 00:22:52.778 ************************************ 00:22:52.778 17:05:04 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:52.778 17:05:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:52.778 17:05:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:52.778 17:05:04 -- common/autotest_common.sh@10 -- # set +x 00:22:52.778 ************************************ 00:22:52.778 START TEST nvmf_shutdown_tc2 00:22:52.778 ************************************ 00:22:52.778 17:05:04 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:52.778 17:05:04 -- target/shutdown.sh@98 -- # starttarget 00:22:52.778 17:05:04 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:52.778 17:05:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:52.778 17:05:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:52.778 17:05:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:52.778 17:05:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:52.778 17:05:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:52.778 17:05:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:52.778 17:05:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:52.778 17:05:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:52.778 17:05:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:52.778 17:05:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:52.779 17:05:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:52.779 17:05:04 -- common/autotest_common.sh@10 -- # set +x 00:22:52.779 17:05:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:52.779 17:05:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:52.779 17:05:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:52.779 17:05:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:52.779 17:05:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:52.779 17:05:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:52.779 17:05:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:52.779 17:05:04 -- nvmf/common.sh@294 -- # net_devs=() 00:22:52.779 17:05:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:52.779 17:05:04 -- nvmf/common.sh@295 -- # e810=() 00:22:52.779 17:05:04 -- nvmf/common.sh@295 -- # local -ga e810 00:22:52.779 17:05:04 -- nvmf/common.sh@296 -- # x722=() 00:22:52.779 17:05:04 -- nvmf/common.sh@296 -- # local -ga x722 00:22:52.779 17:05:04 -- nvmf/common.sh@297 -- # mlx=() 00:22:52.779 17:05:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:52.779 17:05:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:52.779 17:05:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:52.779 17:05:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:52.779 17:05:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:52.779 17:05:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:52.779 17:05:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:52.779 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:52.779 17:05:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:52.779 17:05:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:52.779 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:52.779 17:05:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:52.779 17:05:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:52.779 17:05:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:52.779 17:05:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:52.779 17:05:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:52.779 17:05:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:52.779 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:52.779 17:05:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:52.779 17:05:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:52.779 17:05:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:52.779 17:05:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:52.779 17:05:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:52.779 17:05:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:52.779 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:52.779 17:05:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:52.779 17:05:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:52.779 17:05:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:52.779 17:05:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:52.779 17:05:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:52.779 17:05:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:52.779 17:05:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:52.779 17:05:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:52.779 17:05:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:52.779 17:05:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:52.779 17:05:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:52.779 17:05:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:52.779 17:05:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:52.779 17:05:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:52.779 17:05:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:52.779 17:05:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:52.779 17:05:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:52.779 17:05:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:52.779 17:05:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:52.779 17:05:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:52.779 17:05:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:52.779 17:05:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:53.037 17:05:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:53.037 17:05:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:53.037 17:05:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:53.037 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:53.037 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:22:53.037 00:22:53.037 --- 10.0.0.2 ping statistics --- 00:22:53.037 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:53.037 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:22:53.037 17:05:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:53.037 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:53.037 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:22:53.037 00:22:53.037 --- 10.0.0.1 ping statistics --- 00:22:53.037 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:53.037 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:22:53.037 17:05:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:53.037 17:05:04 -- nvmf/common.sh@410 -- # return 0 00:22:53.037 17:05:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:53.037 17:05:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:53.037 17:05:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:53.037 17:05:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:53.037 17:05:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:53.037 17:05:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:53.037 17:05:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:53.037 17:05:04 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:53.037 17:05:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:53.037 17:05:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:53.037 17:05:04 -- common/autotest_common.sh@10 -- # set +x 00:22:53.037 17:05:04 -- nvmf/common.sh@469 -- # nvmfpid=271476 00:22:53.037 17:05:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:53.037 17:05:04 -- nvmf/common.sh@470 -- # waitforlisten 271476 00:22:53.037 17:05:04 -- common/autotest_common.sh@829 -- # '[' -z 271476 ']' 00:22:53.037 17:05:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:53.037 17:05:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:53.038 17:05:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:53.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:53.038 17:05:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:53.038 17:05:04 -- common/autotest_common.sh@10 -- # set +x 00:22:53.038 [2024-11-29 17:05:04.309101] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:53.038 [2024-11-29 17:05:04.309199] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:53.038 EAL: No free 2048 kB hugepages reported on node 1 00:22:53.038 [2024-11-29 17:05:04.374818] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:53.295 [2024-11-29 17:05:04.486701] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:53.295 [2024-11-29 17:05:04.486850] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:53.295 [2024-11-29 17:05:04.486867] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:53.295 [2024-11-29 17:05:04.486879] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:53.295 [2024-11-29 17:05:04.486980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:53.295 [2024-11-29 17:05:04.487033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:53.295 [2024-11-29 17:05:04.487104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:53.295 [2024-11-29 17:05:04.487106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:53.879 17:05:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:53.879 17:05:05 -- common/autotest_common.sh@862 -- # return 0 00:22:53.879 17:05:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:53.879 17:05:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:53.879 17:05:05 -- common/autotest_common.sh@10 -- # set +x 00:22:53.879 17:05:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:53.879 17:05:05 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:53.879 17:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.879 17:05:05 -- common/autotest_common.sh@10 -- # set +x 00:22:54.139 [2024-11-29 17:05:05.308613] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:54.139 17:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.139 17:05:05 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:54.139 17:05:05 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:54.139 17:05:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:54.139 17:05:05 -- common/autotest_common.sh@10 -- # set +x 00:22:54.139 17:05:05 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.139 17:05:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.139 17:05:05 -- target/shutdown.sh@28 -- # cat 00:22:54.140 17:05:05 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:54.140 17:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.140 17:05:05 -- common/autotest_common.sh@10 -- # set +x 00:22:54.140 Malloc1 00:22:54.140 [2024-11-29 17:05:05.388932] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:54.140 Malloc2 00:22:54.140 Malloc3 00:22:54.140 Malloc4 00:22:54.140 Malloc5 00:22:54.397 Malloc6 00:22:54.397 Malloc7 00:22:54.397 Malloc8 00:22:54.397 Malloc9 00:22:54.397 Malloc10 00:22:54.655 17:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.655 17:05:05 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:54.655 17:05:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:54.655 17:05:05 -- common/autotest_common.sh@10 -- # set +x 00:22:54.655 17:05:05 -- target/shutdown.sh@102 -- # perfpid=271673 00:22:54.655 17:05:05 -- target/shutdown.sh@103 -- # waitforlisten 271673 /var/tmp/bdevperf.sock 00:22:54.655 17:05:05 -- common/autotest_common.sh@829 -- # '[' -z 271673 ']' 00:22:54.655 17:05:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:54.655 17:05:05 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:54.655 17:05:05 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:54.655 17:05:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:54.655 17:05:05 -- nvmf/common.sh@520 -- # config=() 00:22:54.655 17:05:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:54.655 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:54.655 17:05:05 -- nvmf/common.sh@520 -- # local subsystem config 00:22:54.655 17:05:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:54.655 17:05:05 -- common/autotest_common.sh@10 -- # set +x 00:22:54.655 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.655 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.655 { 00:22:54.655 "params": { 00:22:54.655 "name": "Nvme$subsystem", 00:22:54.655 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.656 { 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme$subsystem", 00:22:54.656 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.656 { 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme$subsystem", 00:22:54.656 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.656 { 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme$subsystem", 00:22:54.656 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.656 { 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme$subsystem", 00:22:54.656 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.656 { 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme$subsystem", 00:22:54.656 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.656 { 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme$subsystem", 00:22:54.656 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.656 { 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme$subsystem", 00:22:54.656 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.656 { 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme$subsystem", 00:22:54.656 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.656 { 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme$subsystem", 00:22:54.656 "trtype": "$TEST_TRANSPORT", 00:22:54.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "$NVMF_PORT", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.656 "hdgst": ${hdgst:-false}, 00:22:54.656 "ddgst": ${ddgst:-false} 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 } 00:22:54.656 EOF 00:22:54.656 )") 00:22:54.656 17:05:05 -- nvmf/common.sh@542 -- # cat 00:22:54.656 17:05:05 -- nvmf/common.sh@544 -- # jq . 00:22:54.656 17:05:05 -- nvmf/common.sh@545 -- # IFS=, 00:22:54.656 17:05:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme1", 00:22:54.656 "trtype": "tcp", 00:22:54.656 "traddr": "10.0.0.2", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "4420", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:54.656 "hdgst": false, 00:22:54.656 "ddgst": false 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 },{ 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme2", 00:22:54.656 "trtype": "tcp", 00:22:54.656 "traddr": "10.0.0.2", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "4420", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:54.656 "hdgst": false, 00:22:54.656 "ddgst": false 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 },{ 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme3", 00:22:54.656 "trtype": "tcp", 00:22:54.656 "traddr": "10.0.0.2", 00:22:54.656 "adrfam": "ipv4", 00:22:54.656 "trsvcid": "4420", 00:22:54.656 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:54.656 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:54.656 "hdgst": false, 00:22:54.656 "ddgst": false 00:22:54.656 }, 00:22:54.656 "method": "bdev_nvme_attach_controller" 00:22:54.656 },{ 00:22:54.656 "params": { 00:22:54.656 "name": "Nvme4", 00:22:54.656 "trtype": "tcp", 00:22:54.656 "traddr": "10.0.0.2", 00:22:54.657 "adrfam": "ipv4", 00:22:54.657 "trsvcid": "4420", 00:22:54.657 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:54.657 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:54.657 "hdgst": false, 00:22:54.657 "ddgst": false 00:22:54.657 }, 00:22:54.657 "method": "bdev_nvme_attach_controller" 00:22:54.657 },{ 00:22:54.657 "params": { 00:22:54.657 "name": "Nvme5", 00:22:54.657 "trtype": "tcp", 00:22:54.657 "traddr": "10.0.0.2", 00:22:54.657 "adrfam": "ipv4", 00:22:54.657 "trsvcid": "4420", 00:22:54.657 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:54.657 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:54.657 "hdgst": false, 00:22:54.657 "ddgst": false 00:22:54.657 }, 00:22:54.657 "method": "bdev_nvme_attach_controller" 00:22:54.657 },{ 00:22:54.657 "params": { 00:22:54.657 "name": "Nvme6", 00:22:54.657 "trtype": "tcp", 00:22:54.657 "traddr": "10.0.0.2", 00:22:54.657 "adrfam": "ipv4", 00:22:54.657 "trsvcid": "4420", 00:22:54.657 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:54.657 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:54.657 "hdgst": false, 00:22:54.657 "ddgst": false 00:22:54.657 }, 00:22:54.657 "method": "bdev_nvme_attach_controller" 00:22:54.657 },{ 00:22:54.657 "params": { 00:22:54.657 "name": "Nvme7", 00:22:54.657 "trtype": "tcp", 00:22:54.657 "traddr": "10.0.0.2", 00:22:54.657 "adrfam": "ipv4", 00:22:54.657 "trsvcid": "4420", 00:22:54.657 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:54.657 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:54.657 "hdgst": false, 00:22:54.657 "ddgst": false 00:22:54.657 }, 00:22:54.657 "method": "bdev_nvme_attach_controller" 00:22:54.657 },{ 00:22:54.657 "params": { 00:22:54.657 "name": "Nvme8", 00:22:54.657 "trtype": "tcp", 00:22:54.657 "traddr": "10.0.0.2", 00:22:54.657 "adrfam": "ipv4", 00:22:54.657 "trsvcid": "4420", 00:22:54.657 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:54.657 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:54.657 "hdgst": false, 00:22:54.657 "ddgst": false 00:22:54.657 }, 00:22:54.657 "method": "bdev_nvme_attach_controller" 00:22:54.657 },{ 00:22:54.657 "params": { 00:22:54.657 "name": "Nvme9", 00:22:54.657 "trtype": "tcp", 00:22:54.657 "traddr": "10.0.0.2", 00:22:54.657 "adrfam": "ipv4", 00:22:54.657 "trsvcid": "4420", 00:22:54.657 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:54.657 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:54.657 "hdgst": false, 00:22:54.657 "ddgst": false 00:22:54.657 }, 00:22:54.657 "method": "bdev_nvme_attach_controller" 00:22:54.657 },{ 00:22:54.657 "params": { 00:22:54.657 "name": "Nvme10", 00:22:54.657 "trtype": "tcp", 00:22:54.657 "traddr": "10.0.0.2", 00:22:54.657 "adrfam": "ipv4", 00:22:54.657 "trsvcid": "4420", 00:22:54.657 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:54.657 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:54.657 "hdgst": false, 00:22:54.657 "ddgst": false 00:22:54.657 }, 00:22:54.657 "method": "bdev_nvme_attach_controller" 00:22:54.657 }' 00:22:54.657 [2024-11-29 17:05:05.904204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:54.657 [2024-11-29 17:05:05.904294] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid271673 ] 00:22:54.657 EAL: No free 2048 kB hugepages reported on node 1 00:22:54.657 [2024-11-29 17:05:05.966012] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:54.657 [2024-11-29 17:05:06.073881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:56.030 Running I/O for 10 seconds... 00:22:56.288 17:05:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:56.288 17:05:07 -- common/autotest_common.sh@862 -- # return 0 00:22:56.288 17:05:07 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:56.288 17:05:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.288 17:05:07 -- common/autotest_common.sh@10 -- # set +x 00:22:56.546 17:05:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.546 17:05:07 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:56.546 17:05:07 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:56.546 17:05:07 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:56.546 17:05:07 -- target/shutdown.sh@57 -- # local ret=1 00:22:56.546 17:05:07 -- target/shutdown.sh@58 -- # local i 00:22:56.546 17:05:07 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:56.546 17:05:07 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:56.546 17:05:07 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:56.546 17:05:07 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:56.546 17:05:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.546 17:05:07 -- common/autotest_common.sh@10 -- # set +x 00:22:56.546 17:05:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.546 17:05:07 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:56.546 17:05:07 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:56.546 17:05:07 -- target/shutdown.sh@64 -- # ret=0 00:22:56.546 17:05:07 -- target/shutdown.sh@65 -- # break 00:22:56.546 17:05:07 -- target/shutdown.sh@69 -- # return 0 00:22:56.546 17:05:07 -- target/shutdown.sh@109 -- # killprocess 271673 00:22:56.546 17:05:07 -- common/autotest_common.sh@936 -- # '[' -z 271673 ']' 00:22:56.546 17:05:07 -- common/autotest_common.sh@940 -- # kill -0 271673 00:22:56.546 17:05:07 -- common/autotest_common.sh@941 -- # uname 00:22:56.546 17:05:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:56.546 17:05:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 271673 00:22:56.546 17:05:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:56.546 17:05:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:56.546 17:05:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 271673' 00:22:56.546 killing process with pid 271673 00:22:56.546 17:05:07 -- common/autotest_common.sh@955 -- # kill 271673 00:22:56.546 17:05:07 -- common/autotest_common.sh@960 -- # wait 271673 00:22:56.546 Received shutdown signal, test time was about 0.579058 seconds 00:22:56.546 00:22:56.546 Latency(us) 00:22:56.546 [2024-11-29T16:05:07.977Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme1n1 : 0.56 410.23 25.64 0.00 0.00 150118.32 23787.14 119615.34 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme2n1 : 0.56 405.63 25.35 0.00 0.00 149480.63 24660.95 118061.89 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme3n1 : 0.56 409.19 25.57 0.00 0.00 146297.73 23010.42 116508.44 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme4n1 : 0.56 408.19 25.51 0.00 0.00 144587.58 23690.05 114955.00 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme5n1 : 0.56 404.53 25.28 0.00 0.00 143650.31 25049.32 115731.72 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme6n1 : 0.57 401.24 25.08 0.00 0.00 142509.93 26796.94 116508.44 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme7n1 : 0.57 399.17 24.95 0.00 0.00 141404.46 25049.32 121168.78 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme8n1 : 0.57 397.52 24.85 0.00 0.00 140226.60 24660.95 122722.23 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme9n1 : 0.58 395.95 24.75 0.00 0.00 139122.84 22719.15 121945.51 00:22:56.546 [2024-11-29T16:05:07.977Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.546 Verification LBA range: start 0x0 length 0x400 00:22:56.546 Nvme10n1 : 0.58 394.27 24.64 0.00 0.00 139707.08 12621.75 122722.23 00:22:56.546 [2024-11-29T16:05:07.977Z] =================================================================================================================== 00:22:56.546 [2024-11-29T16:05:07.977Z] Total : 4025.91 251.62 0.00 0.00 143710.55 12621.75 122722.23 00:22:56.804 17:05:08 -- target/shutdown.sh@112 -- # sleep 1 00:22:58.176 17:05:09 -- target/shutdown.sh@113 -- # kill -0 271476 00:22:58.176 17:05:09 -- target/shutdown.sh@115 -- # stoptarget 00:22:58.177 17:05:09 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:58.177 17:05:09 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:58.177 17:05:09 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:58.177 17:05:09 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:58.177 17:05:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:58.177 17:05:09 -- nvmf/common.sh@116 -- # sync 00:22:58.177 17:05:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:58.177 17:05:09 -- nvmf/common.sh@119 -- # set +e 00:22:58.177 17:05:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:58.177 17:05:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:58.177 rmmod nvme_tcp 00:22:58.177 rmmod nvme_fabrics 00:22:58.177 rmmod nvme_keyring 00:22:58.177 17:05:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:58.177 17:05:09 -- nvmf/common.sh@123 -- # set -e 00:22:58.177 17:05:09 -- nvmf/common.sh@124 -- # return 0 00:22:58.177 17:05:09 -- nvmf/common.sh@477 -- # '[' -n 271476 ']' 00:22:58.177 17:05:09 -- nvmf/common.sh@478 -- # killprocess 271476 00:22:58.177 17:05:09 -- common/autotest_common.sh@936 -- # '[' -z 271476 ']' 00:22:58.177 17:05:09 -- common/autotest_common.sh@940 -- # kill -0 271476 00:22:58.177 17:05:09 -- common/autotest_common.sh@941 -- # uname 00:22:58.177 17:05:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:58.177 17:05:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 271476 00:22:58.177 17:05:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:58.177 17:05:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:58.177 17:05:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 271476' 00:22:58.177 killing process with pid 271476 00:22:58.177 17:05:09 -- common/autotest_common.sh@955 -- # kill 271476 00:22:58.177 17:05:09 -- common/autotest_common.sh@960 -- # wait 271476 00:22:58.435 17:05:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:58.435 17:05:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:58.435 17:05:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:58.435 17:05:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:58.435 17:05:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:58.435 17:05:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:58.435 17:05:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:58.435 17:05:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.970 17:05:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:00.970 00:23:00.970 real 0m7.764s 00:23:00.970 user 0m23.401s 00:23:00.970 sys 0m1.419s 00:23:00.970 17:05:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:00.970 17:05:11 -- common/autotest_common.sh@10 -- # set +x 00:23:00.970 ************************************ 00:23:00.970 END TEST nvmf_shutdown_tc2 00:23:00.970 ************************************ 00:23:00.970 17:05:11 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:23:00.970 17:05:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:23:00.970 17:05:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:00.970 17:05:11 -- common/autotest_common.sh@10 -- # set +x 00:23:00.970 ************************************ 00:23:00.970 START TEST nvmf_shutdown_tc3 00:23:00.970 ************************************ 00:23:00.970 17:05:11 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:23:00.970 17:05:11 -- target/shutdown.sh@120 -- # starttarget 00:23:00.970 17:05:11 -- target/shutdown.sh@15 -- # nvmftestinit 00:23:00.970 17:05:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:00.970 17:05:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:00.970 17:05:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:00.970 17:05:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:00.970 17:05:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:00.970 17:05:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:00.970 17:05:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:00.970 17:05:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.970 17:05:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:00.970 17:05:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:00.970 17:05:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:00.970 17:05:11 -- common/autotest_common.sh@10 -- # set +x 00:23:00.970 17:05:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:00.970 17:05:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:00.970 17:05:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:00.970 17:05:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:00.970 17:05:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:00.970 17:05:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:00.970 17:05:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:00.970 17:05:11 -- nvmf/common.sh@294 -- # net_devs=() 00:23:00.970 17:05:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:00.970 17:05:11 -- nvmf/common.sh@295 -- # e810=() 00:23:00.970 17:05:11 -- nvmf/common.sh@295 -- # local -ga e810 00:23:00.970 17:05:11 -- nvmf/common.sh@296 -- # x722=() 00:23:00.970 17:05:11 -- nvmf/common.sh@296 -- # local -ga x722 00:23:00.970 17:05:11 -- nvmf/common.sh@297 -- # mlx=() 00:23:00.970 17:05:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:00.970 17:05:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:00.970 17:05:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:00.970 17:05:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:00.970 17:05:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:00.970 17:05:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:00.970 17:05:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:00.970 17:05:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:00.970 17:05:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:00.970 17:05:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:00.970 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:00.970 17:05:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:00.970 17:05:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:00.970 17:05:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:00.970 17:05:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:00.970 17:05:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:00.970 17:05:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:00.970 17:05:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:00.970 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:00.971 17:05:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:00.971 17:05:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:00.971 17:05:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:00.971 17:05:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:00.971 17:05:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:00.971 17:05:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:00.971 17:05:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:00.971 17:05:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:00.971 17:05:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:00.971 17:05:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:00.971 17:05:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:00.971 17:05:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:00.971 17:05:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:00.971 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:00.971 17:05:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:00.971 17:05:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:00.971 17:05:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:00.971 17:05:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:00.971 17:05:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:00.971 17:05:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:00.971 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:00.971 17:05:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:00.971 17:05:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:00.971 17:05:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:00.971 17:05:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:00.971 17:05:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:00.971 17:05:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:00.971 17:05:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:00.971 17:05:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:00.971 17:05:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:00.971 17:05:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:00.971 17:05:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:00.971 17:05:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:00.971 17:05:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:00.971 17:05:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:00.971 17:05:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:00.971 17:05:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:00.971 17:05:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:00.971 17:05:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:00.971 17:05:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:00.971 17:05:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:00.971 17:05:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:00.971 17:05:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:00.971 17:05:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:00.971 17:05:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:00.971 17:05:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:00.971 17:05:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:00.971 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:00.971 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:23:00.971 00:23:00.971 --- 10.0.0.2 ping statistics --- 00:23:00.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:00.971 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:23:00.971 17:05:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:00.971 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:00.971 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:23:00.971 00:23:00.971 --- 10.0.0.1 ping statistics --- 00:23:00.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:00.971 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:23:00.971 17:05:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:00.971 17:05:12 -- nvmf/common.sh@410 -- # return 0 00:23:00.971 17:05:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:00.971 17:05:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:00.971 17:05:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:00.971 17:05:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:00.971 17:05:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:00.971 17:05:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:00.971 17:05:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:00.971 17:05:12 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:23:00.971 17:05:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:00.971 17:05:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:00.971 17:05:12 -- common/autotest_common.sh@10 -- # set +x 00:23:00.971 17:05:12 -- nvmf/common.sh@469 -- # nvmfpid=272479 00:23:00.971 17:05:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:23:00.971 17:05:12 -- nvmf/common.sh@470 -- # waitforlisten 272479 00:23:00.971 17:05:12 -- common/autotest_common.sh@829 -- # '[' -z 272479 ']' 00:23:00.971 17:05:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:00.971 17:05:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:00.971 17:05:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:00.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:00.971 17:05:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:00.971 17:05:12 -- common/autotest_common.sh@10 -- # set +x 00:23:00.971 [2024-11-29 17:05:12.095604] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:00.971 [2024-11-29 17:05:12.095678] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:00.971 EAL: No free 2048 kB hugepages reported on node 1 00:23:00.971 [2024-11-29 17:05:12.168880] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:00.971 [2024-11-29 17:05:12.284296] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:00.971 [2024-11-29 17:05:12.284460] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:00.971 [2024-11-29 17:05:12.284479] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:00.971 [2024-11-29 17:05:12.284494] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:00.971 [2024-11-29 17:05:12.284594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:00.971 [2024-11-29 17:05:12.284694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:00.971 [2024-11-29 17:05:12.284745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:23:00.971 [2024-11-29 17:05:12.284748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:01.906 17:05:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:01.906 17:05:13 -- common/autotest_common.sh@862 -- # return 0 00:23:01.906 17:05:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:01.906 17:05:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:01.906 17:05:13 -- common/autotest_common.sh@10 -- # set +x 00:23:01.906 17:05:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:01.906 17:05:13 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:01.906 17:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.906 17:05:13 -- common/autotest_common.sh@10 -- # set +x 00:23:01.906 [2024-11-29 17:05:13.086465] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:01.906 17:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.906 17:05:13 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:23:01.906 17:05:13 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:23:01.906 17:05:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:01.906 17:05:13 -- common/autotest_common.sh@10 -- # set +x 00:23:01.906 17:05:13 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:01.906 17:05:13 -- target/shutdown.sh@28 -- # cat 00:23:01.906 17:05:13 -- target/shutdown.sh@35 -- # rpc_cmd 00:23:01.906 17:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.906 17:05:13 -- common/autotest_common.sh@10 -- # set +x 00:23:01.906 Malloc1 00:23:01.906 [2024-11-29 17:05:13.161534] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:01.906 Malloc2 00:23:01.906 Malloc3 00:23:01.906 Malloc4 00:23:01.906 Malloc5 00:23:02.164 Malloc6 00:23:02.164 Malloc7 00:23:02.164 Malloc8 00:23:02.164 Malloc9 00:23:02.164 Malloc10 00:23:02.164 17:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.164 17:05:13 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:23:02.164 17:05:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:02.164 17:05:13 -- common/autotest_common.sh@10 -- # set +x 00:23:02.422 17:05:13 -- target/shutdown.sh@124 -- # perfpid=272782 00:23:02.422 17:05:13 -- target/shutdown.sh@125 -- # waitforlisten 272782 /var/tmp/bdevperf.sock 00:23:02.422 17:05:13 -- common/autotest_common.sh@829 -- # '[' -z 272782 ']' 00:23:02.422 17:05:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:02.422 17:05:13 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:23:02.422 17:05:13 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:23:02.422 17:05:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:02.422 17:05:13 -- nvmf/common.sh@520 -- # config=() 00:23:02.422 17:05:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:02.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:02.422 17:05:13 -- nvmf/common.sh@520 -- # local subsystem config 00:23:02.422 17:05:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:02.422 17:05:13 -- common/autotest_common.sh@10 -- # set +x 00:23:02.422 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.422 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.422 { 00:23:02.422 "params": { 00:23:02.422 "name": "Nvme$subsystem", 00:23:02.422 "trtype": "$TEST_TRANSPORT", 00:23:02.422 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.422 "adrfam": "ipv4", 00:23:02.422 "trsvcid": "$NVMF_PORT", 00:23:02.422 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.422 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.422 "hdgst": ${hdgst:-false}, 00:23:02.422 "ddgst": ${ddgst:-false} 00:23:02.422 }, 00:23:02.422 "method": "bdev_nvme_attach_controller" 00:23:02.422 } 00:23:02.422 EOF 00:23:02.422 )") 00:23:02.422 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.422 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.422 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.422 { 00:23:02.422 "params": { 00:23:02.422 "name": "Nvme$subsystem", 00:23:02.422 "trtype": "$TEST_TRANSPORT", 00:23:02.422 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.422 "adrfam": "ipv4", 00:23:02.422 "trsvcid": "$NVMF_PORT", 00:23:02.422 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.422 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.422 "hdgst": ${hdgst:-false}, 00:23:02.422 "ddgst": ${ddgst:-false} 00:23:02.422 }, 00:23:02.422 "method": "bdev_nvme_attach_controller" 00:23:02.422 } 00:23:02.422 EOF 00:23:02.422 )") 00:23:02.422 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.422 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.422 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.422 { 00:23:02.422 "params": { 00:23:02.422 "name": "Nvme$subsystem", 00:23:02.422 "trtype": "$TEST_TRANSPORT", 00:23:02.422 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.422 "adrfam": "ipv4", 00:23:02.422 "trsvcid": "$NVMF_PORT", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.423 "hdgst": ${hdgst:-false}, 00:23:02.423 "ddgst": ${ddgst:-false} 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 } 00:23:02.423 EOF 00:23:02.423 )") 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.423 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.423 { 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme$subsystem", 00:23:02.423 "trtype": "$TEST_TRANSPORT", 00:23:02.423 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "$NVMF_PORT", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.423 "hdgst": ${hdgst:-false}, 00:23:02.423 "ddgst": ${ddgst:-false} 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 } 00:23:02.423 EOF 00:23:02.423 )") 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.423 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.423 { 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme$subsystem", 00:23:02.423 "trtype": "$TEST_TRANSPORT", 00:23:02.423 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "$NVMF_PORT", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.423 "hdgst": ${hdgst:-false}, 00:23:02.423 "ddgst": ${ddgst:-false} 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 } 00:23:02.423 EOF 00:23:02.423 )") 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.423 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.423 { 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme$subsystem", 00:23:02.423 "trtype": "$TEST_TRANSPORT", 00:23:02.423 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "$NVMF_PORT", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.423 "hdgst": ${hdgst:-false}, 00:23:02.423 "ddgst": ${ddgst:-false} 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 } 00:23:02.423 EOF 00:23:02.423 )") 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.423 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.423 { 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme$subsystem", 00:23:02.423 "trtype": "$TEST_TRANSPORT", 00:23:02.423 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "$NVMF_PORT", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.423 "hdgst": ${hdgst:-false}, 00:23:02.423 "ddgst": ${ddgst:-false} 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 } 00:23:02.423 EOF 00:23:02.423 )") 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.423 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.423 { 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme$subsystem", 00:23:02.423 "trtype": "$TEST_TRANSPORT", 00:23:02.423 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "$NVMF_PORT", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.423 "hdgst": ${hdgst:-false}, 00:23:02.423 "ddgst": ${ddgst:-false} 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 } 00:23:02.423 EOF 00:23:02.423 )") 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.423 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.423 { 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme$subsystem", 00:23:02.423 "trtype": "$TEST_TRANSPORT", 00:23:02.423 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "$NVMF_PORT", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.423 "hdgst": ${hdgst:-false}, 00:23:02.423 "ddgst": ${ddgst:-false} 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 } 00:23:02.423 EOF 00:23:02.423 )") 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.423 17:05:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:02.423 { 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme$subsystem", 00:23:02.423 "trtype": "$TEST_TRANSPORT", 00:23:02.423 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "$NVMF_PORT", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:02.423 "hdgst": ${hdgst:-false}, 00:23:02.423 "ddgst": ${ddgst:-false} 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 } 00:23:02.423 EOF 00:23:02.423 )") 00:23:02.423 17:05:13 -- nvmf/common.sh@542 -- # cat 00:23:02.423 17:05:13 -- nvmf/common.sh@544 -- # jq . 00:23:02.423 17:05:13 -- nvmf/common.sh@545 -- # IFS=, 00:23:02.423 17:05:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme1", 00:23:02.423 "trtype": "tcp", 00:23:02.423 "traddr": "10.0.0.2", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "4420", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:23:02.423 "hdgst": false, 00:23:02.423 "ddgst": false 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 },{ 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme2", 00:23:02.423 "trtype": "tcp", 00:23:02.423 "traddr": "10.0.0.2", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "4420", 00:23:02.423 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:02.423 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:23:02.423 "hdgst": false, 00:23:02.423 "ddgst": false 00:23:02.423 }, 00:23:02.423 "method": "bdev_nvme_attach_controller" 00:23:02.423 },{ 00:23:02.423 "params": { 00:23:02.423 "name": "Nvme3", 00:23:02.423 "trtype": "tcp", 00:23:02.423 "traddr": "10.0.0.2", 00:23:02.423 "adrfam": "ipv4", 00:23:02.423 "trsvcid": "4420", 00:23:02.424 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:23:02.424 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:23:02.424 "hdgst": false, 00:23:02.424 "ddgst": false 00:23:02.424 }, 00:23:02.424 "method": "bdev_nvme_attach_controller" 00:23:02.424 },{ 00:23:02.424 "params": { 00:23:02.424 "name": "Nvme4", 00:23:02.424 "trtype": "tcp", 00:23:02.424 "traddr": "10.0.0.2", 00:23:02.424 "adrfam": "ipv4", 00:23:02.424 "trsvcid": "4420", 00:23:02.424 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:23:02.424 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:23:02.424 "hdgst": false, 00:23:02.424 "ddgst": false 00:23:02.424 }, 00:23:02.424 "method": "bdev_nvme_attach_controller" 00:23:02.424 },{ 00:23:02.424 "params": { 00:23:02.424 "name": "Nvme5", 00:23:02.424 "trtype": "tcp", 00:23:02.424 "traddr": "10.0.0.2", 00:23:02.424 "adrfam": "ipv4", 00:23:02.424 "trsvcid": "4420", 00:23:02.424 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:23:02.424 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:23:02.424 "hdgst": false, 00:23:02.424 "ddgst": false 00:23:02.424 }, 00:23:02.424 "method": "bdev_nvme_attach_controller" 00:23:02.424 },{ 00:23:02.424 "params": { 00:23:02.424 "name": "Nvme6", 00:23:02.424 "trtype": "tcp", 00:23:02.424 "traddr": "10.0.0.2", 00:23:02.424 "adrfam": "ipv4", 00:23:02.424 "trsvcid": "4420", 00:23:02.424 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:23:02.424 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:23:02.424 "hdgst": false, 00:23:02.424 "ddgst": false 00:23:02.424 }, 00:23:02.424 "method": "bdev_nvme_attach_controller" 00:23:02.424 },{ 00:23:02.424 "params": { 00:23:02.424 "name": "Nvme7", 00:23:02.424 "trtype": "tcp", 00:23:02.424 "traddr": "10.0.0.2", 00:23:02.424 "adrfam": "ipv4", 00:23:02.424 "trsvcid": "4420", 00:23:02.424 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:23:02.424 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:23:02.424 "hdgst": false, 00:23:02.424 "ddgst": false 00:23:02.424 }, 00:23:02.424 "method": "bdev_nvme_attach_controller" 00:23:02.424 },{ 00:23:02.424 "params": { 00:23:02.424 "name": "Nvme8", 00:23:02.424 "trtype": "tcp", 00:23:02.424 "traddr": "10.0.0.2", 00:23:02.424 "adrfam": "ipv4", 00:23:02.424 "trsvcid": "4420", 00:23:02.424 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:23:02.424 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:23:02.424 "hdgst": false, 00:23:02.424 "ddgst": false 00:23:02.424 }, 00:23:02.424 "method": "bdev_nvme_attach_controller" 00:23:02.424 },{ 00:23:02.424 "params": { 00:23:02.424 "name": "Nvme9", 00:23:02.424 "trtype": "tcp", 00:23:02.424 "traddr": "10.0.0.2", 00:23:02.424 "adrfam": "ipv4", 00:23:02.424 "trsvcid": "4420", 00:23:02.424 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:23:02.424 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:23:02.424 "hdgst": false, 00:23:02.424 "ddgst": false 00:23:02.424 }, 00:23:02.424 "method": "bdev_nvme_attach_controller" 00:23:02.424 },{ 00:23:02.424 "params": { 00:23:02.424 "name": "Nvme10", 00:23:02.424 "trtype": "tcp", 00:23:02.424 "traddr": "10.0.0.2", 00:23:02.424 "adrfam": "ipv4", 00:23:02.424 "trsvcid": "4420", 00:23:02.424 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:23:02.424 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:23:02.424 "hdgst": false, 00:23:02.424 "ddgst": false 00:23:02.424 }, 00:23:02.424 "method": "bdev_nvme_attach_controller" 00:23:02.424 }' 00:23:02.424 [2024-11-29 17:05:13.649008] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:02.424 [2024-11-29 17:05:13.649087] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid272782 ] 00:23:02.424 EAL: No free 2048 kB hugepages reported on node 1 00:23:02.424 [2024-11-29 17:05:13.710930] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:02.424 [2024-11-29 17:05:13.818763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:04.330 Running I/O for 10 seconds... 00:23:04.330 17:05:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:04.330 17:05:15 -- common/autotest_common.sh@862 -- # return 0 00:23:04.330 17:05:15 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:23:04.330 17:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.330 17:05:15 -- common/autotest_common.sh@10 -- # set +x 00:23:04.330 17:05:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.330 17:05:15 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:04.330 17:05:15 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:23:04.330 17:05:15 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:23:04.330 17:05:15 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:23:04.330 17:05:15 -- target/shutdown.sh@57 -- # local ret=1 00:23:04.330 17:05:15 -- target/shutdown.sh@58 -- # local i 00:23:04.330 17:05:15 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:23:04.330 17:05:15 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:23:04.330 17:05:15 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:23:04.330 17:05:15 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:23:04.330 17:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.330 17:05:15 -- common/autotest_common.sh@10 -- # set +x 00:23:04.330 17:05:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.330 17:05:15 -- target/shutdown.sh@60 -- # read_io_count=3 00:23:04.330 17:05:15 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:23:04.330 17:05:15 -- target/shutdown.sh@67 -- # sleep 0.25 00:23:04.604 17:05:15 -- target/shutdown.sh@59 -- # (( i-- )) 00:23:04.604 17:05:15 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:23:04.604 17:05:15 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:23:04.604 17:05:15 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:23:04.604 17:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.604 17:05:15 -- common/autotest_common.sh@10 -- # set +x 00:23:04.604 17:05:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.604 17:05:15 -- target/shutdown.sh@60 -- # read_io_count=129 00:23:04.604 17:05:15 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:23:04.604 17:05:15 -- target/shutdown.sh@64 -- # ret=0 00:23:04.604 17:05:15 -- target/shutdown.sh@65 -- # break 00:23:04.604 17:05:15 -- target/shutdown.sh@69 -- # return 0 00:23:04.604 17:05:15 -- target/shutdown.sh@134 -- # killprocess 272479 00:23:04.604 17:05:15 -- common/autotest_common.sh@936 -- # '[' -z 272479 ']' 00:23:04.604 17:05:15 -- common/autotest_common.sh@940 -- # kill -0 272479 00:23:04.604 17:05:15 -- common/autotest_common.sh@941 -- # uname 00:23:04.604 17:05:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:04.604 17:05:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 272479 00:23:04.604 17:05:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:23:04.604 17:05:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:23:04.604 17:05:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 272479' 00:23:04.604 killing process with pid 272479 00:23:04.604 17:05:15 -- common/autotest_common.sh@955 -- # kill 272479 00:23:04.604 17:05:15 -- common/autotest_common.sh@960 -- # wait 272479 00:23:04.604 [2024-11-29 17:05:15.871635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.871997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.604 [2024-11-29 17:05:15.872517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.872534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.872547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.872559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.872572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.872584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b92e0 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.873997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.874401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bbc90 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.879953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.879990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.605 [2024-11-29 17:05:15.880181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.880740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9790 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.885999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.606 [2024-11-29 17:05:15.886223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.886462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b9c40 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.888160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baa10 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.888187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baa10 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.888999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.889791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19baec0 is same with the state(5) to be set 00:23:04.607 [2024-11-29 17:05:15.890794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.890997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.891614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb350 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.608 [2024-11-29 17:05:15.892474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.892995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.893143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bb7e0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.896057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896128] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896156] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896196] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26b2150 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.896287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896323] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896377] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26aca60 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.896451] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896487] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896514] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896541] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x269d0a0 is same with the state(5) to be set 00:23:04.609 [2024-11-29 17:05:15.896613] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.609 [2024-11-29 17:05:15.896634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.609 [2024-11-29 17:05:15.896660] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.896678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.896692] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.896711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.896726] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.896739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.896752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2527690 is same with the state(5) to be set 00:23:04.610 [2024-11-29 17:05:15.896802] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.896823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.896838] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.896851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.896865] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.896878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.896892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.896904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.896917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24fbf70 is same with the state(5) to be set 00:23:04.610 [2024-11-29 17:05:15.896971] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.896992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897010] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897037] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897063] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26c2600 is same with the state(5) to be set 00:23:04.610 [2024-11-29 17:05:15.897142] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897189] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x251e1b0 is same with the state(5) to be set 00:23:04.610 [2024-11-29 17:05:15.897326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897361] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2554590 is same with the state(5) to be set 00:23:04.610 [2024-11-29 17:05:15.897488] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897523] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897550] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897577] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26b1c70 is same with the state(5) to be set 00:23:04.610 [2024-11-29 17:05:15.897649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897688] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897717] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:04.610 [2024-11-29 17:05:15.897756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.897768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2549490 is same with the state(5) to be set 00:23:04.610 [2024-11-29 17:05:15.898587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.610 [2024-11-29 17:05:15.898899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.610 [2024-11-29 17:05:15.898915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.898929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.898945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.898966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.898984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.898999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.899970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.899988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.900002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.900017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.900035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.900052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.900066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.900082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.611 [2024-11-29 17:05:15.900095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.611 [2024-11-29 17:05:15.900112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26896f0 is same with the state(5) to be set 00:23:04.612 [2024-11-29 17:05:15.900661] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x26896f0 was disconnected and freed. reset controller. 00:23:04.612 [2024-11-29 17:05:15.900728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.900966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.900983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.612 [2024-11-29 17:05:15.901465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.612 [2024-11-29 17:05:15.901480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.901979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.901996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.613 [2024-11-29 17:05:15.902492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.613 [2024-11-29 17:05:15.902507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.902521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.902537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.902551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.902567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.902580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.902596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.902610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.902626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.902639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.902655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.902669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.902683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x274b950 is same with the state(5) to be set 00:23:04.614 [2024-11-29 17:05:15.902760] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x274b950 was disconnected and freed. reset controller. 00:23:04.614 [2024-11-29 17:05:15.910554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26b2150 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.910644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26aca60 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.910670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x269d0a0 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.910699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2527690 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.910724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24fbf70 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.910752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26c2600 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.910780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x251e1b0 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.910810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2554590 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.910834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26b1c70 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.910873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2549490 (9): Bad file descriptor 00:23:04.614 [2024-11-29 17:05:15.911421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.911971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.911989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.614 [2024-11-29 17:05:15.912301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.614 [2024-11-29 17:05:15.912316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.912965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.912988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.913393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.913522] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x26881a0 was disconnected and freed. reset controller. 00:23:04.615 [2024-11-29 17:05:15.915821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.915848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.915871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.915887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.915903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.915917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.615 [2024-11-29 17:05:15.915934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.615 [2024-11-29 17:05:15.915947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.915971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.915986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.916980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.916996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.917013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.917027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.917043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.917057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.917073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.917087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.917104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.917118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.917134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.917148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.616 [2024-11-29 17:05:15.917164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.616 [2024-11-29 17:05:15.917178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.917789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.917804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x274ce00 is same with the state(5) to be set 00:23:04.617 [2024-11-29 17:05:15.917887] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x274ce00 was disconnected and freed. reset controller. 00:23:04.617 [2024-11-29 17:05:15.918301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.617 [2024-11-29 17:05:15.918726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.617 [2024-11-29 17:05:15.918741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.918755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.918771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.918784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.918800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.918814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.918830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.918845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.918861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.918875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.918891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.918906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.918921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.918939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.918955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.918979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.918996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.618 [2024-11-29 17:05:15.919943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.618 [2024-11-29 17:05:15.919964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.919979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.919995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920358] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2740260 was disconnected and freed. reset controller. 00:23:04.619 [2024-11-29 17:05:15.920414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.920975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.920997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.619 [2024-11-29 17:05:15.921334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.619 [2024-11-29 17:05:15.921348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.921969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.921997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.922419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.922515] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x24ec550 was disconnected and freed. reset controller. 00:23:04.620 [2024-11-29 17:05:15.925994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:23:04.620 [2024-11-29 17:05:15.926039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:23:04.620 [2024-11-29 17:05:15.926120] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.620 [2024-11-29 17:05:15.926149] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.620 [2024-11-29 17:05:15.926169] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.620 [2024-11-29 17:05:15.926196] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.620 [2024-11-29 17:05:15.929151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.929183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.929212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.620 [2024-11-29 17:05:15.929229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.620 [2024-11-29 17:05:15.929268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.929969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.929992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.930009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.930029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.930046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.930066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.930082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.930103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.930119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.930139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.930156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.930176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.930192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.931024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x274e3e0 is same with the state(5) to be set 00:23:04.621 [2024-11-29 17:05:15.931126] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x274e3e0 was disconnected and freed. reset controller. 00:23:04.621 [2024-11-29 17:05:15.931144] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.621 [2024-11-29 17:05:15.931211] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:04.621 [2024-11-29 17:05:15.931292] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:04.621 [2024-11-29 17:05:15.931368] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:04.621 [2024-11-29 17:05:15.931399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:23:04.621 [2024-11-29 17:05:15.931450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:23:04.621 [2024-11-29 17:05:15.931630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.621 [2024-11-29 17:05:15.931735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.621 [2024-11-29 17:05:15.931761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2527690 with addr=10.0.0.2, port=4420 00:23:04.621 [2024-11-29 17:05:15.931777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2527690 is same with the state(5) to be set 00:23:04.621 [2024-11-29 17:05:15.931858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.621 [2024-11-29 17:05:15.931943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.621 [2024-11-29 17:05:15.931975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x26b2150 with addr=10.0.0.2, port=4420 00:23:04.621 [2024-11-29 17:05:15.931992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26b2150 is same with the state(5) to be set 00:23:04.621 [2024-11-29 17:05:15.932647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.932672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.932696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.932712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.932730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.932744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.932760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.932774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.621 [2024-11-29 17:05:15.932790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.621 [2024-11-29 17:05:15.932804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.932820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.932834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.932849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.932869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.932885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.932899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.932915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.932929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.932945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.932971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.932990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.933967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.933984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.622 [2024-11-29 17:05:15.934001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.622 [2024-11-29 17:05:15.934015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.934650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.934665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x274f9c0 is same with the state(5) to be set 00:23:04.623 [2024-11-29 17:05:15.935901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.935925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.935946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.935970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.935988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.623 [2024-11-29 17:05:15.936453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.623 [2024-11-29 17:05:15.936468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.936978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.936993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.624 [2024-11-29 17:05:15.937680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.624 [2024-11-29 17:05:15.937694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.937710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.937724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.937740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.937754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.937770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.937785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.937801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.937815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.937832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.937846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.937863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.937877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.937891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2751000 is same with the state(5) to be set 00:23:04.625 [2024-11-29 17:05:15.940271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.940945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.940996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.625 [2024-11-29 17:05:15.941316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.625 [2024-11-29 17:05:15.941330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.941983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.941997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.942026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.942058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.942087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.942117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.942145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.942175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.942205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.942235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:04.626 [2024-11-29 17:05:15.942264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:04.626 [2024-11-29 17:05:15.942279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2752610 is same with the state(5) to be set 00:23:04.626 [2024-11-29 17:05:15.944605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:23:04.626 [2024-11-29 17:05:15.944646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:23:04.626 [2024-11-29 17:05:15.944666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:23:04.626 [2024-11-29 17:05:15.944685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:23:04.626 [2024-11-29 17:05:15.944908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.626 [2024-11-29 17:05:15.945017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.626 [2024-11-29 17:05:15.945043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x251e1b0 with addr=10.0.0.2, port=4420 00:23:04.626 [2024-11-29 17:05:15.945060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x251e1b0 is same with the state(5) to be set 00:23:04.626 [2024-11-29 17:05:15.945147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.626 [2024-11-29 17:05:15.945232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.945256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x24fbf70 with addr=10.0.0.2, port=4420 00:23:04.627 [2024-11-29 17:05:15.945272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24fbf70 is same with the state(5) to be set 00:23:04.627 [2024-11-29 17:05:15.945298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2527690 (9): Bad file descriptor 00:23:04.627 [2024-11-29 17:05:15.945319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26b2150 (9): Bad file descriptor 00:23:04.627 [2024-11-29 17:05:15.945386] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.627 [2024-11-29 17:05:15.945413] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.627 [2024-11-29 17:05:15.945432] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.627 [2024-11-29 17:05:15.945452] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.627 [2024-11-29 17:05:15.945472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24fbf70 (9): Bad file descriptor 00:23:04.627 [2024-11-29 17:05:15.945497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x251e1b0 (9): Bad file descriptor 00:23:04.627 [2024-11-29 17:05:15.946434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:23:04.627 task offset: 24320 on job bdev=Nvme4n1 fails 00:23:04.627 00:23:04.627 Latency(us) 00:23:04.627 [2024-11-29T16:05:16.058Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme1n1 ended in about 0.52 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme1n1 : 0.52 318.13 19.88 124.15 0.00 143378.63 59807.67 123498.95 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme2n1 ended in about 0.52 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme2n1 : 0.52 317.46 19.84 123.89 0.00 141573.09 53593.88 122722.23 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme3n1 ended in about 0.51 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme3n1 : 0.51 320.41 20.03 125.04 0.00 138118.29 24272.59 134373.07 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme4n1 ended in about 0.50 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme4n1 : 0.50 326.13 20.38 127.27 0.00 133454.12 25437.68 120392.06 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme5n1 ended in about 0.50 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme5n1 : 0.50 325.41 20.34 126.99 0.00 131663.27 19320.98 121945.51 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme6n1 ended in about 0.51 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme6n1 : 0.51 319.70 19.98 124.76 0.00 132053.12 13981.01 122722.23 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme7n1 ended in about 0.52 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme7n1 : 0.52 313.96 19.62 52.01 0.00 157114.06 4271.98 131266.18 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme8n1 ended in about 0.52 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme8n1 : 0.52 240.49 15.03 122.15 0.00 157061.56 100197.26 128936.01 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme9n1 ended in about 0.53 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme9n1 : 0.53 239.03 14.94 121.41 0.00 155618.49 107187.77 128159.29 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:04.627 [2024-11-29T16:05:16.058Z] Job: Nvme10n1 ended in about 0.53 seconds with error 00:23:04.627 Verification LBA range: start 0x0 length 0x400 00:23:04.627 Nvme10n1 : 0.53 237.06 14.82 120.41 0.00 154657.81 100197.26 128936.01 00:23:04.627 [2024-11-29T16:05:16.058Z] =================================================================================================================== 00:23:04.627 [2024-11-29T16:05:16.058Z] Total : 2957.80 184.86 1168.08 0.00 143637.55 4271.98 134373.07 00:23:04.627 [2024-11-29 17:05:15.975560] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:23:04.627 [2024-11-29 17:05:15.975651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:23:04.627 [2024-11-29 17:05:15.975919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.976053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.976081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x26c2600 with addr=10.0.0.2, port=4420 00:23:04.627 [2024-11-29 17:05:15.976103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26c2600 is same with the state(5) to be set 00:23:04.627 [2024-11-29 17:05:15.976184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.976278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.976304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x269d0a0 with addr=10.0.0.2, port=4420 00:23:04.627 [2024-11-29 17:05:15.976321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x269d0a0 is same with the state(5) to be set 00:23:04.627 [2024-11-29 17:05:15.976406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.976488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.976514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x26aca60 with addr=10.0.0.2, port=4420 00:23:04.627 [2024-11-29 17:05:15.976530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26aca60 is same with the state(5) to be set 00:23:04.627 [2024-11-29 17:05:15.976609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.976689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.976714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x26b1c70 with addr=10.0.0.2, port=4420 00:23:04.627 [2024-11-29 17:05:15.976749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26b1c70 is same with the state(5) to be set 00:23:04.627 [2024-11-29 17:05:15.976771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:23:04.627 [2024-11-29 17:05:15.976785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:23:04.627 [2024-11-29 17:05:15.976803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:23:04.627 [2024-11-29 17:05:15.976834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:23:04.627 [2024-11-29 17:05:15.976849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:23:04.627 [2024-11-29 17:05:15.976862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:23:04.627 [2024-11-29 17:05:15.977823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.627 [2024-11-29 17:05:15.977849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.627 [2024-11-29 17:05:15.977971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.978060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.978086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2549490 with addr=10.0.0.2, port=4420 00:23:04.627 [2024-11-29 17:05:15.978102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2549490 is same with the state(5) to be set 00:23:04.627 [2024-11-29 17:05:15.978176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.978262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.627 [2024-11-29 17:05:15.978287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2554590 with addr=10.0.0.2, port=4420 00:23:04.627 [2024-11-29 17:05:15.978303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2554590 is same with the state(5) to be set 00:23:04.627 [2024-11-29 17:05:15.978329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26c2600 (9): Bad file descriptor 00:23:04.627 [2024-11-29 17:05:15.978353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x269d0a0 (9): Bad file descriptor 00:23:04.627 [2024-11-29 17:05:15.978371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26aca60 (9): Bad file descriptor 00:23:04.627 [2024-11-29 17:05:15.978388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26b1c70 (9): Bad file descriptor 00:23:04.627 [2024-11-29 17:05:15.978404] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:23:04.627 [2024-11-29 17:05:15.978416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:23:04.627 [2024-11-29 17:05:15.978429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:23:04.627 [2024-11-29 17:05:15.978448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:23:04.627 [2024-11-29 17:05:15.978462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:23:04.627 [2024-11-29 17:05:15.978475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:23:04.627 [2024-11-29 17:05:15.978545] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.627 [2024-11-29 17:05:15.978573] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.628 [2024-11-29 17:05:15.978593] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.628 [2024-11-29 17:05:15.978610] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.628 [2024-11-29 17:05:15.978634] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.628 [2024-11-29 17:05:15.978653] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:04.628 [2024-11-29 17:05:15.978748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.628 [2024-11-29 17:05:15.978769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.628 [2024-11-29 17:05:15.978794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2549490 (9): Bad file descriptor 00:23:04.628 [2024-11-29 17:05:15.978815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2554590 (9): Bad file descriptor 00:23:04.628 [2024-11-29 17:05:15.978831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:23:04.628 [2024-11-29 17:05:15.978844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:23:04.628 [2024-11-29 17:05:15.978857] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:23:04.628 [2024-11-29 17:05:15.978873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:23:04.628 [2024-11-29 17:05:15.978887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:23:04.628 [2024-11-29 17:05:15.978900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:23:04.628 [2024-11-29 17:05:15.978916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:23:04.628 [2024-11-29 17:05:15.978930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:23:04.628 [2024-11-29 17:05:15.978942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:23:04.628 [2024-11-29 17:05:15.978968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:23:04.628 [2024-11-29 17:05:15.978984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:23:04.628 [2024-11-29 17:05:15.978997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:23:04.628 [2024-11-29 17:05:15.979064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:23:04.628 [2024-11-29 17:05:15.979087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:23:04.628 [2024-11-29 17:05:15.979103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.628 [2024-11-29 17:05:15.979117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.628 [2024-11-29 17:05:15.979128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.628 [2024-11-29 17:05:15.979139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.628 [2024-11-29 17:05:15.979165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:23:04.628 [2024-11-29 17:05:15.979180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:23:04.628 [2024-11-29 17:05:15.979193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:23:04.628 [2024-11-29 17:05:15.979208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:23:04.628 [2024-11-29 17:05:15.979221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:23:04.628 [2024-11-29 17:05:15.979234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:23:04.628 [2024-11-29 17:05:15.979282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.628 [2024-11-29 17:05:15.979300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.628 [2024-11-29 17:05:15.979382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.628 [2024-11-29 17:05:15.979464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.628 [2024-11-29 17:05:15.979488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x26b2150 with addr=10.0.0.2, port=4420 00:23:04.628 [2024-11-29 17:05:15.979504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26b2150 is same with the state(5) to be set 00:23:04.628 [2024-11-29 17:05:15.979575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.628 [2024-11-29 17:05:15.979651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:04.628 [2024-11-29 17:05:15.979675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2527690 with addr=10.0.0.2, port=4420 00:23:04.628 [2024-11-29 17:05:15.979691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2527690 is same with the state(5) to be set 00:23:04.628 [2024-11-29 17:05:15.979733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26b2150 (9): Bad file descriptor 00:23:04.628 [2024-11-29 17:05:15.979756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2527690 (9): Bad file descriptor 00:23:04.628 [2024-11-29 17:05:15.979798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:23:04.628 [2024-11-29 17:05:15.979817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:23:04.628 [2024-11-29 17:05:15.979830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:23:04.628 [2024-11-29 17:05:15.979847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:23:04.628 [2024-11-29 17:05:15.979861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:23:04.628 [2024-11-29 17:05:15.979873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:23:04.628 [2024-11-29 17:05:15.979908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:04.628 [2024-11-29 17:05:15.979925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:05.194 17:05:16 -- target/shutdown.sh@135 -- # nvmfpid= 00:23:05.194 17:05:16 -- target/shutdown.sh@138 -- # sleep 1 00:23:06.130 17:05:17 -- target/shutdown.sh@141 -- # kill -9 272782 00:23:06.130 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (272782) - No such process 00:23:06.130 17:05:17 -- target/shutdown.sh@141 -- # true 00:23:06.130 17:05:17 -- target/shutdown.sh@143 -- # stoptarget 00:23:06.130 17:05:17 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:23:06.130 17:05:17 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:23:06.130 17:05:17 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:23:06.130 17:05:17 -- target/shutdown.sh@45 -- # nvmftestfini 00:23:06.130 17:05:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:06.130 17:05:17 -- nvmf/common.sh@116 -- # sync 00:23:06.130 17:05:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:06.130 17:05:17 -- nvmf/common.sh@119 -- # set +e 00:23:06.130 17:05:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:06.130 17:05:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:06.130 rmmod nvme_tcp 00:23:06.130 rmmod nvme_fabrics 00:23:06.130 rmmod nvme_keyring 00:23:06.130 17:05:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:06.130 17:05:17 -- nvmf/common.sh@123 -- # set -e 00:23:06.130 17:05:17 -- nvmf/common.sh@124 -- # return 0 00:23:06.130 17:05:17 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:23:06.130 17:05:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:06.130 17:05:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:06.130 17:05:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:06.130 17:05:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:06.130 17:05:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:06.130 17:05:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:06.130 17:05:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:06.130 17:05:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:08.663 17:05:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:08.663 00:23:08.663 real 0m7.719s 00:23:08.663 user 0m19.357s 00:23:08.663 sys 0m1.302s 00:23:08.663 17:05:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:08.663 17:05:19 -- common/autotest_common.sh@10 -- # set +x 00:23:08.663 ************************************ 00:23:08.663 END TEST nvmf_shutdown_tc3 00:23:08.663 ************************************ 00:23:08.663 17:05:19 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:23:08.663 00:23:08.663 real 0m27.838s 00:23:08.663 user 1m17.646s 00:23:08.663 sys 0m6.149s 00:23:08.663 17:05:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:08.663 17:05:19 -- common/autotest_common.sh@10 -- # set +x 00:23:08.663 ************************************ 00:23:08.663 END TEST nvmf_shutdown 00:23:08.663 ************************************ 00:23:08.663 17:05:19 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:23:08.663 17:05:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:08.663 17:05:19 -- common/autotest_common.sh@10 -- # set +x 00:23:08.663 17:05:19 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:23:08.663 17:05:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:08.663 17:05:19 -- common/autotest_common.sh@10 -- # set +x 00:23:08.663 17:05:19 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:23:08.663 17:05:19 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:08.663 17:05:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:08.663 17:05:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:08.663 17:05:19 -- common/autotest_common.sh@10 -- # set +x 00:23:08.663 ************************************ 00:23:08.663 START TEST nvmf_multicontroller 00:23:08.663 ************************************ 00:23:08.663 17:05:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:08.663 * Looking for test storage... 00:23:08.663 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:08.663 17:05:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:08.663 17:05:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:08.663 17:05:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:08.663 17:05:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:08.663 17:05:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:08.663 17:05:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:08.663 17:05:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:08.663 17:05:19 -- scripts/common.sh@335 -- # IFS=.-: 00:23:08.663 17:05:19 -- scripts/common.sh@335 -- # read -ra ver1 00:23:08.663 17:05:19 -- scripts/common.sh@336 -- # IFS=.-: 00:23:08.663 17:05:19 -- scripts/common.sh@336 -- # read -ra ver2 00:23:08.663 17:05:19 -- scripts/common.sh@337 -- # local 'op=<' 00:23:08.663 17:05:19 -- scripts/common.sh@339 -- # ver1_l=2 00:23:08.663 17:05:19 -- scripts/common.sh@340 -- # ver2_l=1 00:23:08.663 17:05:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:08.663 17:05:19 -- scripts/common.sh@343 -- # case "$op" in 00:23:08.663 17:05:19 -- scripts/common.sh@344 -- # : 1 00:23:08.663 17:05:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:08.663 17:05:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:08.663 17:05:19 -- scripts/common.sh@364 -- # decimal 1 00:23:08.663 17:05:19 -- scripts/common.sh@352 -- # local d=1 00:23:08.663 17:05:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:08.663 17:05:19 -- scripts/common.sh@354 -- # echo 1 00:23:08.663 17:05:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:08.663 17:05:19 -- scripts/common.sh@365 -- # decimal 2 00:23:08.663 17:05:19 -- scripts/common.sh@352 -- # local d=2 00:23:08.663 17:05:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:08.663 17:05:19 -- scripts/common.sh@354 -- # echo 2 00:23:08.663 17:05:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:08.663 17:05:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:08.663 17:05:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:08.663 17:05:19 -- scripts/common.sh@367 -- # return 0 00:23:08.663 17:05:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:08.663 17:05:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:08.663 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.663 --rc genhtml_branch_coverage=1 00:23:08.663 --rc genhtml_function_coverage=1 00:23:08.663 --rc genhtml_legend=1 00:23:08.663 --rc geninfo_all_blocks=1 00:23:08.663 --rc geninfo_unexecuted_blocks=1 00:23:08.663 00:23:08.663 ' 00:23:08.664 17:05:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:08.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.664 --rc genhtml_branch_coverage=1 00:23:08.664 --rc genhtml_function_coverage=1 00:23:08.664 --rc genhtml_legend=1 00:23:08.664 --rc geninfo_all_blocks=1 00:23:08.664 --rc geninfo_unexecuted_blocks=1 00:23:08.664 00:23:08.664 ' 00:23:08.664 17:05:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:08.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.664 --rc genhtml_branch_coverage=1 00:23:08.664 --rc genhtml_function_coverage=1 00:23:08.664 --rc genhtml_legend=1 00:23:08.664 --rc geninfo_all_blocks=1 00:23:08.664 --rc geninfo_unexecuted_blocks=1 00:23:08.664 00:23:08.664 ' 00:23:08.664 17:05:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:08.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.664 --rc genhtml_branch_coverage=1 00:23:08.664 --rc genhtml_function_coverage=1 00:23:08.664 --rc genhtml_legend=1 00:23:08.664 --rc geninfo_all_blocks=1 00:23:08.664 --rc geninfo_unexecuted_blocks=1 00:23:08.664 00:23:08.664 ' 00:23:08.664 17:05:19 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:08.664 17:05:19 -- nvmf/common.sh@7 -- # uname -s 00:23:08.664 17:05:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:08.664 17:05:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:08.664 17:05:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:08.664 17:05:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:08.664 17:05:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:08.664 17:05:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:08.664 17:05:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:08.664 17:05:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:08.664 17:05:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:08.664 17:05:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:08.664 17:05:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.664 17:05:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.664 17:05:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:08.664 17:05:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:08.664 17:05:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:08.664 17:05:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:08.664 17:05:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:08.664 17:05:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:08.664 17:05:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:08.664 17:05:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.664 17:05:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.664 17:05:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.664 17:05:19 -- paths/export.sh@5 -- # export PATH 00:23:08.664 17:05:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.664 17:05:19 -- nvmf/common.sh@46 -- # : 0 00:23:08.664 17:05:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:08.664 17:05:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:08.664 17:05:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:08.664 17:05:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:08.664 17:05:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:08.664 17:05:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:08.664 17:05:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:08.664 17:05:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:08.664 17:05:19 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:08.664 17:05:19 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:08.664 17:05:19 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:23:08.664 17:05:19 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:23:08.664 17:05:19 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:23:08.664 17:05:19 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:23:08.664 17:05:19 -- host/multicontroller.sh@23 -- # nvmftestinit 00:23:08.664 17:05:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:08.664 17:05:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:08.664 17:05:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:08.664 17:05:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:08.664 17:05:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:08.664 17:05:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:08.664 17:05:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:08.664 17:05:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:08.664 17:05:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:08.664 17:05:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:08.664 17:05:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:08.664 17:05:19 -- common/autotest_common.sh@10 -- # set +x 00:23:10.565 17:05:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:10.565 17:05:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:10.565 17:05:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:10.565 17:05:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:10.565 17:05:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:10.565 17:05:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:10.565 17:05:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:10.565 17:05:21 -- nvmf/common.sh@294 -- # net_devs=() 00:23:10.565 17:05:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:10.565 17:05:21 -- nvmf/common.sh@295 -- # e810=() 00:23:10.565 17:05:21 -- nvmf/common.sh@295 -- # local -ga e810 00:23:10.565 17:05:21 -- nvmf/common.sh@296 -- # x722=() 00:23:10.565 17:05:21 -- nvmf/common.sh@296 -- # local -ga x722 00:23:10.565 17:05:21 -- nvmf/common.sh@297 -- # mlx=() 00:23:10.565 17:05:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:10.565 17:05:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:10.565 17:05:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:10.565 17:05:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:10.565 17:05:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:10.565 17:05:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:10.565 17:05:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:10.565 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:10.565 17:05:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:10.565 17:05:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:10.565 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:10.565 17:05:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:10.565 17:05:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:10.565 17:05:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.565 17:05:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:10.565 17:05:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.565 17:05:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:10.565 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:10.565 17:05:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.565 17:05:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:10.565 17:05:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.565 17:05:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:10.565 17:05:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.565 17:05:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:10.565 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:10.565 17:05:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.565 17:05:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:10.565 17:05:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:10.565 17:05:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:10.565 17:05:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:10.565 17:05:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:10.565 17:05:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:10.565 17:05:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:10.565 17:05:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:10.565 17:05:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:10.565 17:05:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:10.565 17:05:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:10.565 17:05:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:10.565 17:05:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:10.565 17:05:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:10.565 17:05:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:10.565 17:05:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:10.565 17:05:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:10.565 17:05:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:10.565 17:05:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:10.565 17:05:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:10.565 17:05:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:10.565 17:05:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:10.565 17:05:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:10.565 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:10.565 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:23:10.565 00:23:10.565 --- 10.0.0.2 ping statistics --- 00:23:10.565 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:10.565 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:23:10.565 17:05:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:10.565 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:10.565 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:23:10.565 00:23:10.565 --- 10.0.0.1 ping statistics --- 00:23:10.565 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:10.565 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:23:10.565 17:05:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:10.565 17:05:21 -- nvmf/common.sh@410 -- # return 0 00:23:10.565 17:05:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:10.565 17:05:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:10.565 17:05:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:10.565 17:05:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:10.565 17:05:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:10.565 17:05:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:10.566 17:05:21 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:23:10.566 17:05:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:10.566 17:05:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:10.566 17:05:21 -- common/autotest_common.sh@10 -- # set +x 00:23:10.823 17:05:21 -- nvmf/common.sh@469 -- # nvmfpid=275215 00:23:10.823 17:05:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:23:10.823 17:05:21 -- nvmf/common.sh@470 -- # waitforlisten 275215 00:23:10.823 17:05:21 -- common/autotest_common.sh@829 -- # '[' -z 275215 ']' 00:23:10.823 17:05:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:10.823 17:05:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:10.823 17:05:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:10.823 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:10.823 17:05:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:10.823 17:05:21 -- common/autotest_common.sh@10 -- # set +x 00:23:10.823 [2024-11-29 17:05:22.036629] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.823 [2024-11-29 17:05:22.036709] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:10.823 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.823 [2024-11-29 17:05:22.101027] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:23:10.823 [2024-11-29 17:05:22.211195] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:10.823 [2024-11-29 17:05:22.211349] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:10.823 [2024-11-29 17:05:22.211365] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:10.824 [2024-11-29 17:05:22.211378] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:10.824 [2024-11-29 17:05:22.211511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:10.824 [2024-11-29 17:05:22.211555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:10.824 [2024-11-29 17:05:22.211558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:11.754 17:05:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:11.754 17:05:23 -- common/autotest_common.sh@862 -- # return 0 00:23:11.754 17:05:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:11.755 17:05:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:11.755 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:11.755 17:05:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:11.755 17:05:23 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:11.755 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.755 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:11.755 [2024-11-29 17:05:23.092334] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:11.755 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.755 17:05:23 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:11.755 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.755 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:11.755 Malloc0 00:23:11.755 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.755 17:05:23 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:11.755 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.755 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:11.755 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.755 17:05:23 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:11.755 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.755 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:11.755 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.755 17:05:23 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:11.755 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.755 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:11.755 [2024-11-29 17:05:23.154832] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:11.755 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.755 17:05:23 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:23:11.755 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.755 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:11.755 [2024-11-29 17:05:23.162709] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:11.755 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.755 17:05:23 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:11.755 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.755 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:12.011 Malloc1 00:23:12.011 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.011 17:05:23 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:23:12.011 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.011 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:12.011 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.011 17:05:23 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:23:12.011 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.011 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:12.011 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.011 17:05:23 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:12.011 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.011 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:12.011 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.011 17:05:23 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:23:12.011 17:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.011 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:12.011 17:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.011 17:05:23 -- host/multicontroller.sh@44 -- # bdevperf_pid=275375 00:23:12.011 17:05:23 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:23:12.011 17:05:23 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:12.011 17:05:23 -- host/multicontroller.sh@47 -- # waitforlisten 275375 /var/tmp/bdevperf.sock 00:23:12.011 17:05:23 -- common/autotest_common.sh@829 -- # '[' -z 275375 ']' 00:23:12.011 17:05:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:12.011 17:05:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:12.011 17:05:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:12.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:12.011 17:05:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:12.011 17:05:23 -- common/autotest_common.sh@10 -- # set +x 00:23:12.940 17:05:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:12.940 17:05:24 -- common/autotest_common.sh@862 -- # return 0 00:23:12.940 17:05:24 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:12.940 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.940 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.198 NVMe0n1 00:23:13.198 17:05:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.198 17:05:24 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:13.198 17:05:24 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:13.198 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.198 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.198 17:05:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.198 1 00:23:13.198 17:05:24 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:13.198 17:05:24 -- common/autotest_common.sh@650 -- # local es=0 00:23:13.198 17:05:24 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:13.198 17:05:24 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:13.198 17:05:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:13.198 17:05:24 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:13.198 17:05:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:13.198 17:05:24 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:13.198 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.198 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.198 request: 00:23:13.198 { 00:23:13.198 "name": "NVMe0", 00:23:13.198 "trtype": "tcp", 00:23:13.198 "traddr": "10.0.0.2", 00:23:13.198 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:13.198 "hostaddr": "10.0.0.2", 00:23:13.198 "hostsvcid": "60000", 00:23:13.198 "adrfam": "ipv4", 00:23:13.198 "trsvcid": "4420", 00:23:13.198 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:13.198 "method": "bdev_nvme_attach_controller", 00:23:13.198 "req_id": 1 00:23:13.198 } 00:23:13.198 Got JSON-RPC error response 00:23:13.198 response: 00:23:13.198 { 00:23:13.198 "code": -114, 00:23:13.198 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:13.198 } 00:23:13.198 17:05:24 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:13.198 17:05:24 -- common/autotest_common.sh@653 -- # es=1 00:23:13.198 17:05:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:13.198 17:05:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:13.198 17:05:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:13.198 17:05:24 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:13.198 17:05:24 -- common/autotest_common.sh@650 -- # local es=0 00:23:13.198 17:05:24 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:13.198 17:05:24 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:13.198 17:05:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:13.198 17:05:24 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:13.198 17:05:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:13.198 17:05:24 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:13.198 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.198 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.198 request: 00:23:13.198 { 00:23:13.198 "name": "NVMe0", 00:23:13.198 "trtype": "tcp", 00:23:13.198 "traddr": "10.0.0.2", 00:23:13.198 "hostaddr": "10.0.0.2", 00:23:13.198 "hostsvcid": "60000", 00:23:13.198 "adrfam": "ipv4", 00:23:13.198 "trsvcid": "4420", 00:23:13.198 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:13.198 "method": "bdev_nvme_attach_controller", 00:23:13.198 "req_id": 1 00:23:13.198 } 00:23:13.198 Got JSON-RPC error response 00:23:13.198 response: 00:23:13.198 { 00:23:13.198 "code": -114, 00:23:13.198 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:13.198 } 00:23:13.198 17:05:24 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:13.198 17:05:24 -- common/autotest_common.sh@653 -- # es=1 00:23:13.198 17:05:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:13.198 17:05:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:13.198 17:05:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:13.198 17:05:24 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:13.198 17:05:24 -- common/autotest_common.sh@650 -- # local es=0 00:23:13.198 17:05:24 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:13.198 17:05:24 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:13.198 17:05:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:13.198 17:05:24 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:13.198 17:05:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:13.198 17:05:24 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:13.199 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.199 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.199 request: 00:23:13.199 { 00:23:13.199 "name": "NVMe0", 00:23:13.199 "trtype": "tcp", 00:23:13.199 "traddr": "10.0.0.2", 00:23:13.199 "hostaddr": "10.0.0.2", 00:23:13.199 "hostsvcid": "60000", 00:23:13.199 "adrfam": "ipv4", 00:23:13.199 "trsvcid": "4420", 00:23:13.199 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:13.199 "multipath": "disable", 00:23:13.199 "method": "bdev_nvme_attach_controller", 00:23:13.199 "req_id": 1 00:23:13.199 } 00:23:13.199 Got JSON-RPC error response 00:23:13.199 response: 00:23:13.199 { 00:23:13.199 "code": -114, 00:23:13.199 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:23:13.199 } 00:23:13.199 17:05:24 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:13.199 17:05:24 -- common/autotest_common.sh@653 -- # es=1 00:23:13.199 17:05:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:13.199 17:05:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:13.199 17:05:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:13.199 17:05:24 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:13.199 17:05:24 -- common/autotest_common.sh@650 -- # local es=0 00:23:13.199 17:05:24 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:13.199 17:05:24 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:13.199 17:05:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:13.199 17:05:24 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:13.199 17:05:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:13.199 17:05:24 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:13.199 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.199 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.199 request: 00:23:13.199 { 00:23:13.199 "name": "NVMe0", 00:23:13.199 "trtype": "tcp", 00:23:13.199 "traddr": "10.0.0.2", 00:23:13.199 "hostaddr": "10.0.0.2", 00:23:13.199 "hostsvcid": "60000", 00:23:13.199 "adrfam": "ipv4", 00:23:13.199 "trsvcid": "4420", 00:23:13.199 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:13.199 "multipath": "failover", 00:23:13.199 "method": "bdev_nvme_attach_controller", 00:23:13.199 "req_id": 1 00:23:13.199 } 00:23:13.199 Got JSON-RPC error response 00:23:13.199 response: 00:23:13.199 { 00:23:13.199 "code": -114, 00:23:13.199 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:13.199 } 00:23:13.199 17:05:24 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:13.199 17:05:24 -- common/autotest_common.sh@653 -- # es=1 00:23:13.199 17:05:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:13.199 17:05:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:13.199 17:05:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:13.199 17:05:24 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:13.199 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.199 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.456 00:23:13.456 17:05:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.456 17:05:24 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:13.456 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.456 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.456 17:05:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.456 17:05:24 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:13.456 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.456 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.456 00:23:13.456 17:05:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.456 17:05:24 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:13.456 17:05:24 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:13.456 17:05:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.457 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:23:13.457 17:05:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.457 17:05:24 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:13.457 17:05:24 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:14.828 0 00:23:14.828 17:05:25 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:14.828 17:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.828 17:05:25 -- common/autotest_common.sh@10 -- # set +x 00:23:14.828 17:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.828 17:05:25 -- host/multicontroller.sh@100 -- # killprocess 275375 00:23:14.828 17:05:25 -- common/autotest_common.sh@936 -- # '[' -z 275375 ']' 00:23:14.828 17:05:25 -- common/autotest_common.sh@940 -- # kill -0 275375 00:23:14.828 17:05:25 -- common/autotest_common.sh@941 -- # uname 00:23:14.828 17:05:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:14.828 17:05:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 275375 00:23:14.828 17:05:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:14.828 17:05:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:14.828 17:05:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 275375' 00:23:14.828 killing process with pid 275375 00:23:14.828 17:05:25 -- common/autotest_common.sh@955 -- # kill 275375 00:23:14.828 17:05:25 -- common/autotest_common.sh@960 -- # wait 275375 00:23:14.828 17:05:26 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:14.828 17:05:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.828 17:05:26 -- common/autotest_common.sh@10 -- # set +x 00:23:14.828 17:05:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.828 17:05:26 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:14.828 17:05:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.828 17:05:26 -- common/autotest_common.sh@10 -- # set +x 00:23:15.086 17:05:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:15.086 17:05:26 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:15.086 17:05:26 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:15.086 17:05:26 -- common/autotest_common.sh@1607 -- # read -r file 00:23:15.086 17:05:26 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:15.086 17:05:26 -- common/autotest_common.sh@1606 -- # sort -u 00:23:15.086 17:05:26 -- common/autotest_common.sh@1608 -- # cat 00:23:15.086 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:15.086 [2024-11-29 17:05:23.257314] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:15.086 [2024-11-29 17:05:23.257402] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid275375 ] 00:23:15.086 EAL: No free 2048 kB hugepages reported on node 1 00:23:15.086 [2024-11-29 17:05:23.317074] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:15.086 [2024-11-29 17:05:23.423455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:15.086 [2024-11-29 17:05:24.784697] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name b85d40c2-d36e-42a4-b14e-95323e9209b5 already exists 00:23:15.086 [2024-11-29 17:05:24.784735] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:b85d40c2-d36e-42a4-b14e-95323e9209b5 alias for bdev NVMe1n1 00:23:15.086 [2024-11-29 17:05:24.784752] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:15.086 Running I/O for 1 seconds... 00:23:15.086 00:23:15.086 Latency(us) 00:23:15.086 [2024-11-29T16:05:26.517Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:15.086 [2024-11-29T16:05:26.517Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:15.086 NVMe0n1 : 1.00 19602.03 76.57 0.00 0.00 6520.79 2536.49 16893.72 00:23:15.086 [2024-11-29T16:05:26.517Z] =================================================================================================================== 00:23:15.086 [2024-11-29T16:05:26.517Z] Total : 19602.03 76.57 0.00 0.00 6520.79 2536.49 16893.72 00:23:15.086 Received shutdown signal, test time was about 1.000000 seconds 00:23:15.086 00:23:15.086 Latency(us) 00:23:15.086 [2024-11-29T16:05:26.517Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:15.086 [2024-11-29T16:05:26.517Z] =================================================================================================================== 00:23:15.086 [2024-11-29T16:05:26.517Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:15.086 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:15.086 17:05:26 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:15.086 17:05:26 -- common/autotest_common.sh@1607 -- # read -r file 00:23:15.086 17:05:26 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:15.086 17:05:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:15.086 17:05:26 -- nvmf/common.sh@116 -- # sync 00:23:15.086 17:05:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:15.086 17:05:26 -- nvmf/common.sh@119 -- # set +e 00:23:15.086 17:05:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:15.086 17:05:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:15.086 rmmod nvme_tcp 00:23:15.086 rmmod nvme_fabrics 00:23:15.086 rmmod nvme_keyring 00:23:15.086 17:05:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:15.086 17:05:26 -- nvmf/common.sh@123 -- # set -e 00:23:15.086 17:05:26 -- nvmf/common.sh@124 -- # return 0 00:23:15.086 17:05:26 -- nvmf/common.sh@477 -- # '[' -n 275215 ']' 00:23:15.086 17:05:26 -- nvmf/common.sh@478 -- # killprocess 275215 00:23:15.086 17:05:26 -- common/autotest_common.sh@936 -- # '[' -z 275215 ']' 00:23:15.086 17:05:26 -- common/autotest_common.sh@940 -- # kill -0 275215 00:23:15.086 17:05:26 -- common/autotest_common.sh@941 -- # uname 00:23:15.086 17:05:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:15.086 17:05:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 275215 00:23:15.086 17:05:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:23:15.086 17:05:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:23:15.086 17:05:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 275215' 00:23:15.086 killing process with pid 275215 00:23:15.086 17:05:26 -- common/autotest_common.sh@955 -- # kill 275215 00:23:15.086 17:05:26 -- common/autotest_common.sh@960 -- # wait 275215 00:23:15.345 17:05:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:15.345 17:05:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:15.345 17:05:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:15.345 17:05:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:15.345 17:05:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:15.345 17:05:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:15.345 17:05:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:15.345 17:05:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.880 17:05:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:17.880 00:23:17.880 real 0m9.033s 00:23:17.880 user 0m17.538s 00:23:17.880 sys 0m2.375s 00:23:17.880 17:05:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:17.880 17:05:28 -- common/autotest_common.sh@10 -- # set +x 00:23:17.880 ************************************ 00:23:17.880 END TEST nvmf_multicontroller 00:23:17.880 ************************************ 00:23:17.880 17:05:28 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:17.880 17:05:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:17.880 17:05:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:17.880 17:05:28 -- common/autotest_common.sh@10 -- # set +x 00:23:17.880 ************************************ 00:23:17.880 START TEST nvmf_aer 00:23:17.880 ************************************ 00:23:17.880 17:05:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:17.880 * Looking for test storage... 00:23:17.880 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:17.880 17:05:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:17.880 17:05:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:17.880 17:05:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:17.880 17:05:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:17.880 17:05:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:17.880 17:05:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:17.880 17:05:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:17.880 17:05:28 -- scripts/common.sh@335 -- # IFS=.-: 00:23:17.880 17:05:28 -- scripts/common.sh@335 -- # read -ra ver1 00:23:17.880 17:05:28 -- scripts/common.sh@336 -- # IFS=.-: 00:23:17.880 17:05:28 -- scripts/common.sh@336 -- # read -ra ver2 00:23:17.880 17:05:28 -- scripts/common.sh@337 -- # local 'op=<' 00:23:17.880 17:05:28 -- scripts/common.sh@339 -- # ver1_l=2 00:23:17.880 17:05:28 -- scripts/common.sh@340 -- # ver2_l=1 00:23:17.880 17:05:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:17.880 17:05:28 -- scripts/common.sh@343 -- # case "$op" in 00:23:17.880 17:05:28 -- scripts/common.sh@344 -- # : 1 00:23:17.880 17:05:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:17.881 17:05:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:17.881 17:05:28 -- scripts/common.sh@364 -- # decimal 1 00:23:17.881 17:05:28 -- scripts/common.sh@352 -- # local d=1 00:23:17.881 17:05:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:17.881 17:05:28 -- scripts/common.sh@354 -- # echo 1 00:23:17.881 17:05:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:17.881 17:05:28 -- scripts/common.sh@365 -- # decimal 2 00:23:17.881 17:05:28 -- scripts/common.sh@352 -- # local d=2 00:23:17.881 17:05:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:17.881 17:05:28 -- scripts/common.sh@354 -- # echo 2 00:23:17.881 17:05:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:17.881 17:05:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:17.881 17:05:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:17.881 17:05:28 -- scripts/common.sh@367 -- # return 0 00:23:17.881 17:05:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:17.881 17:05:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:17.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.881 --rc genhtml_branch_coverage=1 00:23:17.881 --rc genhtml_function_coverage=1 00:23:17.881 --rc genhtml_legend=1 00:23:17.881 --rc geninfo_all_blocks=1 00:23:17.881 --rc geninfo_unexecuted_blocks=1 00:23:17.881 00:23:17.881 ' 00:23:17.881 17:05:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:17.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.881 --rc genhtml_branch_coverage=1 00:23:17.881 --rc genhtml_function_coverage=1 00:23:17.881 --rc genhtml_legend=1 00:23:17.881 --rc geninfo_all_blocks=1 00:23:17.881 --rc geninfo_unexecuted_blocks=1 00:23:17.881 00:23:17.881 ' 00:23:17.881 17:05:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:17.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.881 --rc genhtml_branch_coverage=1 00:23:17.881 --rc genhtml_function_coverage=1 00:23:17.881 --rc genhtml_legend=1 00:23:17.881 --rc geninfo_all_blocks=1 00:23:17.881 --rc geninfo_unexecuted_blocks=1 00:23:17.881 00:23:17.881 ' 00:23:17.881 17:05:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:17.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.881 --rc genhtml_branch_coverage=1 00:23:17.881 --rc genhtml_function_coverage=1 00:23:17.881 --rc genhtml_legend=1 00:23:17.881 --rc geninfo_all_blocks=1 00:23:17.881 --rc geninfo_unexecuted_blocks=1 00:23:17.881 00:23:17.881 ' 00:23:17.881 17:05:28 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:17.881 17:05:28 -- nvmf/common.sh@7 -- # uname -s 00:23:17.881 17:05:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:17.881 17:05:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:17.881 17:05:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:17.881 17:05:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:17.881 17:05:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:17.881 17:05:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:17.881 17:05:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:17.881 17:05:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:17.881 17:05:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:17.881 17:05:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:17.881 17:05:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.881 17:05:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.881 17:05:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:17.881 17:05:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:17.881 17:05:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:17.881 17:05:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:17.881 17:05:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:17.881 17:05:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:17.881 17:05:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:17.881 17:05:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.881 17:05:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.881 17:05:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.881 17:05:28 -- paths/export.sh@5 -- # export PATH 00:23:17.881 17:05:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.881 17:05:28 -- nvmf/common.sh@46 -- # : 0 00:23:17.881 17:05:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:17.881 17:05:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:17.881 17:05:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:17.881 17:05:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:17.881 17:05:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:17.881 17:05:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:17.881 17:05:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:17.881 17:05:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:17.881 17:05:28 -- host/aer.sh@11 -- # nvmftestinit 00:23:17.881 17:05:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:17.881 17:05:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:17.881 17:05:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:17.881 17:05:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:17.881 17:05:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:17.881 17:05:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:17.881 17:05:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:17.881 17:05:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.881 17:05:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:17.881 17:05:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:17.881 17:05:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:17.881 17:05:28 -- common/autotest_common.sh@10 -- # set +x 00:23:19.783 17:05:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:19.783 17:05:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:19.783 17:05:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:19.783 17:05:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:19.783 17:05:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:19.783 17:05:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:19.783 17:05:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:19.783 17:05:30 -- nvmf/common.sh@294 -- # net_devs=() 00:23:19.783 17:05:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:19.783 17:05:30 -- nvmf/common.sh@295 -- # e810=() 00:23:19.783 17:05:30 -- nvmf/common.sh@295 -- # local -ga e810 00:23:19.783 17:05:30 -- nvmf/common.sh@296 -- # x722=() 00:23:19.783 17:05:30 -- nvmf/common.sh@296 -- # local -ga x722 00:23:19.783 17:05:30 -- nvmf/common.sh@297 -- # mlx=() 00:23:19.783 17:05:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:19.783 17:05:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:19.783 17:05:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:19.783 17:05:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:19.783 17:05:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:19.783 17:05:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.783 17:05:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:19.783 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:19.783 17:05:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.783 17:05:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:19.783 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:19.783 17:05:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:19.783 17:05:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.783 17:05:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.783 17:05:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.783 17:05:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.783 17:05:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:19.783 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:19.783 17:05:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.783 17:05:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.783 17:05:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.783 17:05:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.783 17:05:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.783 17:05:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:19.783 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:19.783 17:05:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.783 17:05:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:19.783 17:05:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:19.783 17:05:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:19.783 17:05:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:19.783 17:05:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:19.783 17:05:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:19.783 17:05:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:19.783 17:05:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:19.783 17:05:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:19.783 17:05:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:19.783 17:05:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:19.783 17:05:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:19.783 17:05:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:19.783 17:05:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:19.783 17:05:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:19.783 17:05:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:19.783 17:05:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:19.783 17:05:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:19.783 17:05:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:19.783 17:05:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:19.783 17:05:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:19.783 17:05:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:19.784 17:05:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:19.784 17:05:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:19.784 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:19.784 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.276 ms 00:23:19.784 00:23:19.784 --- 10.0.0.2 ping statistics --- 00:23:19.784 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.784 rtt min/avg/max/mdev = 0.276/0.276/0.276/0.000 ms 00:23:19.784 17:05:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:19.784 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:19.784 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:23:19.784 00:23:19.784 --- 10.0.0.1 ping statistics --- 00:23:19.784 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.784 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:23:19.784 17:05:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:19.784 17:05:30 -- nvmf/common.sh@410 -- # return 0 00:23:19.784 17:05:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:19.784 17:05:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:19.784 17:05:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:19.784 17:05:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:19.784 17:05:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:19.784 17:05:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:19.784 17:05:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:19.784 17:05:30 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:19.784 17:05:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:19.784 17:05:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:19.784 17:05:30 -- common/autotest_common.sh@10 -- # set +x 00:23:19.784 17:05:30 -- nvmf/common.sh@469 -- # nvmfpid=277739 00:23:19.784 17:05:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:19.784 17:05:30 -- nvmf/common.sh@470 -- # waitforlisten 277739 00:23:19.784 17:05:30 -- common/autotest_common.sh@829 -- # '[' -z 277739 ']' 00:23:19.784 17:05:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:19.784 17:05:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:19.784 17:05:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:19.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:19.784 17:05:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:19.784 17:05:30 -- common/autotest_common.sh@10 -- # set +x 00:23:19.784 [2024-11-29 17:05:31.018651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:19.784 [2024-11-29 17:05:31.018728] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:19.784 EAL: No free 2048 kB hugepages reported on node 1 00:23:19.784 [2024-11-29 17:05:31.086561] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:19.784 [2024-11-29 17:05:31.202975] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:19.784 [2024-11-29 17:05:31.203151] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:19.784 [2024-11-29 17:05:31.203171] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:19.784 [2024-11-29 17:05:31.203185] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:19.784 [2024-11-29 17:05:31.203279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:19.784 [2024-11-29 17:05:31.203350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:19.784 [2024-11-29 17:05:31.203446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:19.784 [2024-11-29 17:05:31.203449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:20.717 17:05:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:20.717 17:05:31 -- common/autotest_common.sh@862 -- # return 0 00:23:20.717 17:05:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:20.717 17:05:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:20.717 17:05:31 -- common/autotest_common.sh@10 -- # set +x 00:23:20.717 17:05:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:20.717 17:05:31 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:20.717 17:05:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.717 17:05:31 -- common/autotest_common.sh@10 -- # set +x 00:23:20.717 [2024-11-29 17:05:31.991479] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:20.717 17:05:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.717 17:05:31 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:20.717 17:05:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.717 17:05:31 -- common/autotest_common.sh@10 -- # set +x 00:23:20.717 Malloc0 00:23:20.717 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.717 17:05:32 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:20.717 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.717 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:20.717 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.717 17:05:32 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:20.717 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.717 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:20.717 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.717 17:05:32 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:20.717 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.717 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:20.717 [2024-11-29 17:05:32.042768] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:20.717 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.717 17:05:32 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:20.717 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.717 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:20.717 [2024-11-29 17:05:32.050507] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:20.717 [ 00:23:20.717 { 00:23:20.717 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:20.717 "subtype": "Discovery", 00:23:20.717 "listen_addresses": [], 00:23:20.717 "allow_any_host": true, 00:23:20.717 "hosts": [] 00:23:20.717 }, 00:23:20.717 { 00:23:20.717 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:20.717 "subtype": "NVMe", 00:23:20.717 "listen_addresses": [ 00:23:20.717 { 00:23:20.717 "transport": "TCP", 00:23:20.717 "trtype": "TCP", 00:23:20.717 "adrfam": "IPv4", 00:23:20.717 "traddr": "10.0.0.2", 00:23:20.717 "trsvcid": "4420" 00:23:20.717 } 00:23:20.717 ], 00:23:20.717 "allow_any_host": true, 00:23:20.717 "hosts": [], 00:23:20.717 "serial_number": "SPDK00000000000001", 00:23:20.717 "model_number": "SPDK bdev Controller", 00:23:20.717 "max_namespaces": 2, 00:23:20.717 "min_cntlid": 1, 00:23:20.717 "max_cntlid": 65519, 00:23:20.717 "namespaces": [ 00:23:20.717 { 00:23:20.717 "nsid": 1, 00:23:20.717 "bdev_name": "Malloc0", 00:23:20.717 "name": "Malloc0", 00:23:20.717 "nguid": "E7B5D02048C64A958A08F4619BF1159F", 00:23:20.717 "uuid": "e7b5d020-48c6-4a95-8a08-f4619bf1159f" 00:23:20.717 } 00:23:20.717 ] 00:23:20.717 } 00:23:20.717 ] 00:23:20.717 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.717 17:05:32 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:20.717 17:05:32 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:20.717 17:05:32 -- host/aer.sh@33 -- # aerpid=277905 00:23:20.717 17:05:32 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:20.717 17:05:32 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:20.717 17:05:32 -- common/autotest_common.sh@1254 -- # local i=0 00:23:20.717 17:05:32 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:20.717 17:05:32 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:23:20.717 17:05:32 -- common/autotest_common.sh@1257 -- # i=1 00:23:20.717 17:05:32 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:20.717 EAL: No free 2048 kB hugepages reported on node 1 00:23:20.975 17:05:32 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:20.975 17:05:32 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:23:20.975 17:05:32 -- common/autotest_common.sh@1257 -- # i=2 00:23:20.975 17:05:32 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:20.975 17:05:32 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:20.975 17:05:32 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:20.975 17:05:32 -- common/autotest_common.sh@1265 -- # return 0 00:23:20.975 17:05:32 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:20.975 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.975 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:20.975 Malloc1 00:23:20.975 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.975 17:05:32 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:20.975 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.975 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:20.975 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.975 17:05:32 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:20.975 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.975 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:20.975 Asynchronous Event Request test 00:23:20.975 Attaching to 10.0.0.2 00:23:20.975 Attached to 10.0.0.2 00:23:20.975 Registering asynchronous event callbacks... 00:23:20.975 Starting namespace attribute notice tests for all controllers... 00:23:20.975 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:20.975 aer_cb - Changed Namespace 00:23:20.975 Cleaning up... 00:23:20.975 [ 00:23:20.975 { 00:23:20.975 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:20.975 "subtype": "Discovery", 00:23:20.975 "listen_addresses": [], 00:23:20.975 "allow_any_host": true, 00:23:20.975 "hosts": [] 00:23:20.975 }, 00:23:20.975 { 00:23:20.975 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:20.975 "subtype": "NVMe", 00:23:20.975 "listen_addresses": [ 00:23:20.975 { 00:23:20.975 "transport": "TCP", 00:23:20.975 "trtype": "TCP", 00:23:20.975 "adrfam": "IPv4", 00:23:20.975 "traddr": "10.0.0.2", 00:23:20.975 "trsvcid": "4420" 00:23:20.975 } 00:23:20.975 ], 00:23:20.975 "allow_any_host": true, 00:23:20.975 "hosts": [], 00:23:20.975 "serial_number": "SPDK00000000000001", 00:23:20.975 "model_number": "SPDK bdev Controller", 00:23:20.975 "max_namespaces": 2, 00:23:20.975 "min_cntlid": 1, 00:23:20.975 "max_cntlid": 65519, 00:23:20.975 "namespaces": [ 00:23:20.975 { 00:23:20.975 "nsid": 1, 00:23:20.975 "bdev_name": "Malloc0", 00:23:20.975 "name": "Malloc0", 00:23:20.975 "nguid": "E7B5D02048C64A958A08F4619BF1159F", 00:23:20.975 "uuid": "e7b5d020-48c6-4a95-8a08-f4619bf1159f" 00:23:20.975 }, 00:23:20.975 { 00:23:20.975 "nsid": 2, 00:23:20.975 "bdev_name": "Malloc1", 00:23:20.975 "name": "Malloc1", 00:23:20.975 "nguid": "568BB10CDBE14461896847F50A61BFDC", 00:23:20.975 "uuid": "568bb10c-dbe1-4461-8968-47f50a61bfdc" 00:23:20.975 } 00:23:20.975 ] 00:23:20.975 } 00:23:20.975 ] 00:23:20.975 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.975 17:05:32 -- host/aer.sh@43 -- # wait 277905 00:23:20.975 17:05:32 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:20.975 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.975 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:20.975 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.975 17:05:32 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:20.975 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.975 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:20.975 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.975 17:05:32 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:20.975 17:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.233 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:23:21.233 17:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.233 17:05:32 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:21.233 17:05:32 -- host/aer.sh@51 -- # nvmftestfini 00:23:21.233 17:05:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:21.233 17:05:32 -- nvmf/common.sh@116 -- # sync 00:23:21.233 17:05:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:21.233 17:05:32 -- nvmf/common.sh@119 -- # set +e 00:23:21.233 17:05:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:21.233 17:05:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:21.233 rmmod nvme_tcp 00:23:21.233 rmmod nvme_fabrics 00:23:21.233 rmmod nvme_keyring 00:23:21.233 17:05:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:21.233 17:05:32 -- nvmf/common.sh@123 -- # set -e 00:23:21.233 17:05:32 -- nvmf/common.sh@124 -- # return 0 00:23:21.233 17:05:32 -- nvmf/common.sh@477 -- # '[' -n 277739 ']' 00:23:21.233 17:05:32 -- nvmf/common.sh@478 -- # killprocess 277739 00:23:21.233 17:05:32 -- common/autotest_common.sh@936 -- # '[' -z 277739 ']' 00:23:21.233 17:05:32 -- common/autotest_common.sh@940 -- # kill -0 277739 00:23:21.233 17:05:32 -- common/autotest_common.sh@941 -- # uname 00:23:21.233 17:05:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:21.233 17:05:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 277739 00:23:21.233 17:05:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:21.233 17:05:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:21.233 17:05:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 277739' 00:23:21.233 killing process with pid 277739 00:23:21.233 17:05:32 -- common/autotest_common.sh@955 -- # kill 277739 00:23:21.233 [2024-11-29 17:05:32.506293] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:21.233 17:05:32 -- common/autotest_common.sh@960 -- # wait 277739 00:23:21.491 17:05:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:21.491 17:05:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:21.491 17:05:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:21.491 17:05:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:21.491 17:05:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:21.491 17:05:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:21.491 17:05:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:21.491 17:05:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:23.396 17:05:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:23.396 00:23:23.396 real 0m6.085s 00:23:23.396 user 0m7.097s 00:23:23.396 sys 0m1.851s 00:23:23.396 17:05:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:23.396 17:05:34 -- common/autotest_common.sh@10 -- # set +x 00:23:23.396 ************************************ 00:23:23.396 END TEST nvmf_aer 00:23:23.396 ************************************ 00:23:23.653 17:05:34 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:23.653 17:05:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:23.653 17:05:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:23.653 17:05:34 -- common/autotest_common.sh@10 -- # set +x 00:23:23.653 ************************************ 00:23:23.653 START TEST nvmf_async_init 00:23:23.653 ************************************ 00:23:23.654 17:05:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:23.654 * Looking for test storage... 00:23:23.654 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:23.654 17:05:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:23.654 17:05:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:23.654 17:05:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:23.654 17:05:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:23.654 17:05:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:23.654 17:05:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:23.654 17:05:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:23.654 17:05:34 -- scripts/common.sh@335 -- # IFS=.-: 00:23:23.654 17:05:34 -- scripts/common.sh@335 -- # read -ra ver1 00:23:23.654 17:05:34 -- scripts/common.sh@336 -- # IFS=.-: 00:23:23.654 17:05:34 -- scripts/common.sh@336 -- # read -ra ver2 00:23:23.654 17:05:34 -- scripts/common.sh@337 -- # local 'op=<' 00:23:23.654 17:05:34 -- scripts/common.sh@339 -- # ver1_l=2 00:23:23.654 17:05:34 -- scripts/common.sh@340 -- # ver2_l=1 00:23:23.654 17:05:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:23.654 17:05:34 -- scripts/common.sh@343 -- # case "$op" in 00:23:23.654 17:05:34 -- scripts/common.sh@344 -- # : 1 00:23:23.654 17:05:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:23.654 17:05:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:23.654 17:05:34 -- scripts/common.sh@364 -- # decimal 1 00:23:23.654 17:05:34 -- scripts/common.sh@352 -- # local d=1 00:23:23.654 17:05:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:23.654 17:05:34 -- scripts/common.sh@354 -- # echo 1 00:23:23.654 17:05:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:23.654 17:05:34 -- scripts/common.sh@365 -- # decimal 2 00:23:23.654 17:05:34 -- scripts/common.sh@352 -- # local d=2 00:23:23.654 17:05:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:23.654 17:05:34 -- scripts/common.sh@354 -- # echo 2 00:23:23.654 17:05:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:23.654 17:05:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:23.654 17:05:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:23.654 17:05:34 -- scripts/common.sh@367 -- # return 0 00:23:23.654 17:05:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:23.654 17:05:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:23.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.654 --rc genhtml_branch_coverage=1 00:23:23.654 --rc genhtml_function_coverage=1 00:23:23.654 --rc genhtml_legend=1 00:23:23.654 --rc geninfo_all_blocks=1 00:23:23.654 --rc geninfo_unexecuted_blocks=1 00:23:23.654 00:23:23.654 ' 00:23:23.654 17:05:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:23.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.654 --rc genhtml_branch_coverage=1 00:23:23.654 --rc genhtml_function_coverage=1 00:23:23.654 --rc genhtml_legend=1 00:23:23.654 --rc geninfo_all_blocks=1 00:23:23.654 --rc geninfo_unexecuted_blocks=1 00:23:23.654 00:23:23.654 ' 00:23:23.654 17:05:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:23.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.654 --rc genhtml_branch_coverage=1 00:23:23.654 --rc genhtml_function_coverage=1 00:23:23.654 --rc genhtml_legend=1 00:23:23.654 --rc geninfo_all_blocks=1 00:23:23.654 --rc geninfo_unexecuted_blocks=1 00:23:23.654 00:23:23.654 ' 00:23:23.654 17:05:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:23.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.654 --rc genhtml_branch_coverage=1 00:23:23.654 --rc genhtml_function_coverage=1 00:23:23.654 --rc genhtml_legend=1 00:23:23.654 --rc geninfo_all_blocks=1 00:23:23.654 --rc geninfo_unexecuted_blocks=1 00:23:23.654 00:23:23.654 ' 00:23:23.654 17:05:34 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:23.654 17:05:34 -- nvmf/common.sh@7 -- # uname -s 00:23:23.654 17:05:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:23.654 17:05:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:23.654 17:05:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:23.654 17:05:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:23.654 17:05:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:23.654 17:05:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:23.654 17:05:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:23.654 17:05:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:23.654 17:05:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:23.654 17:05:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:23.654 17:05:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:23.654 17:05:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:23.654 17:05:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:23.654 17:05:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:23.654 17:05:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:23.654 17:05:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:23.654 17:05:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:23.654 17:05:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:23.654 17:05:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:23.654 17:05:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.654 17:05:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.654 17:05:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.654 17:05:34 -- paths/export.sh@5 -- # export PATH 00:23:23.654 17:05:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.654 17:05:34 -- nvmf/common.sh@46 -- # : 0 00:23:23.654 17:05:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:23.654 17:05:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:23.654 17:05:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:23.654 17:05:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:23.654 17:05:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:23.654 17:05:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:23.654 17:05:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:23.654 17:05:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:23.654 17:05:34 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:23.654 17:05:34 -- host/async_init.sh@14 -- # null_block_size=512 00:23:23.654 17:05:34 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:23.654 17:05:34 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:23.654 17:05:35 -- host/async_init.sh@20 -- # uuidgen 00:23:23.654 17:05:35 -- host/async_init.sh@20 -- # tr -d - 00:23:23.654 17:05:35 -- host/async_init.sh@20 -- # nguid=691863040c954d0aa3f0afcecfb6b80a 00:23:23.654 17:05:35 -- host/async_init.sh@22 -- # nvmftestinit 00:23:23.654 17:05:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:23.654 17:05:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:23.654 17:05:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:23.654 17:05:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:23.654 17:05:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:23.654 17:05:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:23.654 17:05:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:23.654 17:05:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:23.654 17:05:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:23.654 17:05:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:23.654 17:05:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:23.654 17:05:35 -- common/autotest_common.sh@10 -- # set +x 00:23:25.553 17:05:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:25.553 17:05:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:25.553 17:05:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:25.553 17:05:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:25.553 17:05:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:25.553 17:05:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:25.553 17:05:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:25.553 17:05:36 -- nvmf/common.sh@294 -- # net_devs=() 00:23:25.553 17:05:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:25.553 17:05:36 -- nvmf/common.sh@295 -- # e810=() 00:23:25.553 17:05:36 -- nvmf/common.sh@295 -- # local -ga e810 00:23:25.553 17:05:36 -- nvmf/common.sh@296 -- # x722=() 00:23:25.553 17:05:36 -- nvmf/common.sh@296 -- # local -ga x722 00:23:25.553 17:05:36 -- nvmf/common.sh@297 -- # mlx=() 00:23:25.553 17:05:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:25.553 17:05:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:25.553 17:05:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:25.553 17:05:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:25.553 17:05:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:25.553 17:05:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:25.553 17:05:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:25.553 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:25.553 17:05:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:25.553 17:05:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:25.553 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:25.553 17:05:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:25.553 17:05:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:25.553 17:05:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:25.554 17:05:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:25.554 17:05:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:25.554 17:05:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:25.554 17:05:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:25.554 17:05:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:25.554 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:25.554 17:05:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:25.554 17:05:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:25.554 17:05:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:25.554 17:05:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:25.554 17:05:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:25.554 17:05:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:25.554 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:25.554 17:05:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:25.554 17:05:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:25.554 17:05:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:25.554 17:05:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:25.554 17:05:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:25.554 17:05:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:25.554 17:05:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:25.554 17:05:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:25.554 17:05:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:25.554 17:05:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:25.554 17:05:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:25.554 17:05:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:25.554 17:05:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:25.554 17:05:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:25.554 17:05:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:25.554 17:05:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:25.554 17:05:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:25.554 17:05:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:25.554 17:05:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:25.812 17:05:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:25.813 17:05:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:25.813 17:05:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:25.813 17:05:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:25.813 17:05:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:25.813 17:05:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:25.813 17:05:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:25.813 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:25.813 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:23:25.813 00:23:25.813 --- 10.0.0.2 ping statistics --- 00:23:25.813 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:25.813 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:23:25.813 17:05:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:25.813 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:25.813 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:23:25.813 00:23:25.813 --- 10.0.0.1 ping statistics --- 00:23:25.813 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:25.813 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:23:25.813 17:05:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:25.813 17:05:37 -- nvmf/common.sh@410 -- # return 0 00:23:25.813 17:05:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:25.813 17:05:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:25.813 17:05:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:25.813 17:05:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:25.813 17:05:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:25.813 17:05:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:25.813 17:05:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:25.813 17:05:37 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:25.813 17:05:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:25.813 17:05:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:25.813 17:05:37 -- common/autotest_common.sh@10 -- # set +x 00:23:25.813 17:05:37 -- nvmf/common.sh@469 -- # nvmfpid=279877 00:23:25.813 17:05:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:25.813 17:05:37 -- nvmf/common.sh@470 -- # waitforlisten 279877 00:23:25.813 17:05:37 -- common/autotest_common.sh@829 -- # '[' -z 279877 ']' 00:23:25.813 17:05:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:25.813 17:05:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:25.813 17:05:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:25.813 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:25.813 17:05:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:25.813 17:05:37 -- common/autotest_common.sh@10 -- # set +x 00:23:25.813 [2024-11-29 17:05:37.138281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:25.813 [2024-11-29 17:05:37.138373] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:25.813 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.813 [2024-11-29 17:05:37.208859] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:26.071 [2024-11-29 17:05:37.323106] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:26.071 [2024-11-29 17:05:37.323273] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:26.071 [2024-11-29 17:05:37.323305] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:26.071 [2024-11-29 17:05:37.323321] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:26.071 [2024-11-29 17:05:37.323361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:27.005 17:05:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:27.005 17:05:38 -- common/autotest_common.sh@862 -- # return 0 00:23:27.005 17:05:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:27.005 17:05:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 17:05:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:27.005 17:05:38 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:27.005 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 [2024-11-29 17:05:38.125138] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:27.005 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.005 17:05:38 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:27.005 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 null0 00:23:27.005 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.005 17:05:38 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:27.005 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.005 17:05:38 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:27.005 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.005 17:05:38 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 691863040c954d0aa3f0afcecfb6b80a 00:23:27.005 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.005 17:05:38 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:27.005 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 [2024-11-29 17:05:38.165391] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:27.005 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.005 17:05:38 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:27.005 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 nvme0n1 00:23:27.005 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.005 17:05:38 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:27.005 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 [ 00:23:27.005 { 00:23:27.005 "name": "nvme0n1", 00:23:27.005 "aliases": [ 00:23:27.005 "69186304-0c95-4d0a-a3f0-afcecfb6b80a" 00:23:27.005 ], 00:23:27.005 "product_name": "NVMe disk", 00:23:27.005 "block_size": 512, 00:23:27.005 "num_blocks": 2097152, 00:23:27.005 "uuid": "69186304-0c95-4d0a-a3f0-afcecfb6b80a", 00:23:27.005 "assigned_rate_limits": { 00:23:27.005 "rw_ios_per_sec": 0, 00:23:27.005 "rw_mbytes_per_sec": 0, 00:23:27.005 "r_mbytes_per_sec": 0, 00:23:27.005 "w_mbytes_per_sec": 0 00:23:27.005 }, 00:23:27.005 "claimed": false, 00:23:27.005 "zoned": false, 00:23:27.005 "supported_io_types": { 00:23:27.005 "read": true, 00:23:27.005 "write": true, 00:23:27.005 "unmap": false, 00:23:27.005 "write_zeroes": true, 00:23:27.005 "flush": true, 00:23:27.005 "reset": true, 00:23:27.005 "compare": true, 00:23:27.005 "compare_and_write": true, 00:23:27.005 "abort": true, 00:23:27.005 "nvme_admin": true, 00:23:27.005 "nvme_io": true 00:23:27.005 }, 00:23:27.005 "driver_specific": { 00:23:27.005 "nvme": [ 00:23:27.005 { 00:23:27.005 "trid": { 00:23:27.005 "trtype": "TCP", 00:23:27.005 "adrfam": "IPv4", 00:23:27.005 "traddr": "10.0.0.2", 00:23:27.005 "trsvcid": "4420", 00:23:27.005 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:27.005 }, 00:23:27.005 "ctrlr_data": { 00:23:27.005 "cntlid": 1, 00:23:27.005 "vendor_id": "0x8086", 00:23:27.005 "model_number": "SPDK bdev Controller", 00:23:27.005 "serial_number": "00000000000000000000", 00:23:27.005 "firmware_revision": "24.01.1", 00:23:27.005 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:27.005 "oacs": { 00:23:27.005 "security": 0, 00:23:27.005 "format": 0, 00:23:27.005 "firmware": 0, 00:23:27.005 "ns_manage": 0 00:23:27.005 }, 00:23:27.005 "multi_ctrlr": true, 00:23:27.005 "ana_reporting": false 00:23:27.005 }, 00:23:27.005 "vs": { 00:23:27.005 "nvme_version": "1.3" 00:23:27.005 }, 00:23:27.005 "ns_data": { 00:23:27.005 "id": 1, 00:23:27.005 "can_share": true 00:23:27.005 } 00:23:27.005 } 00:23:27.005 ], 00:23:27.005 "mp_policy": "active_passive" 00:23:27.005 } 00:23:27.005 } 00:23:27.005 ] 00:23:27.005 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.005 17:05:38 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:27.005 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.005 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 [2024-11-29 17:05:38.414001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:27.005 [2024-11-29 17:05:38.414090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12a2ba0 (9): Bad file descriptor 00:23:27.263 [2024-11-29 17:05:38.546108] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:27.263 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.263 17:05:38 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:27.263 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.263 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.263 [ 00:23:27.263 { 00:23:27.263 "name": "nvme0n1", 00:23:27.263 "aliases": [ 00:23:27.263 "69186304-0c95-4d0a-a3f0-afcecfb6b80a" 00:23:27.263 ], 00:23:27.263 "product_name": "NVMe disk", 00:23:27.263 "block_size": 512, 00:23:27.263 "num_blocks": 2097152, 00:23:27.263 "uuid": "69186304-0c95-4d0a-a3f0-afcecfb6b80a", 00:23:27.263 "assigned_rate_limits": { 00:23:27.263 "rw_ios_per_sec": 0, 00:23:27.263 "rw_mbytes_per_sec": 0, 00:23:27.263 "r_mbytes_per_sec": 0, 00:23:27.263 "w_mbytes_per_sec": 0 00:23:27.263 }, 00:23:27.263 "claimed": false, 00:23:27.263 "zoned": false, 00:23:27.263 "supported_io_types": { 00:23:27.263 "read": true, 00:23:27.263 "write": true, 00:23:27.263 "unmap": false, 00:23:27.263 "write_zeroes": true, 00:23:27.263 "flush": true, 00:23:27.263 "reset": true, 00:23:27.263 "compare": true, 00:23:27.263 "compare_and_write": true, 00:23:27.263 "abort": true, 00:23:27.263 "nvme_admin": true, 00:23:27.263 "nvme_io": true 00:23:27.263 }, 00:23:27.263 "driver_specific": { 00:23:27.263 "nvme": [ 00:23:27.263 { 00:23:27.263 "trid": { 00:23:27.263 "trtype": "TCP", 00:23:27.263 "adrfam": "IPv4", 00:23:27.263 "traddr": "10.0.0.2", 00:23:27.263 "trsvcid": "4420", 00:23:27.263 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:27.263 }, 00:23:27.263 "ctrlr_data": { 00:23:27.263 "cntlid": 2, 00:23:27.263 "vendor_id": "0x8086", 00:23:27.263 "model_number": "SPDK bdev Controller", 00:23:27.263 "serial_number": "00000000000000000000", 00:23:27.263 "firmware_revision": "24.01.1", 00:23:27.263 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:27.263 "oacs": { 00:23:27.263 "security": 0, 00:23:27.263 "format": 0, 00:23:27.263 "firmware": 0, 00:23:27.263 "ns_manage": 0 00:23:27.263 }, 00:23:27.263 "multi_ctrlr": true, 00:23:27.263 "ana_reporting": false 00:23:27.263 }, 00:23:27.263 "vs": { 00:23:27.263 "nvme_version": "1.3" 00:23:27.263 }, 00:23:27.263 "ns_data": { 00:23:27.263 "id": 1, 00:23:27.263 "can_share": true 00:23:27.263 } 00:23:27.263 } 00:23:27.263 ], 00:23:27.263 "mp_policy": "active_passive" 00:23:27.263 } 00:23:27.263 } 00:23:27.263 ] 00:23:27.263 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.263 17:05:38 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:27.263 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.263 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.263 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.263 17:05:38 -- host/async_init.sh@53 -- # mktemp 00:23:27.263 17:05:38 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.oWwSvrEciR 00:23:27.263 17:05:38 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:27.263 17:05:38 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.oWwSvrEciR 00:23:27.263 17:05:38 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:27.263 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.263 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.263 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.263 17:05:38 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:27.263 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.263 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.263 [2024-11-29 17:05:38.590606] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:27.263 [2024-11-29 17:05:38.590745] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:27.263 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.263 17:05:38 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.oWwSvrEciR 00:23:27.263 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.263 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.263 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.263 17:05:38 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.oWwSvrEciR 00:23:27.263 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.263 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.263 [2024-11-29 17:05:38.606647] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:27.263 nvme0n1 00:23:27.263 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.263 17:05:38 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:27.263 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.263 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.263 [ 00:23:27.263 { 00:23:27.263 "name": "nvme0n1", 00:23:27.263 "aliases": [ 00:23:27.263 "69186304-0c95-4d0a-a3f0-afcecfb6b80a" 00:23:27.263 ], 00:23:27.263 "product_name": "NVMe disk", 00:23:27.263 "block_size": 512, 00:23:27.263 "num_blocks": 2097152, 00:23:27.263 "uuid": "69186304-0c95-4d0a-a3f0-afcecfb6b80a", 00:23:27.263 "assigned_rate_limits": { 00:23:27.263 "rw_ios_per_sec": 0, 00:23:27.263 "rw_mbytes_per_sec": 0, 00:23:27.263 "r_mbytes_per_sec": 0, 00:23:27.263 "w_mbytes_per_sec": 0 00:23:27.263 }, 00:23:27.263 "claimed": false, 00:23:27.263 "zoned": false, 00:23:27.263 "supported_io_types": { 00:23:27.263 "read": true, 00:23:27.263 "write": true, 00:23:27.263 "unmap": false, 00:23:27.263 "write_zeroes": true, 00:23:27.263 "flush": true, 00:23:27.263 "reset": true, 00:23:27.263 "compare": true, 00:23:27.263 "compare_and_write": true, 00:23:27.263 "abort": true, 00:23:27.263 "nvme_admin": true, 00:23:27.263 "nvme_io": true 00:23:27.263 }, 00:23:27.263 "driver_specific": { 00:23:27.263 "nvme": [ 00:23:27.263 { 00:23:27.263 "trid": { 00:23:27.263 "trtype": "TCP", 00:23:27.263 "adrfam": "IPv4", 00:23:27.263 "traddr": "10.0.0.2", 00:23:27.263 "trsvcid": "4421", 00:23:27.263 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:27.263 }, 00:23:27.263 "ctrlr_data": { 00:23:27.263 "cntlid": 3, 00:23:27.263 "vendor_id": "0x8086", 00:23:27.263 "model_number": "SPDK bdev Controller", 00:23:27.263 "serial_number": "00000000000000000000", 00:23:27.263 "firmware_revision": "24.01.1", 00:23:27.263 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:27.263 "oacs": { 00:23:27.263 "security": 0, 00:23:27.263 "format": 0, 00:23:27.263 "firmware": 0, 00:23:27.263 "ns_manage": 0 00:23:27.263 }, 00:23:27.263 "multi_ctrlr": true, 00:23:27.263 "ana_reporting": false 00:23:27.263 }, 00:23:27.263 "vs": { 00:23:27.263 "nvme_version": "1.3" 00:23:27.263 }, 00:23:27.263 "ns_data": { 00:23:27.263 "id": 1, 00:23:27.263 "can_share": true 00:23:27.263 } 00:23:27.263 } 00:23:27.263 ], 00:23:27.263 "mp_policy": "active_passive" 00:23:27.263 } 00:23:27.263 } 00:23:27.263 ] 00:23:27.263 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.263 17:05:38 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:27.263 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.263 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:23:27.521 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.521 17:05:38 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.oWwSvrEciR 00:23:27.521 17:05:38 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:27.521 17:05:38 -- host/async_init.sh@78 -- # nvmftestfini 00:23:27.521 17:05:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:27.521 17:05:38 -- nvmf/common.sh@116 -- # sync 00:23:27.521 17:05:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:27.521 17:05:38 -- nvmf/common.sh@119 -- # set +e 00:23:27.521 17:05:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:27.521 17:05:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:27.521 rmmod nvme_tcp 00:23:27.521 rmmod nvme_fabrics 00:23:27.521 rmmod nvme_keyring 00:23:27.521 17:05:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:27.521 17:05:38 -- nvmf/common.sh@123 -- # set -e 00:23:27.521 17:05:38 -- nvmf/common.sh@124 -- # return 0 00:23:27.521 17:05:38 -- nvmf/common.sh@477 -- # '[' -n 279877 ']' 00:23:27.521 17:05:38 -- nvmf/common.sh@478 -- # killprocess 279877 00:23:27.521 17:05:38 -- common/autotest_common.sh@936 -- # '[' -z 279877 ']' 00:23:27.521 17:05:38 -- common/autotest_common.sh@940 -- # kill -0 279877 00:23:27.521 17:05:38 -- common/autotest_common.sh@941 -- # uname 00:23:27.521 17:05:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:27.521 17:05:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 279877 00:23:27.521 17:05:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:27.521 17:05:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:27.521 17:05:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 279877' 00:23:27.521 killing process with pid 279877 00:23:27.521 17:05:38 -- common/autotest_common.sh@955 -- # kill 279877 00:23:27.521 17:05:38 -- common/autotest_common.sh@960 -- # wait 279877 00:23:27.779 17:05:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:27.779 17:05:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:27.779 17:05:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:27.779 17:05:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:27.779 17:05:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:27.779 17:05:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:27.779 17:05:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:27.779 17:05:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:29.684 17:05:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:29.684 00:23:29.684 real 0m6.225s 00:23:29.684 user 0m3.026s 00:23:29.684 sys 0m1.817s 00:23:29.684 17:05:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:29.684 17:05:41 -- common/autotest_common.sh@10 -- # set +x 00:23:29.684 ************************************ 00:23:29.684 END TEST nvmf_async_init 00:23:29.684 ************************************ 00:23:29.684 17:05:41 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:29.684 17:05:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:29.684 17:05:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:29.684 17:05:41 -- common/autotest_common.sh@10 -- # set +x 00:23:29.684 ************************************ 00:23:29.684 START TEST dma 00:23:29.684 ************************************ 00:23:29.684 17:05:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:29.943 * Looking for test storage... 00:23:29.943 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:29.943 17:05:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:29.943 17:05:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:29.943 17:05:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:29.943 17:05:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:29.943 17:05:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:29.943 17:05:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:29.943 17:05:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:29.943 17:05:41 -- scripts/common.sh@335 -- # IFS=.-: 00:23:29.943 17:05:41 -- scripts/common.sh@335 -- # read -ra ver1 00:23:29.943 17:05:41 -- scripts/common.sh@336 -- # IFS=.-: 00:23:29.943 17:05:41 -- scripts/common.sh@336 -- # read -ra ver2 00:23:29.943 17:05:41 -- scripts/common.sh@337 -- # local 'op=<' 00:23:29.943 17:05:41 -- scripts/common.sh@339 -- # ver1_l=2 00:23:29.943 17:05:41 -- scripts/common.sh@340 -- # ver2_l=1 00:23:29.943 17:05:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:29.943 17:05:41 -- scripts/common.sh@343 -- # case "$op" in 00:23:29.943 17:05:41 -- scripts/common.sh@344 -- # : 1 00:23:29.943 17:05:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:29.943 17:05:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:29.943 17:05:41 -- scripts/common.sh@364 -- # decimal 1 00:23:29.943 17:05:41 -- scripts/common.sh@352 -- # local d=1 00:23:29.943 17:05:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:29.943 17:05:41 -- scripts/common.sh@354 -- # echo 1 00:23:29.943 17:05:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:29.943 17:05:41 -- scripts/common.sh@365 -- # decimal 2 00:23:29.943 17:05:41 -- scripts/common.sh@352 -- # local d=2 00:23:29.943 17:05:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:29.943 17:05:41 -- scripts/common.sh@354 -- # echo 2 00:23:29.943 17:05:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:29.943 17:05:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:29.943 17:05:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:29.944 17:05:41 -- scripts/common.sh@367 -- # return 0 00:23:29.944 17:05:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:29.944 17:05:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:29.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.944 --rc genhtml_branch_coverage=1 00:23:29.944 --rc genhtml_function_coverage=1 00:23:29.944 --rc genhtml_legend=1 00:23:29.944 --rc geninfo_all_blocks=1 00:23:29.944 --rc geninfo_unexecuted_blocks=1 00:23:29.944 00:23:29.944 ' 00:23:29.944 17:05:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:29.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.944 --rc genhtml_branch_coverage=1 00:23:29.944 --rc genhtml_function_coverage=1 00:23:29.944 --rc genhtml_legend=1 00:23:29.944 --rc geninfo_all_blocks=1 00:23:29.944 --rc geninfo_unexecuted_blocks=1 00:23:29.944 00:23:29.944 ' 00:23:29.944 17:05:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:29.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.944 --rc genhtml_branch_coverage=1 00:23:29.944 --rc genhtml_function_coverage=1 00:23:29.944 --rc genhtml_legend=1 00:23:29.944 --rc geninfo_all_blocks=1 00:23:29.944 --rc geninfo_unexecuted_blocks=1 00:23:29.944 00:23:29.944 ' 00:23:29.944 17:05:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:29.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.944 --rc genhtml_branch_coverage=1 00:23:29.944 --rc genhtml_function_coverage=1 00:23:29.944 --rc genhtml_legend=1 00:23:29.944 --rc geninfo_all_blocks=1 00:23:29.944 --rc geninfo_unexecuted_blocks=1 00:23:29.944 00:23:29.944 ' 00:23:29.944 17:05:41 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:29.944 17:05:41 -- nvmf/common.sh@7 -- # uname -s 00:23:29.944 17:05:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:29.944 17:05:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:29.944 17:05:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:29.944 17:05:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:29.944 17:05:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:29.944 17:05:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:29.944 17:05:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:29.944 17:05:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:29.944 17:05:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:29.944 17:05:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:29.944 17:05:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:29.944 17:05:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:29.944 17:05:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:29.944 17:05:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:29.944 17:05:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:29.944 17:05:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:29.944 17:05:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:29.944 17:05:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:29.944 17:05:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:29.944 17:05:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:29.944 17:05:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:29.944 17:05:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:29.944 17:05:41 -- paths/export.sh@5 -- # export PATH 00:23:29.944 17:05:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:29.944 17:05:41 -- nvmf/common.sh@46 -- # : 0 00:23:29.944 17:05:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:29.944 17:05:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:29.944 17:05:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:29.944 17:05:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:29.944 17:05:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:29.944 17:05:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:29.944 17:05:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:29.944 17:05:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:29.944 17:05:41 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:29.944 17:05:41 -- host/dma.sh@13 -- # exit 0 00:23:29.944 00:23:29.944 real 0m0.155s 00:23:29.944 user 0m0.112s 00:23:29.944 sys 0m0.051s 00:23:29.944 17:05:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:29.944 17:05:41 -- common/autotest_common.sh@10 -- # set +x 00:23:29.944 ************************************ 00:23:29.944 END TEST dma 00:23:29.944 ************************************ 00:23:29.944 17:05:41 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:29.944 17:05:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:29.944 17:05:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:29.944 17:05:41 -- common/autotest_common.sh@10 -- # set +x 00:23:29.944 ************************************ 00:23:29.944 START TEST nvmf_identify 00:23:29.944 ************************************ 00:23:29.944 17:05:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:29.944 * Looking for test storage... 00:23:29.944 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:29.944 17:05:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:29.944 17:05:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:29.944 17:05:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:30.203 17:05:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:30.203 17:05:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:30.203 17:05:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:30.203 17:05:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:30.203 17:05:41 -- scripts/common.sh@335 -- # IFS=.-: 00:23:30.203 17:05:41 -- scripts/common.sh@335 -- # read -ra ver1 00:23:30.203 17:05:41 -- scripts/common.sh@336 -- # IFS=.-: 00:23:30.203 17:05:41 -- scripts/common.sh@336 -- # read -ra ver2 00:23:30.203 17:05:41 -- scripts/common.sh@337 -- # local 'op=<' 00:23:30.203 17:05:41 -- scripts/common.sh@339 -- # ver1_l=2 00:23:30.203 17:05:41 -- scripts/common.sh@340 -- # ver2_l=1 00:23:30.203 17:05:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:30.203 17:05:41 -- scripts/common.sh@343 -- # case "$op" in 00:23:30.203 17:05:41 -- scripts/common.sh@344 -- # : 1 00:23:30.203 17:05:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:30.203 17:05:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:30.203 17:05:41 -- scripts/common.sh@364 -- # decimal 1 00:23:30.203 17:05:41 -- scripts/common.sh@352 -- # local d=1 00:23:30.203 17:05:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:30.203 17:05:41 -- scripts/common.sh@354 -- # echo 1 00:23:30.203 17:05:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:30.203 17:05:41 -- scripts/common.sh@365 -- # decimal 2 00:23:30.203 17:05:41 -- scripts/common.sh@352 -- # local d=2 00:23:30.203 17:05:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:30.203 17:05:41 -- scripts/common.sh@354 -- # echo 2 00:23:30.203 17:05:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:30.203 17:05:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:30.203 17:05:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:30.203 17:05:41 -- scripts/common.sh@367 -- # return 0 00:23:30.203 17:05:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:30.203 17:05:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:30.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:30.203 --rc genhtml_branch_coverage=1 00:23:30.203 --rc genhtml_function_coverage=1 00:23:30.203 --rc genhtml_legend=1 00:23:30.203 --rc geninfo_all_blocks=1 00:23:30.203 --rc geninfo_unexecuted_blocks=1 00:23:30.203 00:23:30.203 ' 00:23:30.203 17:05:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:30.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:30.203 --rc genhtml_branch_coverage=1 00:23:30.203 --rc genhtml_function_coverage=1 00:23:30.203 --rc genhtml_legend=1 00:23:30.203 --rc geninfo_all_blocks=1 00:23:30.203 --rc geninfo_unexecuted_blocks=1 00:23:30.203 00:23:30.203 ' 00:23:30.203 17:05:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:30.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:30.203 --rc genhtml_branch_coverage=1 00:23:30.203 --rc genhtml_function_coverage=1 00:23:30.203 --rc genhtml_legend=1 00:23:30.203 --rc geninfo_all_blocks=1 00:23:30.203 --rc geninfo_unexecuted_blocks=1 00:23:30.203 00:23:30.203 ' 00:23:30.203 17:05:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:30.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:30.203 --rc genhtml_branch_coverage=1 00:23:30.203 --rc genhtml_function_coverage=1 00:23:30.203 --rc genhtml_legend=1 00:23:30.203 --rc geninfo_all_blocks=1 00:23:30.203 --rc geninfo_unexecuted_blocks=1 00:23:30.203 00:23:30.203 ' 00:23:30.203 17:05:41 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:30.203 17:05:41 -- nvmf/common.sh@7 -- # uname -s 00:23:30.203 17:05:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:30.203 17:05:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:30.203 17:05:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:30.203 17:05:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:30.203 17:05:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:30.204 17:05:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:30.204 17:05:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:30.204 17:05:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:30.204 17:05:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:30.204 17:05:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:30.204 17:05:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:30.204 17:05:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:30.204 17:05:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:30.204 17:05:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:30.204 17:05:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:30.204 17:05:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:30.204 17:05:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:30.204 17:05:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:30.204 17:05:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:30.204 17:05:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:30.204 17:05:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:30.204 17:05:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:30.204 17:05:41 -- paths/export.sh@5 -- # export PATH 00:23:30.204 17:05:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:30.204 17:05:41 -- nvmf/common.sh@46 -- # : 0 00:23:30.204 17:05:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:30.204 17:05:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:30.204 17:05:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:30.204 17:05:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:30.204 17:05:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:30.204 17:05:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:30.204 17:05:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:30.204 17:05:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:30.204 17:05:41 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:30.204 17:05:41 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:30.204 17:05:41 -- host/identify.sh@14 -- # nvmftestinit 00:23:30.204 17:05:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:30.204 17:05:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:30.204 17:05:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:30.204 17:05:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:30.204 17:05:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:30.204 17:05:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:30.204 17:05:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:30.204 17:05:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:30.204 17:05:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:30.204 17:05:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:30.204 17:05:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:30.204 17:05:41 -- common/autotest_common.sh@10 -- # set +x 00:23:32.106 17:05:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:32.106 17:05:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:32.106 17:05:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:32.106 17:05:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:32.106 17:05:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:32.106 17:05:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:32.106 17:05:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:32.106 17:05:43 -- nvmf/common.sh@294 -- # net_devs=() 00:23:32.106 17:05:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:32.106 17:05:43 -- nvmf/common.sh@295 -- # e810=() 00:23:32.106 17:05:43 -- nvmf/common.sh@295 -- # local -ga e810 00:23:32.106 17:05:43 -- nvmf/common.sh@296 -- # x722=() 00:23:32.106 17:05:43 -- nvmf/common.sh@296 -- # local -ga x722 00:23:32.106 17:05:43 -- nvmf/common.sh@297 -- # mlx=() 00:23:32.106 17:05:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:32.106 17:05:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:32.106 17:05:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:32.106 17:05:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:32.106 17:05:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:32.106 17:05:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:32.106 17:05:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:32.106 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:32.106 17:05:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:32.106 17:05:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:32.106 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:32.106 17:05:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:32.106 17:05:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:32.106 17:05:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:32.106 17:05:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:32.106 17:05:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:32.106 17:05:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:32.106 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:32.106 17:05:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:32.106 17:05:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:32.106 17:05:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:32.106 17:05:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:32.106 17:05:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:32.106 17:05:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:32.106 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:32.106 17:05:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:32.106 17:05:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:32.106 17:05:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:32.106 17:05:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:32.106 17:05:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:32.106 17:05:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:32.106 17:05:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:32.106 17:05:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:32.106 17:05:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:32.106 17:05:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:32.106 17:05:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:32.106 17:05:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:32.106 17:05:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:32.106 17:05:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:32.106 17:05:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:32.106 17:05:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:32.106 17:05:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:32.365 17:05:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:32.365 17:05:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:32.365 17:05:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:32.365 17:05:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:32.365 17:05:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:32.365 17:05:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:32.365 17:05:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:32.365 17:05:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:32.365 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:32.365 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:23:32.365 00:23:32.365 --- 10.0.0.2 ping statistics --- 00:23:32.365 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:32.365 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:23:32.365 17:05:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:32.365 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:32.365 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:23:32.365 00:23:32.365 --- 10.0.0.1 ping statistics --- 00:23:32.365 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:32.365 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:23:32.365 17:05:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:32.365 17:05:43 -- nvmf/common.sh@410 -- # return 0 00:23:32.365 17:05:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:32.365 17:05:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:32.365 17:05:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:32.365 17:05:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:32.365 17:05:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:32.365 17:05:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:32.365 17:05:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:32.365 17:05:43 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:32.365 17:05:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:32.365 17:05:43 -- common/autotest_common.sh@10 -- # set +x 00:23:32.365 17:05:43 -- host/identify.sh@19 -- # nvmfpid=282146 00:23:32.365 17:05:43 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:32.365 17:05:43 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:32.365 17:05:43 -- host/identify.sh@23 -- # waitforlisten 282146 00:23:32.365 17:05:43 -- common/autotest_common.sh@829 -- # '[' -z 282146 ']' 00:23:32.365 17:05:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:32.365 17:05:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:32.365 17:05:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:32.365 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:32.365 17:05:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:32.365 17:05:43 -- common/autotest_common.sh@10 -- # set +x 00:23:32.365 [2024-11-29 17:05:43.725912] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:32.365 [2024-11-29 17:05:43.726016] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:32.365 EAL: No free 2048 kB hugepages reported on node 1 00:23:32.365 [2024-11-29 17:05:43.793443] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:32.623 [2024-11-29 17:05:43.907492] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:32.623 [2024-11-29 17:05:43.907634] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:32.623 [2024-11-29 17:05:43.907652] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:32.623 [2024-11-29 17:05:43.907665] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:32.623 [2024-11-29 17:05:43.907720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:32.623 [2024-11-29 17:05:43.907780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:32.623 [2024-11-29 17:05:43.907829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:32.623 [2024-11-29 17:05:43.907832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:33.588 17:05:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:33.588 17:05:44 -- common/autotest_common.sh@862 -- # return 0 00:23:33.588 17:05:44 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:33.588 17:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.588 17:05:44 -- common/autotest_common.sh@10 -- # set +x 00:23:33.588 [2024-11-29 17:05:44.760706] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:33.588 17:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.588 17:05:44 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:33.588 17:05:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:33.588 17:05:44 -- common/autotest_common.sh@10 -- # set +x 00:23:33.588 17:05:44 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:33.588 17:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.588 17:05:44 -- common/autotest_common.sh@10 -- # set +x 00:23:33.588 Malloc0 00:23:33.588 17:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.588 17:05:44 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:33.588 17:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.588 17:05:44 -- common/autotest_common.sh@10 -- # set +x 00:23:33.588 17:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.588 17:05:44 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:33.588 17:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.588 17:05:44 -- common/autotest_common.sh@10 -- # set +x 00:23:33.588 17:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.588 17:05:44 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:33.588 17:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.588 17:05:44 -- common/autotest_common.sh@10 -- # set +x 00:23:33.588 [2024-11-29 17:05:44.836309] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:33.588 17:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.588 17:05:44 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:33.588 17:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.588 17:05:44 -- common/autotest_common.sh@10 -- # set +x 00:23:33.588 17:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.588 17:05:44 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:33.588 17:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.588 17:05:44 -- common/autotest_common.sh@10 -- # set +x 00:23:33.588 [2024-11-29 17:05:44.852012] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:33.588 [ 00:23:33.588 { 00:23:33.588 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:33.588 "subtype": "Discovery", 00:23:33.588 "listen_addresses": [ 00:23:33.588 { 00:23:33.588 "transport": "TCP", 00:23:33.588 "trtype": "TCP", 00:23:33.588 "adrfam": "IPv4", 00:23:33.588 "traddr": "10.0.0.2", 00:23:33.588 "trsvcid": "4420" 00:23:33.588 } 00:23:33.588 ], 00:23:33.588 "allow_any_host": true, 00:23:33.588 "hosts": [] 00:23:33.588 }, 00:23:33.588 { 00:23:33.588 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:33.588 "subtype": "NVMe", 00:23:33.588 "listen_addresses": [ 00:23:33.588 { 00:23:33.588 "transport": "TCP", 00:23:33.588 "trtype": "TCP", 00:23:33.588 "adrfam": "IPv4", 00:23:33.588 "traddr": "10.0.0.2", 00:23:33.588 "trsvcid": "4420" 00:23:33.588 } 00:23:33.588 ], 00:23:33.588 "allow_any_host": true, 00:23:33.588 "hosts": [], 00:23:33.588 "serial_number": "SPDK00000000000001", 00:23:33.588 "model_number": "SPDK bdev Controller", 00:23:33.588 "max_namespaces": 32, 00:23:33.588 "min_cntlid": 1, 00:23:33.588 "max_cntlid": 65519, 00:23:33.588 "namespaces": [ 00:23:33.588 { 00:23:33.588 "nsid": 1, 00:23:33.589 "bdev_name": "Malloc0", 00:23:33.589 "name": "Malloc0", 00:23:33.589 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:33.589 "eui64": "ABCDEF0123456789", 00:23:33.589 "uuid": "1952a133-85a6-4ea9-8f4f-540726bbfa37" 00:23:33.589 } 00:23:33.589 ] 00:23:33.589 } 00:23:33.589 ] 00:23:33.589 17:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.589 17:05:44 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:33.589 [2024-11-29 17:05:44.877469] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:33.589 [2024-11-29 17:05:44.877514] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid282305 ] 00:23:33.589 EAL: No free 2048 kB hugepages reported on node 1 00:23:33.589 [2024-11-29 17:05:44.912397] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:33.589 [2024-11-29 17:05:44.912468] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:33.589 [2024-11-29 17:05:44.912479] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:33.589 [2024-11-29 17:05:44.912496] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:33.589 [2024-11-29 17:05:44.912510] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:33.589 [2024-11-29 17:05:44.912800] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:33.589 [2024-11-29 17:05:44.912889] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x166de10 0 00:23:33.589 [2024-11-29 17:05:44.918977] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:33.589 [2024-11-29 17:05:44.919000] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:33.589 [2024-11-29 17:05:44.919016] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:33.589 [2024-11-29 17:05:44.919022] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:33.589 [2024-11-29 17:05:44.919074] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.919088] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.919096] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.589 [2024-11-29 17:05:44.919116] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:33.589 [2024-11-29 17:05:44.919145] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.589 [2024-11-29 17:05:44.926971] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.589 [2024-11-29 17:05:44.926990] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.589 [2024-11-29 17:05:44.926998] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927007] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edb30) on tqpair=0x166de10 00:23:33.589 [2024-11-29 17:05:44.927036] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:33.589 [2024-11-29 17:05:44.927048] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:33.589 [2024-11-29 17:05:44.927057] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:33.589 [2024-11-29 17:05:44.927078] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927087] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927093] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.589 [2024-11-29 17:05:44.927109] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.589 [2024-11-29 17:05:44.927135] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.589 [2024-11-29 17:05:44.927288] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.589 [2024-11-29 17:05:44.927300] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.589 [2024-11-29 17:05:44.927306] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927313] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edb30) on tqpair=0x166de10 00:23:33.589 [2024-11-29 17:05:44.927324] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:33.589 [2024-11-29 17:05:44.927336] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:33.589 [2024-11-29 17:05:44.927349] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927356] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927362] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.589 [2024-11-29 17:05:44.927373] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.589 [2024-11-29 17:05:44.927394] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.589 [2024-11-29 17:05:44.927483] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.589 [2024-11-29 17:05:44.927495] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.589 [2024-11-29 17:05:44.927502] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927508] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edb30) on tqpair=0x166de10 00:23:33.589 [2024-11-29 17:05:44.927519] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:33.589 [2024-11-29 17:05:44.927533] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:33.589 [2024-11-29 17:05:44.927545] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927552] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927558] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.589 [2024-11-29 17:05:44.927568] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.589 [2024-11-29 17:05:44.927589] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.589 [2024-11-29 17:05:44.927659] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.589 [2024-11-29 17:05:44.927671] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.589 [2024-11-29 17:05:44.927678] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927684] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edb30) on tqpair=0x166de10 00:23:33.589 [2024-11-29 17:05:44.927694] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:33.589 [2024-11-29 17:05:44.927710] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927719] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927725] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.589 [2024-11-29 17:05:44.927735] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.589 [2024-11-29 17:05:44.927761] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.589 [2024-11-29 17:05:44.927835] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.589 [2024-11-29 17:05:44.927847] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.589 [2024-11-29 17:05:44.927854] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.927860] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edb30) on tqpair=0x166de10 00:23:33.589 [2024-11-29 17:05:44.927870] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:33.589 [2024-11-29 17:05:44.927879] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:33.589 [2024-11-29 17:05:44.927891] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:33.589 [2024-11-29 17:05:44.928002] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:33.589 [2024-11-29 17:05:44.928012] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:33.589 [2024-11-29 17:05:44.928028] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.928035] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.928042] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.589 [2024-11-29 17:05:44.928052] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.589 [2024-11-29 17:05:44.928073] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.589 [2024-11-29 17:05:44.928193] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.589 [2024-11-29 17:05:44.928207] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.589 [2024-11-29 17:05:44.928214] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.928220] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edb30) on tqpair=0x166de10 00:23:33.589 [2024-11-29 17:05:44.928230] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:33.589 [2024-11-29 17:05:44.928246] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.928255] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.928261] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.589 [2024-11-29 17:05:44.928271] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.589 [2024-11-29 17:05:44.928292] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.589 [2024-11-29 17:05:44.928362] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.589 [2024-11-29 17:05:44.928374] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.589 [2024-11-29 17:05:44.928381] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.589 [2024-11-29 17:05:44.928387] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edb30) on tqpair=0x166de10 00:23:33.589 [2024-11-29 17:05:44.928397] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:33.589 [2024-11-29 17:05:44.928405] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:33.590 [2024-11-29 17:05:44.928418] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:33.590 [2024-11-29 17:05:44.928436] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:33.590 [2024-11-29 17:05:44.928453] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.928460] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.928467] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.928478] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.590 [2024-11-29 17:05:44.928499] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.590 [2024-11-29 17:05:44.928634] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.590 [2024-11-29 17:05:44.928647] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.590 [2024-11-29 17:05:44.928654] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.928661] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x166de10): datao=0, datal=4096, cccid=0 00:23:33.590 [2024-11-29 17:05:44.928669] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16edb30) on tqpair(0x166de10): expected_datao=0, payload_size=4096 00:23:33.590 [2024-11-29 17:05:44.928691] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.928702] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.928715] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.590 [2024-11-29 17:05:44.928725] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.590 [2024-11-29 17:05:44.928732] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.928738] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edb30) on tqpair=0x166de10 00:23:33.590 [2024-11-29 17:05:44.928752] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:33.590 [2024-11-29 17:05:44.928762] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:33.590 [2024-11-29 17:05:44.928769] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:33.590 [2024-11-29 17:05:44.928778] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:33.590 [2024-11-29 17:05:44.928786] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:33.590 [2024-11-29 17:05:44.928794] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:33.590 [2024-11-29 17:05:44.928813] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:33.590 [2024-11-29 17:05:44.928828] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.928835] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.928841] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.928852] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:33.590 [2024-11-29 17:05:44.928874] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.590 [2024-11-29 17:05:44.928975] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.590 [2024-11-29 17:05:44.928993] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.590 [2024-11-29 17:05:44.929000] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929007] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edb30) on tqpair=0x166de10 00:23:33.590 [2024-11-29 17:05:44.929026] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929035] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929041] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.929051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.590 [2024-11-29 17:05:44.929061] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929068] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929074] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.929083] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.590 [2024-11-29 17:05:44.929093] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929100] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929106] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.929114] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.590 [2024-11-29 17:05:44.929124] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929131] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929137] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.929145] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.590 [2024-11-29 17:05:44.929154] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:33.590 [2024-11-29 17:05:44.929174] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:33.590 [2024-11-29 17:05:44.929187] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929194] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929200] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.929210] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.590 [2024-11-29 17:05:44.929234] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edb30, cid 0, qid 0 00:23:33.590 [2024-11-29 17:05:44.929245] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edc90, cid 1, qid 0 00:23:33.590 [2024-11-29 17:05:44.929253] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16eddf0, cid 2, qid 0 00:23:33.590 [2024-11-29 17:05:44.929260] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.590 [2024-11-29 17:05:44.929267] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16ee0b0, cid 4, qid 0 00:23:33.590 [2024-11-29 17:05:44.929405] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.590 [2024-11-29 17:05:44.929417] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.590 [2024-11-29 17:05:44.929424] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929430] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16ee0b0) on tqpair=0x166de10 00:23:33.590 [2024-11-29 17:05:44.929441] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:33.590 [2024-11-29 17:05:44.929450] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:33.590 [2024-11-29 17:05:44.929471] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929481] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929487] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.929498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.590 [2024-11-29 17:05:44.929518] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16ee0b0, cid 4, qid 0 00:23:33.590 [2024-11-29 17:05:44.929618] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.590 [2024-11-29 17:05:44.929632] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.590 [2024-11-29 17:05:44.929638] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929645] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x166de10): datao=0, datal=4096, cccid=4 00:23:33.590 [2024-11-29 17:05:44.929652] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16ee0b0) on tqpair(0x166de10): expected_datao=0, payload_size=4096 00:23:33.590 [2024-11-29 17:05:44.929663] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929670] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929682] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.590 [2024-11-29 17:05:44.929692] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.590 [2024-11-29 17:05:44.929698] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929705] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16ee0b0) on tqpair=0x166de10 00:23:33.590 [2024-11-29 17:05:44.929725] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:33.590 [2024-11-29 17:05:44.929764] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929775] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929781] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.929792] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.590 [2024-11-29 17:05:44.929804] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929811] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.929817] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x166de10) 00:23:33.590 [2024-11-29 17:05:44.929826] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.590 [2024-11-29 17:05:44.929853] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16ee0b0, cid 4, qid 0 00:23:33.590 [2024-11-29 17:05:44.929865] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16ee210, cid 5, qid 0 00:23:33.590 [2024-11-29 17:05:44.930007] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.590 [2024-11-29 17:05:44.930023] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.590 [2024-11-29 17:05:44.930029] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.590 [2024-11-29 17:05:44.930036] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x166de10): datao=0, datal=1024, cccid=4 00:23:33.590 [2024-11-29 17:05:44.930043] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16ee0b0) on tqpair(0x166de10): expected_datao=0, payload_size=1024 00:23:33.590 [2024-11-29 17:05:44.930054] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.930061] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.930070] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.591 [2024-11-29 17:05:44.930078] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.591 [2024-11-29 17:05:44.930089] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.930096] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16ee210) on tqpair=0x166de10 00:23:33.591 [2024-11-29 17:05:44.974976] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.591 [2024-11-29 17:05:44.974995] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.591 [2024-11-29 17:05:44.975003] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975009] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16ee0b0) on tqpair=0x166de10 00:23:33.591 [2024-11-29 17:05:44.975030] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975038] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975045] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x166de10) 00:23:33.591 [2024-11-29 17:05:44.975056] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.591 [2024-11-29 17:05:44.975100] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16ee0b0, cid 4, qid 0 00:23:33.591 [2024-11-29 17:05:44.975240] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.591 [2024-11-29 17:05:44.975255] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.591 [2024-11-29 17:05:44.975261] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975268] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x166de10): datao=0, datal=3072, cccid=4 00:23:33.591 [2024-11-29 17:05:44.975275] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16ee0b0) on tqpair(0x166de10): expected_datao=0, payload_size=3072 00:23:33.591 [2024-11-29 17:05:44.975287] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975294] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975306] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.591 [2024-11-29 17:05:44.975315] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.591 [2024-11-29 17:05:44.975322] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975328] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16ee0b0) on tqpair=0x166de10 00:23:33.591 [2024-11-29 17:05:44.975345] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975354] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975361] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x166de10) 00:23:33.591 [2024-11-29 17:05:44.975371] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.591 [2024-11-29 17:05:44.975400] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16ee0b0, cid 4, qid 0 00:23:33.591 [2024-11-29 17:05:44.975489] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.591 [2024-11-29 17:05:44.975501] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.591 [2024-11-29 17:05:44.975508] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975514] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x166de10): datao=0, datal=8, cccid=4 00:23:33.591 [2024-11-29 17:05:44.975521] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16ee0b0) on tqpair(0x166de10): expected_datao=0, payload_size=8 00:23:33.591 [2024-11-29 17:05:44.975532] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.591 [2024-11-29 17:05:44.975539] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.885 [2024-11-29 17:05:45.016069] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.885 [2024-11-29 17:05:45.016090] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.885 [2024-11-29 17:05:45.016098] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.885 [2024-11-29 17:05:45.016111] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16ee0b0) on tqpair=0x166de10 00:23:33.885 ===================================================== 00:23:33.885 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:33.885 ===================================================== 00:23:33.885 Controller Capabilities/Features 00:23:33.885 ================================ 00:23:33.885 Vendor ID: 0000 00:23:33.885 Subsystem Vendor ID: 0000 00:23:33.885 Serial Number: .................... 00:23:33.885 Model Number: ........................................ 00:23:33.885 Firmware Version: 24.01.1 00:23:33.885 Recommended Arb Burst: 0 00:23:33.885 IEEE OUI Identifier: 00 00 00 00:23:33.885 Multi-path I/O 00:23:33.885 May have multiple subsystem ports: No 00:23:33.885 May have multiple controllers: No 00:23:33.885 Associated with SR-IOV VF: No 00:23:33.885 Max Data Transfer Size: 131072 00:23:33.885 Max Number of Namespaces: 0 00:23:33.885 Max Number of I/O Queues: 1024 00:23:33.885 NVMe Specification Version (VS): 1.3 00:23:33.885 NVMe Specification Version (Identify): 1.3 00:23:33.885 Maximum Queue Entries: 128 00:23:33.885 Contiguous Queues Required: Yes 00:23:33.885 Arbitration Mechanisms Supported 00:23:33.885 Weighted Round Robin: Not Supported 00:23:33.885 Vendor Specific: Not Supported 00:23:33.885 Reset Timeout: 15000 ms 00:23:33.885 Doorbell Stride: 4 bytes 00:23:33.885 NVM Subsystem Reset: Not Supported 00:23:33.885 Command Sets Supported 00:23:33.885 NVM Command Set: Supported 00:23:33.885 Boot Partition: Not Supported 00:23:33.885 Memory Page Size Minimum: 4096 bytes 00:23:33.885 Memory Page Size Maximum: 4096 bytes 00:23:33.885 Persistent Memory Region: Not Supported 00:23:33.885 Optional Asynchronous Events Supported 00:23:33.885 Namespace Attribute Notices: Not Supported 00:23:33.885 Firmware Activation Notices: Not Supported 00:23:33.885 ANA Change Notices: Not Supported 00:23:33.885 PLE Aggregate Log Change Notices: Not Supported 00:23:33.885 LBA Status Info Alert Notices: Not Supported 00:23:33.885 EGE Aggregate Log Change Notices: Not Supported 00:23:33.885 Normal NVM Subsystem Shutdown event: Not Supported 00:23:33.885 Zone Descriptor Change Notices: Not Supported 00:23:33.885 Discovery Log Change Notices: Supported 00:23:33.885 Controller Attributes 00:23:33.885 128-bit Host Identifier: Not Supported 00:23:33.885 Non-Operational Permissive Mode: Not Supported 00:23:33.885 NVM Sets: Not Supported 00:23:33.885 Read Recovery Levels: Not Supported 00:23:33.885 Endurance Groups: Not Supported 00:23:33.885 Predictable Latency Mode: Not Supported 00:23:33.885 Traffic Based Keep ALive: Not Supported 00:23:33.885 Namespace Granularity: Not Supported 00:23:33.885 SQ Associations: Not Supported 00:23:33.885 UUID List: Not Supported 00:23:33.885 Multi-Domain Subsystem: Not Supported 00:23:33.885 Fixed Capacity Management: Not Supported 00:23:33.885 Variable Capacity Management: Not Supported 00:23:33.885 Delete Endurance Group: Not Supported 00:23:33.885 Delete NVM Set: Not Supported 00:23:33.885 Extended LBA Formats Supported: Not Supported 00:23:33.885 Flexible Data Placement Supported: Not Supported 00:23:33.885 00:23:33.885 Controller Memory Buffer Support 00:23:33.885 ================================ 00:23:33.885 Supported: No 00:23:33.885 00:23:33.885 Persistent Memory Region Support 00:23:33.885 ================================ 00:23:33.885 Supported: No 00:23:33.885 00:23:33.885 Admin Command Set Attributes 00:23:33.885 ============================ 00:23:33.885 Security Send/Receive: Not Supported 00:23:33.885 Format NVM: Not Supported 00:23:33.885 Firmware Activate/Download: Not Supported 00:23:33.885 Namespace Management: Not Supported 00:23:33.885 Device Self-Test: Not Supported 00:23:33.885 Directives: Not Supported 00:23:33.885 NVMe-MI: Not Supported 00:23:33.885 Virtualization Management: Not Supported 00:23:33.885 Doorbell Buffer Config: Not Supported 00:23:33.885 Get LBA Status Capability: Not Supported 00:23:33.885 Command & Feature Lockdown Capability: Not Supported 00:23:33.885 Abort Command Limit: 1 00:23:33.885 Async Event Request Limit: 4 00:23:33.885 Number of Firmware Slots: N/A 00:23:33.885 Firmware Slot 1 Read-Only: N/A 00:23:33.885 Firmware Activation Without Reset: N/A 00:23:33.885 Multiple Update Detection Support: N/A 00:23:33.885 Firmware Update Granularity: No Information Provided 00:23:33.885 Per-Namespace SMART Log: No 00:23:33.885 Asymmetric Namespace Access Log Page: Not Supported 00:23:33.885 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:33.885 Command Effects Log Page: Not Supported 00:23:33.885 Get Log Page Extended Data: Supported 00:23:33.885 Telemetry Log Pages: Not Supported 00:23:33.885 Persistent Event Log Pages: Not Supported 00:23:33.885 Supported Log Pages Log Page: May Support 00:23:33.885 Commands Supported & Effects Log Page: Not Supported 00:23:33.885 Feature Identifiers & Effects Log Page:May Support 00:23:33.885 NVMe-MI Commands & Effects Log Page: May Support 00:23:33.885 Data Area 4 for Telemetry Log: Not Supported 00:23:33.885 Error Log Page Entries Supported: 128 00:23:33.885 Keep Alive: Not Supported 00:23:33.885 00:23:33.885 NVM Command Set Attributes 00:23:33.885 ========================== 00:23:33.885 Submission Queue Entry Size 00:23:33.885 Max: 1 00:23:33.885 Min: 1 00:23:33.885 Completion Queue Entry Size 00:23:33.885 Max: 1 00:23:33.885 Min: 1 00:23:33.885 Number of Namespaces: 0 00:23:33.885 Compare Command: Not Supported 00:23:33.885 Write Uncorrectable Command: Not Supported 00:23:33.885 Dataset Management Command: Not Supported 00:23:33.885 Write Zeroes Command: Not Supported 00:23:33.885 Set Features Save Field: Not Supported 00:23:33.885 Reservations: Not Supported 00:23:33.885 Timestamp: Not Supported 00:23:33.885 Copy: Not Supported 00:23:33.885 Volatile Write Cache: Not Present 00:23:33.885 Atomic Write Unit (Normal): 1 00:23:33.885 Atomic Write Unit (PFail): 1 00:23:33.885 Atomic Compare & Write Unit: 1 00:23:33.885 Fused Compare & Write: Supported 00:23:33.885 Scatter-Gather List 00:23:33.885 SGL Command Set: Supported 00:23:33.885 SGL Keyed: Supported 00:23:33.885 SGL Bit Bucket Descriptor: Not Supported 00:23:33.885 SGL Metadata Pointer: Not Supported 00:23:33.885 Oversized SGL: Not Supported 00:23:33.885 SGL Metadata Address: Not Supported 00:23:33.885 SGL Offset: Supported 00:23:33.885 Transport SGL Data Block: Not Supported 00:23:33.885 Replay Protected Memory Block: Not Supported 00:23:33.885 00:23:33.885 Firmware Slot Information 00:23:33.885 ========================= 00:23:33.885 Active slot: 0 00:23:33.885 00:23:33.885 00:23:33.885 Error Log 00:23:33.885 ========= 00:23:33.885 00:23:33.885 Active Namespaces 00:23:33.885 ================= 00:23:33.885 Discovery Log Page 00:23:33.885 ================== 00:23:33.885 Generation Counter: 2 00:23:33.885 Number of Records: 2 00:23:33.885 Record Format: 0 00:23:33.885 00:23:33.885 Discovery Log Entry 0 00:23:33.885 ---------------------- 00:23:33.885 Transport Type: 3 (TCP) 00:23:33.885 Address Family: 1 (IPv4) 00:23:33.885 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:33.885 Entry Flags: 00:23:33.885 Duplicate Returned Information: 1 00:23:33.885 Explicit Persistent Connection Support for Discovery: 1 00:23:33.885 Transport Requirements: 00:23:33.885 Secure Channel: Not Required 00:23:33.885 Port ID: 0 (0x0000) 00:23:33.886 Controller ID: 65535 (0xffff) 00:23:33.886 Admin Max SQ Size: 128 00:23:33.886 Transport Service Identifier: 4420 00:23:33.886 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:33.886 Transport Address: 10.0.0.2 00:23:33.886 Discovery Log Entry 1 00:23:33.886 ---------------------- 00:23:33.886 Transport Type: 3 (TCP) 00:23:33.886 Address Family: 1 (IPv4) 00:23:33.886 Subsystem Type: 2 (NVM Subsystem) 00:23:33.886 Entry Flags: 00:23:33.886 Duplicate Returned Information: 0 00:23:33.886 Explicit Persistent Connection Support for Discovery: 0 00:23:33.886 Transport Requirements: 00:23:33.886 Secure Channel: Not Required 00:23:33.886 Port ID: 0 (0x0000) 00:23:33.886 Controller ID: 65535 (0xffff) 00:23:33.886 Admin Max SQ Size: 128 00:23:33.886 Transport Service Identifier: 4420 00:23:33.886 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:33.886 Transport Address: 10.0.0.2 [2024-11-29 17:05:45.016224] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:33.886 [2024-11-29 17:05:45.016252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:33.886 [2024-11-29 17:05:45.016264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:33.886 [2024-11-29 17:05:45.016273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:33.886 [2024-11-29 17:05:45.016283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:33.886 [2024-11-29 17:05:45.016296] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016304] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016310] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.016322] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.016349] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.016460] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.016475] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.016481] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016488] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.016501] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016508] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016515] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.016525] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.016552] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.016654] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.016666] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.016673] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016679] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.016689] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:33.886 [2024-11-29 17:05:45.016697] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:33.886 [2024-11-29 17:05:45.016712] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016721] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016728] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.016738] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.016759] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.016842] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.016856] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.016863] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016874] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.016893] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016902] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.016908] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.016919] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.016940] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.017021] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.017034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.017041] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017047] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.017064] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017073] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017080] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.017090] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.017111] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.017181] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.017193] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.017199] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017206] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.017222] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017231] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017237] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.017248] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.017268] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.017339] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.017353] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.017360] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017366] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.017383] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017392] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017398] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.017408] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.017429] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.017503] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.017517] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.017523] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017530] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.017558] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017568] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017574] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.017585] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.017606] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.017680] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.017693] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.017700] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017706] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.017724] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017733] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017740] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.017750] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.017771] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.017847] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.017860] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.017867] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017873] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.017890] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017899] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.017905] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.886 [2024-11-29 17:05:45.017916] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.886 [2024-11-29 17:05:45.017937] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.886 [2024-11-29 17:05:45.018021] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.886 [2024-11-29 17:05:45.018035] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.886 [2024-11-29 17:05:45.018042] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.018048] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.886 [2024-11-29 17:05:45.018065] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.886 [2024-11-29 17:05:45.018074] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018081] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.887 [2024-11-29 17:05:45.018091] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.887 [2024-11-29 17:05:45.018112] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.887 [2024-11-29 17:05:45.018189] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.887 [2024-11-29 17:05:45.018201] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.887 [2024-11-29 17:05:45.018207] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018214] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.887 [2024-11-29 17:05:45.018235] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018245] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018252] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.887 [2024-11-29 17:05:45.018263] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.887 [2024-11-29 17:05:45.018285] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.887 [2024-11-29 17:05:45.018355] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.887 [2024-11-29 17:05:45.018367] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.887 [2024-11-29 17:05:45.018374] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018380] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.887 [2024-11-29 17:05:45.018396] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018406] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018412] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.887 [2024-11-29 17:05:45.018422] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.887 [2024-11-29 17:05:45.018443] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.887 [2024-11-29 17:05:45.018536] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.887 [2024-11-29 17:05:45.018551] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.887 [2024-11-29 17:05:45.018558] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018565] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.887 [2024-11-29 17:05:45.018581] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018590] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018596] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.887 [2024-11-29 17:05:45.018607] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.887 [2024-11-29 17:05:45.018627] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.887 [2024-11-29 17:05:45.018697] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.887 [2024-11-29 17:05:45.018709] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.887 [2024-11-29 17:05:45.018716] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018723] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.887 [2024-11-29 17:05:45.018740] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018749] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018755] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.887 [2024-11-29 17:05:45.018766] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.887 [2024-11-29 17:05:45.018786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.887 [2024-11-29 17:05:45.018856] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.887 [2024-11-29 17:05:45.018869] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.887 [2024-11-29 17:05:45.018875] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018882] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.887 [2024-11-29 17:05:45.018899] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018913] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.018920] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.887 [2024-11-29 17:05:45.018930] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.887 [2024-11-29 17:05:45.018951] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.887 [2024-11-29 17:05:45.022981] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.887 [2024-11-29 17:05:45.022995] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.887 [2024-11-29 17:05:45.023002] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.023009] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.887 [2024-11-29 17:05:45.023028] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.023037] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.023043] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x166de10) 00:23:33.887 [2024-11-29 17:05:45.023054] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.887 [2024-11-29 17:05:45.023077] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16edf50, cid 3, qid 0 00:23:33.887 [2024-11-29 17:05:45.023204] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.887 [2024-11-29 17:05:45.023217] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.887 [2024-11-29 17:05:45.023224] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.023230] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16edf50) on tqpair=0x166de10 00:23:33.887 [2024-11-29 17:05:45.023245] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:23:33.887 00:23:33.887 17:05:45 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:33.887 [2024-11-29 17:05:45.058510] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:33.887 [2024-11-29 17:05:45.058560] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid282324 ] 00:23:33.887 EAL: No free 2048 kB hugepages reported on node 1 00:23:33.887 [2024-11-29 17:05:45.092008] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:33.887 [2024-11-29 17:05:45.092057] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:33.887 [2024-11-29 17:05:45.092067] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:33.887 [2024-11-29 17:05:45.092082] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:33.887 [2024-11-29 17:05:45.092094] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:33.887 [2024-11-29 17:05:45.096017] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:33.887 [2024-11-29 17:05:45.096063] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x15fae10 0 00:23:33.887 [2024-11-29 17:05:45.103977] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:33.887 [2024-11-29 17:05:45.103996] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:33.887 [2024-11-29 17:05:45.104008] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:33.887 [2024-11-29 17:05:45.104018] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:33.887 [2024-11-29 17:05:45.104071] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.104084] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.104091] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.887 [2024-11-29 17:05:45.104105] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:33.887 [2024-11-29 17:05:45.104132] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.887 [2024-11-29 17:05:45.111973] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.887 [2024-11-29 17:05:45.111991] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.887 [2024-11-29 17:05:45.111999] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.112006] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167ab30) on tqpair=0x15fae10 00:23:33.887 [2024-11-29 17:05:45.112020] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:33.887 [2024-11-29 17:05:45.112030] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:33.887 [2024-11-29 17:05:45.112040] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:33.887 [2024-11-29 17:05:45.112056] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.112065] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.112072] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.887 [2024-11-29 17:05:45.112083] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.887 [2024-11-29 17:05:45.112107] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.887 [2024-11-29 17:05:45.112239] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.887 [2024-11-29 17:05:45.112254] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.887 [2024-11-29 17:05:45.112260] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.112267] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167ab30) on tqpair=0x15fae10 00:23:33.887 [2024-11-29 17:05:45.112276] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:33.887 [2024-11-29 17:05:45.112289] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:33.887 [2024-11-29 17:05:45.112301] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.112308] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.887 [2024-11-29 17:05:45.112314] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.887 [2024-11-29 17:05:45.112325] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.888 [2024-11-29 17:05:45.112347] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.888 [2024-11-29 17:05:45.112430] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.888 [2024-11-29 17:05:45.112444] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.888 [2024-11-29 17:05:45.112450] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.112457] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167ab30) on tqpair=0x15fae10 00:23:33.888 [2024-11-29 17:05:45.112466] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:33.888 [2024-11-29 17:05:45.112480] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:33.888 [2024-11-29 17:05:45.112496] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.112503] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.112510] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.888 [2024-11-29 17:05:45.112520] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.888 [2024-11-29 17:05:45.112541] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.888 [2024-11-29 17:05:45.112612] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.888 [2024-11-29 17:05:45.112624] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.888 [2024-11-29 17:05:45.112630] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.112637] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167ab30) on tqpair=0x15fae10 00:23:33.888 [2024-11-29 17:05:45.112646] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:33.888 [2024-11-29 17:05:45.112662] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.112671] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.112677] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.888 [2024-11-29 17:05:45.112687] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.888 [2024-11-29 17:05:45.112708] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.888 [2024-11-29 17:05:45.112784] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.888 [2024-11-29 17:05:45.112798] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.888 [2024-11-29 17:05:45.112804] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.112810] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167ab30) on tqpair=0x15fae10 00:23:33.888 [2024-11-29 17:05:45.112820] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:33.888 [2024-11-29 17:05:45.112828] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:33.888 [2024-11-29 17:05:45.112840] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:33.888 [2024-11-29 17:05:45.112949] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:33.888 [2024-11-29 17:05:45.112966] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:33.888 [2024-11-29 17:05:45.112987] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.112997] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.113004] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.888 [2024-11-29 17:05:45.113014] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.888 [2024-11-29 17:05:45.113037] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.888 [2024-11-29 17:05:45.113145] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.888 [2024-11-29 17:05:45.113158] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.888 [2024-11-29 17:05:45.113164] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.113170] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167ab30) on tqpair=0x15fae10 00:23:33.888 [2024-11-29 17:05:45.113184] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:33.888 [2024-11-29 17:05:45.113200] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.113209] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.113215] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.888 [2024-11-29 17:05:45.113225] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.888 [2024-11-29 17:05:45.113247] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.888 [2024-11-29 17:05:45.113320] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.888 [2024-11-29 17:05:45.113333] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.888 [2024-11-29 17:05:45.113339] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.113346] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167ab30) on tqpair=0x15fae10 00:23:33.888 [2024-11-29 17:05:45.113355] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:33.888 [2024-11-29 17:05:45.113363] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:33.888 [2024-11-29 17:05:45.113375] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:33.888 [2024-11-29 17:05:45.113389] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:33.888 [2024-11-29 17:05:45.113404] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.113411] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.113418] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.888 [2024-11-29 17:05:45.113428] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.888 [2024-11-29 17:05:45.113450] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.888 [2024-11-29 17:05:45.113578] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.888 [2024-11-29 17:05:45.113591] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.888 [2024-11-29 17:05:45.113597] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.113603] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15fae10): datao=0, datal=4096, cccid=0 00:23:33.888 [2024-11-29 17:05:45.113611] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x167ab30) on tqpair(0x15fae10): expected_datao=0, payload_size=4096 00:23:33.888 [2024-11-29 17:05:45.113628] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.113638] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154069] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.888 [2024-11-29 17:05:45.154088] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.888 [2024-11-29 17:05:45.154096] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154103] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167ab30) on tqpair=0x15fae10 00:23:33.888 [2024-11-29 17:05:45.154116] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:33.888 [2024-11-29 17:05:45.154125] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:33.888 [2024-11-29 17:05:45.154132] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:33.888 [2024-11-29 17:05:45.154139] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:33.888 [2024-11-29 17:05:45.154152] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:33.888 [2024-11-29 17:05:45.154161] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:33.888 [2024-11-29 17:05:45.154180] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:33.888 [2024-11-29 17:05:45.154194] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154201] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154208] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.888 [2024-11-29 17:05:45.154219] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:33.888 [2024-11-29 17:05:45.154243] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.888 [2024-11-29 17:05:45.154318] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.888 [2024-11-29 17:05:45.154332] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.888 [2024-11-29 17:05:45.154339] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154345] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167ab30) on tqpair=0x15fae10 00:23:33.888 [2024-11-29 17:05:45.154357] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154364] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154370] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15fae10) 00:23:33.888 [2024-11-29 17:05:45.154380] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.888 [2024-11-29 17:05:45.154390] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154397] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154403] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x15fae10) 00:23:33.888 [2024-11-29 17:05:45.154412] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.888 [2024-11-29 17:05:45.154422] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154428] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154434] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x15fae10) 00:23:33.888 [2024-11-29 17:05:45.154442] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.888 [2024-11-29 17:05:45.154452] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154458] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.888 [2024-11-29 17:05:45.154464] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15fae10) 00:23:33.889 [2024-11-29 17:05:45.154473] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.889 [2024-11-29 17:05:45.154482] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.154500] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.154513] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.154520] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.154526] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15fae10) 00:23:33.889 [2024-11-29 17:05:45.154540] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.889 [2024-11-29 17:05:45.154564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ab30, cid 0, qid 0 00:23:33.889 [2024-11-29 17:05:45.154590] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167ac90, cid 1, qid 0 00:23:33.889 [2024-11-29 17:05:45.154598] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167adf0, cid 2, qid 0 00:23:33.889 [2024-11-29 17:05:45.154606] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167af50, cid 3, qid 0 00:23:33.889 [2024-11-29 17:05:45.154613] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b0b0, cid 4, qid 0 00:23:33.889 [2024-11-29 17:05:45.154820] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.889 [2024-11-29 17:05:45.154835] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.889 [2024-11-29 17:05:45.154842] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.154848] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b0b0) on tqpair=0x15fae10 00:23:33.889 [2024-11-29 17:05:45.154857] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:33.889 [2024-11-29 17:05:45.154866] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.154880] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.154895] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.154907] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.154915] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.154921] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15fae10) 00:23:33.889 [2024-11-29 17:05:45.154931] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:33.889 [2024-11-29 17:05:45.154952] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b0b0, cid 4, qid 0 00:23:33.889 [2024-11-29 17:05:45.155076] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.889 [2024-11-29 17:05:45.155089] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.889 [2024-11-29 17:05:45.155096] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155102] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b0b0) on tqpair=0x15fae10 00:23:33.889 [2024-11-29 17:05:45.155169] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.155187] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.155202] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155209] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155215] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15fae10) 00:23:33.889 [2024-11-29 17:05:45.155225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.889 [2024-11-29 17:05:45.155248] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b0b0, cid 4, qid 0 00:23:33.889 [2024-11-29 17:05:45.155389] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.889 [2024-11-29 17:05:45.155403] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.889 [2024-11-29 17:05:45.155410] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155420] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15fae10): datao=0, datal=4096, cccid=4 00:23:33.889 [2024-11-29 17:05:45.155428] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x167b0b0) on tqpair(0x15fae10): expected_datao=0, payload_size=4096 00:23:33.889 [2024-11-29 17:05:45.155439] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155447] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155458] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.889 [2024-11-29 17:05:45.155468] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.889 [2024-11-29 17:05:45.155474] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155480] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b0b0) on tqpair=0x15fae10 00:23:33.889 [2024-11-29 17:05:45.155504] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:33.889 [2024-11-29 17:05:45.155525] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.155545] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.155558] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155566] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155572] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15fae10) 00:23:33.889 [2024-11-29 17:05:45.155582] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.889 [2024-11-29 17:05:45.155604] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b0b0, cid 4, qid 0 00:23:33.889 [2024-11-29 17:05:45.155723] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.889 [2024-11-29 17:05:45.155738] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.889 [2024-11-29 17:05:45.155744] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155750] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15fae10): datao=0, datal=4096, cccid=4 00:23:33.889 [2024-11-29 17:05:45.155758] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x167b0b0) on tqpair(0x15fae10): expected_datao=0, payload_size=4096 00:23:33.889 [2024-11-29 17:05:45.155768] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155776] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155787] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.889 [2024-11-29 17:05:45.155796] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.889 [2024-11-29 17:05:45.155803] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155809] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b0b0) on tqpair=0x15fae10 00:23:33.889 [2024-11-29 17:05:45.155835] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.155854] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:33.889 [2024-11-29 17:05:45.155868] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155876] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.889 [2024-11-29 17:05:45.155882] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15fae10) 00:23:33.889 [2024-11-29 17:05:45.155892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.889 [2024-11-29 17:05:45.155917] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b0b0, cid 4, qid 0 00:23:33.889 [2024-11-29 17:05:45.156029] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.889 [2024-11-29 17:05:45.156044] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.889 [2024-11-29 17:05:45.156050] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156056] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15fae10): datao=0, datal=4096, cccid=4 00:23:33.890 [2024-11-29 17:05:45.156063] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x167b0b0) on tqpair(0x15fae10): expected_datao=0, payload_size=4096 00:23:33.890 [2024-11-29 17:05:45.156074] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156081] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156092] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.890 [2024-11-29 17:05:45.156102] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.890 [2024-11-29 17:05:45.156108] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b0b0) on tqpair=0x15fae10 00:23:33.890 [2024-11-29 17:05:45.156130] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:33.890 [2024-11-29 17:05:45.156144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:33.890 [2024-11-29 17:05:45.156159] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:33.890 [2024-11-29 17:05:45.156171] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:33.890 [2024-11-29 17:05:45.156179] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:33.890 [2024-11-29 17:05:45.156188] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:33.890 [2024-11-29 17:05:45.156196] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:33.890 [2024-11-29 17:05:45.156204] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:33.890 [2024-11-29 17:05:45.156223] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156232] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156238] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15fae10) 00:23:33.890 [2024-11-29 17:05:45.156248] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.890 [2024-11-29 17:05:45.156259] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156267] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156273] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15fae10) 00:23:33.890 [2024-11-29 17:05:45.156282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:33.890 [2024-11-29 17:05:45.156308] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b0b0, cid 4, qid 0 00:23:33.890 [2024-11-29 17:05:45.156320] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b210, cid 5, qid 0 00:23:33.890 [2024-11-29 17:05:45.156434] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.890 [2024-11-29 17:05:45.156447] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.890 [2024-11-29 17:05:45.156454] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156464] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b0b0) on tqpair=0x15fae10 00:23:33.890 [2024-11-29 17:05:45.156476] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.890 [2024-11-29 17:05:45.156485] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.890 [2024-11-29 17:05:45.156491] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156497] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b210) on tqpair=0x15fae10 00:23:33.890 [2024-11-29 17:05:45.156513] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156522] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156528] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15fae10) 00:23:33.890 [2024-11-29 17:05:45.156538] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.890 [2024-11-29 17:05:45.156559] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b210, cid 5, qid 0 00:23:33.890 [2024-11-29 17:05:45.156637] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.890 [2024-11-29 17:05:45.156651] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.890 [2024-11-29 17:05:45.156658] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156664] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b210) on tqpair=0x15fae10 00:23:33.890 [2024-11-29 17:05:45.156680] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156689] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156695] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15fae10) 00:23:33.890 [2024-11-29 17:05:45.156705] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.890 [2024-11-29 17:05:45.156726] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b210, cid 5, qid 0 00:23:33.890 [2024-11-29 17:05:45.156803] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.890 [2024-11-29 17:05:45.156815] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.890 [2024-11-29 17:05:45.156821] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156827] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b210) on tqpair=0x15fae10 00:23:33.890 [2024-11-29 17:05:45.156843] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156852] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.156858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15fae10) 00:23:33.890 [2024-11-29 17:05:45.156868] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.890 [2024-11-29 17:05:45.156889] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b210, cid 5, qid 0 00:23:33.890 [2024-11-29 17:05:45.156978] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.890 [2024-11-29 17:05:45.156997] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.890 [2024-11-29 17:05:45.157027] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157035] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b210) on tqpair=0x15fae10 00:23:33.890 [2024-11-29 17:05:45.157058] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157068] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157074] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15fae10) 00:23:33.890 [2024-11-29 17:05:45.157084] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.890 [2024-11-29 17:05:45.157101] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157110] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157116] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15fae10) 00:23:33.890 [2024-11-29 17:05:45.157126] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.890 [2024-11-29 17:05:45.157138] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157145] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157151] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x15fae10) 00:23:33.890 [2024-11-29 17:05:45.157161] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.890 [2024-11-29 17:05:45.157173] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157180] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157186] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x15fae10) 00:23:33.890 [2024-11-29 17:05:45.157195] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.890 [2024-11-29 17:05:45.157220] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b210, cid 5, qid 0 00:23:33.890 [2024-11-29 17:05:45.157232] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b0b0, cid 4, qid 0 00:23:33.890 [2024-11-29 17:05:45.157240] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b370, cid 6, qid 0 00:23:33.890 [2024-11-29 17:05:45.157247] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b4d0, cid 7, qid 0 00:23:33.890 [2024-11-29 17:05:45.157446] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.890 [2024-11-29 17:05:45.157461] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.890 [2024-11-29 17:05:45.157467] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157473] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15fae10): datao=0, datal=8192, cccid=5 00:23:33.890 [2024-11-29 17:05:45.157486] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x167b210) on tqpair(0x15fae10): expected_datao=0, payload_size=8192 00:23:33.890 [2024-11-29 17:05:45.157508] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157517] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157529] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.890 [2024-11-29 17:05:45.157539] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.890 [2024-11-29 17:05:45.157545] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157551] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15fae10): datao=0, datal=512, cccid=4 00:23:33.890 [2024-11-29 17:05:45.157558] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x167b0b0) on tqpair(0x15fae10): expected_datao=0, payload_size=512 00:23:33.890 [2024-11-29 17:05:45.157568] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157575] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157583] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.890 [2024-11-29 17:05:45.157591] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.890 [2024-11-29 17:05:45.157597] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157603] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15fae10): datao=0, datal=512, cccid=6 00:23:33.890 [2024-11-29 17:05:45.157610] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x167b370) on tqpair(0x15fae10): expected_datao=0, payload_size=512 00:23:33.890 [2024-11-29 17:05:45.157624] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157631] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157640] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:33.890 [2024-11-29 17:05:45.157648] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:33.890 [2024-11-29 17:05:45.157654] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:33.890 [2024-11-29 17:05:45.157660] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15fae10): datao=0, datal=4096, cccid=7 00:23:33.891 [2024-11-29 17:05:45.157667] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x167b4d0) on tqpair(0x15fae10): expected_datao=0, payload_size=4096 00:23:33.891 [2024-11-29 17:05:45.157677] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:33.891 [2024-11-29 17:05:45.157684] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:33.891 [2024-11-29 17:05:45.157696] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.891 [2024-11-29 17:05:45.157705] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.891 [2024-11-29 17:05:45.157711] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.891 [2024-11-29 17:05:45.157717] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b210) on tqpair=0x15fae10 00:23:33.891 [2024-11-29 17:05:45.157738] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.891 [2024-11-29 17:05:45.157749] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.891 [2024-11-29 17:05:45.157756] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.891 [2024-11-29 17:05:45.157762] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b0b0) on tqpair=0x15fae10 00:23:33.891 [2024-11-29 17:05:45.157777] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.891 [2024-11-29 17:05:45.157788] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.891 [2024-11-29 17:05:45.157794] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.891 [2024-11-29 17:05:45.157815] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b370) on tqpair=0x15fae10 00:23:33.891 [2024-11-29 17:05:45.157827] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.891 [2024-11-29 17:05:45.157836] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.891 [2024-11-29 17:05:45.157841] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.891 [2024-11-29 17:05:45.157847] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b4d0) on tqpair=0x15fae10 00:23:33.891 ===================================================== 00:23:33.891 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:33.891 ===================================================== 00:23:33.891 Controller Capabilities/Features 00:23:33.891 ================================ 00:23:33.891 Vendor ID: 8086 00:23:33.891 Subsystem Vendor ID: 8086 00:23:33.891 Serial Number: SPDK00000000000001 00:23:33.891 Model Number: SPDK bdev Controller 00:23:33.891 Firmware Version: 24.01.1 00:23:33.891 Recommended Arb Burst: 6 00:23:33.891 IEEE OUI Identifier: e4 d2 5c 00:23:33.891 Multi-path I/O 00:23:33.891 May have multiple subsystem ports: Yes 00:23:33.891 May have multiple controllers: Yes 00:23:33.891 Associated with SR-IOV VF: No 00:23:33.891 Max Data Transfer Size: 131072 00:23:33.891 Max Number of Namespaces: 32 00:23:33.891 Max Number of I/O Queues: 127 00:23:33.891 NVMe Specification Version (VS): 1.3 00:23:33.891 NVMe Specification Version (Identify): 1.3 00:23:33.891 Maximum Queue Entries: 128 00:23:33.891 Contiguous Queues Required: Yes 00:23:33.891 Arbitration Mechanisms Supported 00:23:33.891 Weighted Round Robin: Not Supported 00:23:33.891 Vendor Specific: Not Supported 00:23:33.891 Reset Timeout: 15000 ms 00:23:33.891 Doorbell Stride: 4 bytes 00:23:33.891 NVM Subsystem Reset: Not Supported 00:23:33.891 Command Sets Supported 00:23:33.891 NVM Command Set: Supported 00:23:33.891 Boot Partition: Not Supported 00:23:33.891 Memory Page Size Minimum: 4096 bytes 00:23:33.891 Memory Page Size Maximum: 4096 bytes 00:23:33.891 Persistent Memory Region: Not Supported 00:23:33.891 Optional Asynchronous Events Supported 00:23:33.891 Namespace Attribute Notices: Supported 00:23:33.891 Firmware Activation Notices: Not Supported 00:23:33.891 ANA Change Notices: Not Supported 00:23:33.891 PLE Aggregate Log Change Notices: Not Supported 00:23:33.891 LBA Status Info Alert Notices: Not Supported 00:23:33.891 EGE Aggregate Log Change Notices: Not Supported 00:23:33.891 Normal NVM Subsystem Shutdown event: Not Supported 00:23:33.891 Zone Descriptor Change Notices: Not Supported 00:23:33.891 Discovery Log Change Notices: Not Supported 00:23:33.891 Controller Attributes 00:23:33.891 128-bit Host Identifier: Supported 00:23:33.891 Non-Operational Permissive Mode: Not Supported 00:23:33.891 NVM Sets: Not Supported 00:23:33.891 Read Recovery Levels: Not Supported 00:23:33.891 Endurance Groups: Not Supported 00:23:33.891 Predictable Latency Mode: Not Supported 00:23:33.891 Traffic Based Keep ALive: Not Supported 00:23:33.891 Namespace Granularity: Not Supported 00:23:33.891 SQ Associations: Not Supported 00:23:33.891 UUID List: Not Supported 00:23:33.891 Multi-Domain Subsystem: Not Supported 00:23:33.891 Fixed Capacity Management: Not Supported 00:23:33.891 Variable Capacity Management: Not Supported 00:23:33.891 Delete Endurance Group: Not Supported 00:23:33.891 Delete NVM Set: Not Supported 00:23:33.891 Extended LBA Formats Supported: Not Supported 00:23:33.891 Flexible Data Placement Supported: Not Supported 00:23:33.891 00:23:33.891 Controller Memory Buffer Support 00:23:33.891 ================================ 00:23:33.891 Supported: No 00:23:33.891 00:23:33.891 Persistent Memory Region Support 00:23:33.891 ================================ 00:23:33.891 Supported: No 00:23:33.891 00:23:33.891 Admin Command Set Attributes 00:23:33.891 ============================ 00:23:33.891 Security Send/Receive: Not Supported 00:23:33.891 Format NVM: Not Supported 00:23:33.891 Firmware Activate/Download: Not Supported 00:23:33.891 Namespace Management: Not Supported 00:23:33.891 Device Self-Test: Not Supported 00:23:33.891 Directives: Not Supported 00:23:33.891 NVMe-MI: Not Supported 00:23:33.891 Virtualization Management: Not Supported 00:23:33.891 Doorbell Buffer Config: Not Supported 00:23:33.891 Get LBA Status Capability: Not Supported 00:23:33.891 Command & Feature Lockdown Capability: Not Supported 00:23:33.891 Abort Command Limit: 4 00:23:33.891 Async Event Request Limit: 4 00:23:33.891 Number of Firmware Slots: N/A 00:23:33.891 Firmware Slot 1 Read-Only: N/A 00:23:33.891 Firmware Activation Without Reset: N/A 00:23:33.891 Multiple Update Detection Support: N/A 00:23:33.891 Firmware Update Granularity: No Information Provided 00:23:33.891 Per-Namespace SMART Log: No 00:23:33.891 Asymmetric Namespace Access Log Page: Not Supported 00:23:33.891 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:33.891 Command Effects Log Page: Supported 00:23:33.891 Get Log Page Extended Data: Supported 00:23:33.891 Telemetry Log Pages: Not Supported 00:23:33.891 Persistent Event Log Pages: Not Supported 00:23:33.891 Supported Log Pages Log Page: May Support 00:23:33.891 Commands Supported & Effects Log Page: Not Supported 00:23:33.891 Feature Identifiers & Effects Log Page:May Support 00:23:33.891 NVMe-MI Commands & Effects Log Page: May Support 00:23:33.891 Data Area 4 for Telemetry Log: Not Supported 00:23:33.891 Error Log Page Entries Supported: 128 00:23:33.891 Keep Alive: Supported 00:23:33.891 Keep Alive Granularity: 10000 ms 00:23:33.891 00:23:33.891 NVM Command Set Attributes 00:23:33.891 ========================== 00:23:33.891 Submission Queue Entry Size 00:23:33.891 Max: 64 00:23:33.891 Min: 64 00:23:33.891 Completion Queue Entry Size 00:23:33.891 Max: 16 00:23:33.891 Min: 16 00:23:33.891 Number of Namespaces: 32 00:23:33.891 Compare Command: Supported 00:23:33.891 Write Uncorrectable Command: Not Supported 00:23:33.891 Dataset Management Command: Supported 00:23:33.891 Write Zeroes Command: Supported 00:23:33.891 Set Features Save Field: Not Supported 00:23:33.891 Reservations: Supported 00:23:33.891 Timestamp: Not Supported 00:23:33.891 Copy: Supported 00:23:33.891 Volatile Write Cache: Present 00:23:33.891 Atomic Write Unit (Normal): 1 00:23:33.891 Atomic Write Unit (PFail): 1 00:23:33.891 Atomic Compare & Write Unit: 1 00:23:33.891 Fused Compare & Write: Supported 00:23:33.891 Scatter-Gather List 00:23:33.891 SGL Command Set: Supported 00:23:33.891 SGL Keyed: Supported 00:23:33.891 SGL Bit Bucket Descriptor: Not Supported 00:23:33.891 SGL Metadata Pointer: Not Supported 00:23:33.891 Oversized SGL: Not Supported 00:23:33.891 SGL Metadata Address: Not Supported 00:23:33.891 SGL Offset: Supported 00:23:33.891 Transport SGL Data Block: Not Supported 00:23:33.891 Replay Protected Memory Block: Not Supported 00:23:33.891 00:23:33.891 Firmware Slot Information 00:23:33.891 ========================= 00:23:33.891 Active slot: 1 00:23:33.891 Slot 1 Firmware Revision: 24.01.1 00:23:33.891 00:23:33.891 00:23:33.891 Commands Supported and Effects 00:23:33.891 ============================== 00:23:33.891 Admin Commands 00:23:33.891 -------------- 00:23:33.891 Get Log Page (02h): Supported 00:23:33.891 Identify (06h): Supported 00:23:33.891 Abort (08h): Supported 00:23:33.891 Set Features (09h): Supported 00:23:33.891 Get Features (0Ah): Supported 00:23:33.891 Asynchronous Event Request (0Ch): Supported 00:23:33.891 Keep Alive (18h): Supported 00:23:33.891 I/O Commands 00:23:33.891 ------------ 00:23:33.891 Flush (00h): Supported LBA-Change 00:23:33.891 Write (01h): Supported LBA-Change 00:23:33.891 Read (02h): Supported 00:23:33.891 Compare (05h): Supported 00:23:33.891 Write Zeroes (08h): Supported LBA-Change 00:23:33.891 Dataset Management (09h): Supported LBA-Change 00:23:33.891 Copy (19h): Supported LBA-Change 00:23:33.891 Unknown (79h): Supported LBA-Change 00:23:33.891 Unknown (7Ah): Supported 00:23:33.891 00:23:33.891 Error Log 00:23:33.891 ========= 00:23:33.891 00:23:33.891 Arbitration 00:23:33.891 =========== 00:23:33.891 Arbitration Burst: 1 00:23:33.891 00:23:33.892 Power Management 00:23:33.892 ================ 00:23:33.892 Number of Power States: 1 00:23:33.892 Current Power State: Power State #0 00:23:33.892 Power State #0: 00:23:33.892 Max Power: 0.00 W 00:23:33.892 Non-Operational State: Operational 00:23:33.892 Entry Latency: Not Reported 00:23:33.892 Exit Latency: Not Reported 00:23:33.892 Relative Read Throughput: 0 00:23:33.892 Relative Read Latency: 0 00:23:33.892 Relative Write Throughput: 0 00:23:33.892 Relative Write Latency: 0 00:23:33.892 Idle Power: Not Reported 00:23:33.892 Active Power: Not Reported 00:23:33.892 Non-Operational Permissive Mode: Not Supported 00:23:33.892 00:23:33.892 Health Information 00:23:33.892 ================== 00:23:33.892 Critical Warnings: 00:23:33.892 Available Spare Space: OK 00:23:33.892 Temperature: OK 00:23:33.892 Device Reliability: OK 00:23:33.892 Read Only: No 00:23:33.892 Volatile Memory Backup: OK 00:23:33.892 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:33.892 Temperature Threshold: [2024-11-29 17:05:45.157991] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158003] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158010] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x15fae10) 00:23:33.892 [2024-11-29 17:05:45.158020] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.892 [2024-11-29 17:05:45.158043] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167b4d0, cid 7, qid 0 00:23:33.892 [2024-11-29 17:05:45.158171] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.892 [2024-11-29 17:05:45.158183] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.892 [2024-11-29 17:05:45.158190] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158196] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167b4d0) on tqpair=0x15fae10 00:23:33.892 [2024-11-29 17:05:45.158246] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:33.892 [2024-11-29 17:05:45.158267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:33.892 [2024-11-29 17:05:45.158279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:33.892 [2024-11-29 17:05:45.158292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:33.892 [2024-11-29 17:05:45.158302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:33.892 [2024-11-29 17:05:45.158314] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158321] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158327] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15fae10) 00:23:33.892 [2024-11-29 17:05:45.158338] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.892 [2024-11-29 17:05:45.158361] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167af50, cid 3, qid 0 00:23:33.892 [2024-11-29 17:05:45.158495] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.892 [2024-11-29 17:05:45.158507] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.892 [2024-11-29 17:05:45.158514] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158520] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167af50) on tqpair=0x15fae10 00:23:33.892 [2024-11-29 17:05:45.158532] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158539] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158544] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15fae10) 00:23:33.892 [2024-11-29 17:05:45.158555] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.892 [2024-11-29 17:05:45.158580] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167af50, cid 3, qid 0 00:23:33.892 [2024-11-29 17:05:45.158683] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.892 [2024-11-29 17:05:45.158698] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.892 [2024-11-29 17:05:45.158704] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158710] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167af50) on tqpair=0x15fae10 00:23:33.892 [2024-11-29 17:05:45.158719] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:33.892 [2024-11-29 17:05:45.158727] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:33.892 [2024-11-29 17:05:45.158744] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158753] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158759] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15fae10) 00:23:33.892 [2024-11-29 17:05:45.158769] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.892 [2024-11-29 17:05:45.158790] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167af50, cid 3, qid 0 00:23:33.892 [2024-11-29 17:05:45.158866] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.892 [2024-11-29 17:05:45.158880] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.892 [2024-11-29 17:05:45.158886] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158892] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167af50) on tqpair=0x15fae10 00:23:33.892 [2024-11-29 17:05:45.158909] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158918] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.158924] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15fae10) 00:23:33.892 [2024-11-29 17:05:45.158935] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.892 [2024-11-29 17:05:45.162967] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167af50, cid 3, qid 0 00:23:33.892 [2024-11-29 17:05:45.162989] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.892 [2024-11-29 17:05:45.163000] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.892 [2024-11-29 17:05:45.163006] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.163012] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167af50) on tqpair=0x15fae10 00:23:33.892 [2024-11-29 17:05:45.163031] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.163055] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.163061] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15fae10) 00:23:33.892 [2024-11-29 17:05:45.163071] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:33.892 [2024-11-29 17:05:45.163094] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x167af50, cid 3, qid 0 00:23:33.892 [2024-11-29 17:05:45.163225] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:33.892 [2024-11-29 17:05:45.163239] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:33.892 [2024-11-29 17:05:45.163246] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:33.892 [2024-11-29 17:05:45.163252] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x167af50) on tqpair=0x15fae10 00:23:33.892 [2024-11-29 17:05:45.163265] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:23:33.892 0 Kelvin (-273 Celsius) 00:23:33.892 Available Spare: 0% 00:23:33.892 Available Spare Threshold: 0% 00:23:33.892 Life Percentage Used: 0% 00:23:33.892 Data Units Read: 0 00:23:33.892 Data Units Written: 0 00:23:33.892 Host Read Commands: 0 00:23:33.892 Host Write Commands: 0 00:23:33.892 Controller Busy Time: 0 minutes 00:23:33.892 Power Cycles: 0 00:23:33.892 Power On Hours: 0 hours 00:23:33.892 Unsafe Shutdowns: 0 00:23:33.892 Unrecoverable Media Errors: 0 00:23:33.892 Lifetime Error Log Entries: 0 00:23:33.892 Warning Temperature Time: 0 minutes 00:23:33.892 Critical Temperature Time: 0 minutes 00:23:33.892 00:23:33.892 Number of Queues 00:23:33.892 ================ 00:23:33.892 Number of I/O Submission Queues: 127 00:23:33.892 Number of I/O Completion Queues: 127 00:23:33.892 00:23:33.892 Active Namespaces 00:23:33.892 ================= 00:23:33.892 Namespace ID:1 00:23:33.892 Error Recovery Timeout: Unlimited 00:23:33.892 Command Set Identifier: NVM (00h) 00:23:33.892 Deallocate: Supported 00:23:33.892 Deallocated/Unwritten Error: Not Supported 00:23:33.892 Deallocated Read Value: Unknown 00:23:33.892 Deallocate in Write Zeroes: Not Supported 00:23:33.892 Deallocated Guard Field: 0xFFFF 00:23:33.892 Flush: Supported 00:23:33.892 Reservation: Supported 00:23:33.892 Namespace Sharing Capabilities: Multiple Controllers 00:23:33.892 Size (in LBAs): 131072 (0GiB) 00:23:33.892 Capacity (in LBAs): 131072 (0GiB) 00:23:33.892 Utilization (in LBAs): 131072 (0GiB) 00:23:33.892 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:33.892 EUI64: ABCDEF0123456789 00:23:33.892 UUID: 1952a133-85a6-4ea9-8f4f-540726bbfa37 00:23:33.892 Thin Provisioning: Not Supported 00:23:33.892 Per-NS Atomic Units: Yes 00:23:33.892 Atomic Boundary Size (Normal): 0 00:23:33.892 Atomic Boundary Size (PFail): 0 00:23:33.892 Atomic Boundary Offset: 0 00:23:33.892 Maximum Single Source Range Length: 65535 00:23:33.892 Maximum Copy Length: 65535 00:23:33.892 Maximum Source Range Count: 1 00:23:33.892 NGUID/EUI64 Never Reused: No 00:23:33.892 Namespace Write Protected: No 00:23:33.892 Number of LBA Formats: 1 00:23:33.892 Current LBA Format: LBA Format #00 00:23:33.892 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:33.892 00:23:33.892 17:05:45 -- host/identify.sh@51 -- # sync 00:23:33.892 17:05:45 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:33.892 17:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.892 17:05:45 -- common/autotest_common.sh@10 -- # set +x 00:23:33.892 17:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.892 17:05:45 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:33.892 17:05:45 -- host/identify.sh@56 -- # nvmftestfini 00:23:33.892 17:05:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:33.892 17:05:45 -- nvmf/common.sh@116 -- # sync 00:23:33.892 17:05:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:33.892 17:05:45 -- nvmf/common.sh@119 -- # set +e 00:23:33.892 17:05:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:33.893 17:05:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:33.893 rmmod nvme_tcp 00:23:33.893 rmmod nvme_fabrics 00:23:33.893 rmmod nvme_keyring 00:23:33.893 17:05:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:33.893 17:05:45 -- nvmf/common.sh@123 -- # set -e 00:23:33.893 17:05:45 -- nvmf/common.sh@124 -- # return 0 00:23:33.893 17:05:45 -- nvmf/common.sh@477 -- # '[' -n 282146 ']' 00:23:33.893 17:05:45 -- nvmf/common.sh@478 -- # killprocess 282146 00:23:33.893 17:05:45 -- common/autotest_common.sh@936 -- # '[' -z 282146 ']' 00:23:33.893 17:05:45 -- common/autotest_common.sh@940 -- # kill -0 282146 00:23:33.893 17:05:45 -- common/autotest_common.sh@941 -- # uname 00:23:33.893 17:05:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:33.893 17:05:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 282146 00:23:33.893 17:05:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:33.893 17:05:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:33.893 17:05:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 282146' 00:23:33.893 killing process with pid 282146 00:23:33.893 17:05:45 -- common/autotest_common.sh@955 -- # kill 282146 00:23:33.893 [2024-11-29 17:05:45.286394] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:33.893 17:05:45 -- common/autotest_common.sh@960 -- # wait 282146 00:23:34.186 17:05:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:34.186 17:05:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:34.186 17:05:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:34.186 17:05:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:34.186 17:05:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:34.186 17:05:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:34.186 17:05:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:34.186 17:05:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:36.215 17:05:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:36.215 00:23:36.215 real 0m6.346s 00:23:36.215 user 0m7.613s 00:23:36.215 sys 0m2.009s 00:23:36.215 17:05:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:36.215 17:05:47 -- common/autotest_common.sh@10 -- # set +x 00:23:36.215 ************************************ 00:23:36.215 END TEST nvmf_identify 00:23:36.215 ************************************ 00:23:36.474 17:05:47 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:36.474 17:05:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:36.474 17:05:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:36.474 17:05:47 -- common/autotest_common.sh@10 -- # set +x 00:23:36.474 ************************************ 00:23:36.474 START TEST nvmf_perf 00:23:36.475 ************************************ 00:23:36.475 17:05:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:36.475 * Looking for test storage... 00:23:36.475 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:36.475 17:05:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:36.475 17:05:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:36.475 17:05:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:36.475 17:05:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:36.475 17:05:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:36.475 17:05:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:36.475 17:05:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:36.475 17:05:47 -- scripts/common.sh@335 -- # IFS=.-: 00:23:36.475 17:05:47 -- scripts/common.sh@335 -- # read -ra ver1 00:23:36.475 17:05:47 -- scripts/common.sh@336 -- # IFS=.-: 00:23:36.475 17:05:47 -- scripts/common.sh@336 -- # read -ra ver2 00:23:36.475 17:05:47 -- scripts/common.sh@337 -- # local 'op=<' 00:23:36.475 17:05:47 -- scripts/common.sh@339 -- # ver1_l=2 00:23:36.475 17:05:47 -- scripts/common.sh@340 -- # ver2_l=1 00:23:36.475 17:05:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:36.475 17:05:47 -- scripts/common.sh@343 -- # case "$op" in 00:23:36.475 17:05:47 -- scripts/common.sh@344 -- # : 1 00:23:36.475 17:05:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:36.475 17:05:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:36.475 17:05:47 -- scripts/common.sh@364 -- # decimal 1 00:23:36.475 17:05:47 -- scripts/common.sh@352 -- # local d=1 00:23:36.475 17:05:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:36.475 17:05:47 -- scripts/common.sh@354 -- # echo 1 00:23:36.475 17:05:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:36.475 17:05:47 -- scripts/common.sh@365 -- # decimal 2 00:23:36.475 17:05:47 -- scripts/common.sh@352 -- # local d=2 00:23:36.475 17:05:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:36.475 17:05:47 -- scripts/common.sh@354 -- # echo 2 00:23:36.475 17:05:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:36.475 17:05:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:36.475 17:05:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:36.475 17:05:47 -- scripts/common.sh@367 -- # return 0 00:23:36.475 17:05:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:36.475 17:05:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:36.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:36.475 --rc genhtml_branch_coverage=1 00:23:36.475 --rc genhtml_function_coverage=1 00:23:36.475 --rc genhtml_legend=1 00:23:36.475 --rc geninfo_all_blocks=1 00:23:36.475 --rc geninfo_unexecuted_blocks=1 00:23:36.475 00:23:36.475 ' 00:23:36.475 17:05:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:36.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:36.475 --rc genhtml_branch_coverage=1 00:23:36.475 --rc genhtml_function_coverage=1 00:23:36.475 --rc genhtml_legend=1 00:23:36.475 --rc geninfo_all_blocks=1 00:23:36.475 --rc geninfo_unexecuted_blocks=1 00:23:36.475 00:23:36.475 ' 00:23:36.475 17:05:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:36.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:36.475 --rc genhtml_branch_coverage=1 00:23:36.475 --rc genhtml_function_coverage=1 00:23:36.475 --rc genhtml_legend=1 00:23:36.475 --rc geninfo_all_blocks=1 00:23:36.475 --rc geninfo_unexecuted_blocks=1 00:23:36.475 00:23:36.475 ' 00:23:36.475 17:05:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:36.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:36.475 --rc genhtml_branch_coverage=1 00:23:36.475 --rc genhtml_function_coverage=1 00:23:36.475 --rc genhtml_legend=1 00:23:36.475 --rc geninfo_all_blocks=1 00:23:36.475 --rc geninfo_unexecuted_blocks=1 00:23:36.475 00:23:36.475 ' 00:23:36.475 17:05:47 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:36.475 17:05:47 -- nvmf/common.sh@7 -- # uname -s 00:23:36.475 17:05:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:36.475 17:05:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:36.475 17:05:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:36.475 17:05:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:36.475 17:05:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:36.475 17:05:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:36.475 17:05:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:36.475 17:05:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:36.475 17:05:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:36.475 17:05:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:36.475 17:05:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:36.475 17:05:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:36.475 17:05:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:36.475 17:05:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:36.475 17:05:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:36.475 17:05:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:36.475 17:05:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:36.475 17:05:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:36.475 17:05:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:36.475 17:05:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:36.475 17:05:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:36.475 17:05:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:36.475 17:05:47 -- paths/export.sh@5 -- # export PATH 00:23:36.475 17:05:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:36.475 17:05:47 -- nvmf/common.sh@46 -- # : 0 00:23:36.475 17:05:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:36.475 17:05:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:36.475 17:05:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:36.475 17:05:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:36.475 17:05:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:36.475 17:05:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:36.475 17:05:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:36.475 17:05:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:36.476 17:05:47 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:36.476 17:05:47 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:36.476 17:05:47 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:36.476 17:05:47 -- host/perf.sh@17 -- # nvmftestinit 00:23:36.476 17:05:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:36.476 17:05:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:36.476 17:05:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:36.476 17:05:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:36.476 17:05:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:36.476 17:05:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:36.476 17:05:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:36.476 17:05:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:36.476 17:05:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:36.476 17:05:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:36.476 17:05:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:36.476 17:05:47 -- common/autotest_common.sh@10 -- # set +x 00:23:38.377 17:05:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:38.377 17:05:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:38.377 17:05:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:38.377 17:05:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:38.377 17:05:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:38.377 17:05:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:38.377 17:05:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:38.377 17:05:49 -- nvmf/common.sh@294 -- # net_devs=() 00:23:38.635 17:05:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:38.635 17:05:49 -- nvmf/common.sh@295 -- # e810=() 00:23:38.635 17:05:49 -- nvmf/common.sh@295 -- # local -ga e810 00:23:38.635 17:05:49 -- nvmf/common.sh@296 -- # x722=() 00:23:38.635 17:05:49 -- nvmf/common.sh@296 -- # local -ga x722 00:23:38.635 17:05:49 -- nvmf/common.sh@297 -- # mlx=() 00:23:38.635 17:05:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:38.635 17:05:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:38.635 17:05:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:38.635 17:05:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:38.635 17:05:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:38.635 17:05:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:38.635 17:05:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:38.635 17:05:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:38.635 17:05:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:38.636 17:05:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:38.636 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:38.636 17:05:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:38.636 17:05:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:38.636 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:38.636 17:05:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:38.636 17:05:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:38.636 17:05:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:38.636 17:05:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:38.636 17:05:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:38.636 17:05:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:38.636 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:38.636 17:05:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:38.636 17:05:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:38.636 17:05:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:38.636 17:05:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:38.636 17:05:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:38.636 17:05:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:38.636 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:38.636 17:05:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:38.636 17:05:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:38.636 17:05:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:38.636 17:05:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:38.636 17:05:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:38.636 17:05:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:38.636 17:05:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:38.636 17:05:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:38.636 17:05:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:38.636 17:05:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:38.636 17:05:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:38.636 17:05:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:38.636 17:05:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:38.636 17:05:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:38.636 17:05:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:38.636 17:05:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:38.636 17:05:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:38.636 17:05:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:38.636 17:05:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:38.636 17:05:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:38.636 17:05:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:38.636 17:05:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:38.636 17:05:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:38.636 17:05:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:38.636 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:38.636 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:23:38.636 00:23:38.636 --- 10.0.0.2 ping statistics --- 00:23:38.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:38.636 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:23:38.636 17:05:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:38.636 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:38.636 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:23:38.636 00:23:38.636 --- 10.0.0.1 ping statistics --- 00:23:38.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:38.636 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:23:38.636 17:05:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:38.636 17:05:49 -- nvmf/common.sh@410 -- # return 0 00:23:38.636 17:05:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:38.636 17:05:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:38.636 17:05:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:38.636 17:05:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:38.636 17:05:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:38.636 17:05:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:38.636 17:05:49 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:38.636 17:05:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:38.636 17:05:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:38.636 17:05:49 -- common/autotest_common.sh@10 -- # set +x 00:23:38.636 17:05:49 -- nvmf/common.sh@469 -- # nvmfpid=284389 00:23:38.636 17:05:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:38.636 17:05:49 -- nvmf/common.sh@470 -- # waitforlisten 284389 00:23:38.636 17:05:49 -- common/autotest_common.sh@829 -- # '[' -z 284389 ']' 00:23:38.636 17:05:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:38.636 17:05:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:38.636 17:05:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:38.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:38.636 17:05:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:38.636 17:05:49 -- common/autotest_common.sh@10 -- # set +x 00:23:38.636 [2024-11-29 17:05:50.018055] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:38.636 [2024-11-29 17:05:50.018153] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:38.636 EAL: No free 2048 kB hugepages reported on node 1 00:23:38.894 [2024-11-29 17:05:50.089508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:38.894 [2024-11-29 17:05:50.204046] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:38.894 [2024-11-29 17:05:50.204228] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:38.894 [2024-11-29 17:05:50.204274] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:38.894 [2024-11-29 17:05:50.204302] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:38.894 [2024-11-29 17:05:50.204433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:38.894 [2024-11-29 17:05:50.204460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:38.894 [2024-11-29 17:05:50.204520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:38.894 [2024-11-29 17:05:50.204523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:39.826 17:05:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:39.826 17:05:51 -- common/autotest_common.sh@862 -- # return 0 00:23:39.826 17:05:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:39.826 17:05:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:39.826 17:05:51 -- common/autotest_common.sh@10 -- # set +x 00:23:39.826 17:05:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:39.826 17:05:51 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:39.826 17:05:51 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:43.101 17:05:54 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:43.101 17:05:54 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:43.101 17:05:54 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:43.101 17:05:54 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:43.359 17:05:54 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:43.359 17:05:54 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:43.359 17:05:54 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:43.359 17:05:54 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:43.359 17:05:54 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:43.617 [2024-11-29 17:05:54.878076] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:43.617 17:05:54 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:43.874 17:05:55 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:43.874 17:05:55 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:44.131 17:05:55 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:44.131 17:05:55 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:44.388 17:05:55 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:44.645 [2024-11-29 17:05:55.889862] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:44.645 17:05:55 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:44.903 17:05:56 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:44.903 17:05:56 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:44.903 17:05:56 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:44.903 17:05:56 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:46.274 Initializing NVMe Controllers 00:23:46.274 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:46.274 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:46.274 Initialization complete. Launching workers. 00:23:46.274 ======================================================== 00:23:46.274 Latency(us) 00:23:46.274 Device Information : IOPS MiB/s Average min max 00:23:46.274 PCIE (0000:88:00.0) NSID 1 from core 0: 86711.98 338.72 368.62 44.73 4302.23 00:23:46.274 ======================================================== 00:23:46.274 Total : 86711.98 338.72 368.62 44.73 4302.23 00:23:46.274 00:23:46.274 17:05:57 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:46.274 EAL: No free 2048 kB hugepages reported on node 1 00:23:47.651 Initializing NVMe Controllers 00:23:47.651 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:47.651 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:47.651 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:47.651 Initialization complete. Launching workers. 00:23:47.651 ======================================================== 00:23:47.651 Latency(us) 00:23:47.651 Device Information : IOPS MiB/s Average min max 00:23:47.652 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 87.69 0.34 11597.00 142.34 44780.58 00:23:47.652 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 55.80 0.22 18774.69 7915.63 51835.66 00:23:47.652 ======================================================== 00:23:47.652 Total : 143.49 0.56 14388.32 142.34 51835.66 00:23:47.652 00:23:47.652 17:05:58 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:47.652 EAL: No free 2048 kB hugepages reported on node 1 00:23:48.583 Initializing NVMe Controllers 00:23:48.583 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:48.583 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:48.583 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:48.583 Initialization complete. Launching workers. 00:23:48.583 ======================================================== 00:23:48.584 Latency(us) 00:23:48.584 Device Information : IOPS MiB/s Average min max 00:23:48.584 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8154.80 31.85 3924.72 685.37 7752.22 00:23:48.584 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3953.36 15.44 8106.72 5113.81 15729.68 00:23:48.584 ======================================================== 00:23:48.584 Total : 12108.16 47.30 5290.16 685.37 15729.68 00:23:48.584 00:23:48.584 17:05:59 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:48.584 17:05:59 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:48.584 17:05:59 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:48.841 EAL: No free 2048 kB hugepages reported on node 1 00:23:51.368 Initializing NVMe Controllers 00:23:51.368 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:51.368 Controller IO queue size 128, less than required. 00:23:51.368 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:51.368 Controller IO queue size 128, less than required. 00:23:51.368 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:51.368 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:51.368 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:51.368 Initialization complete. Launching workers. 00:23:51.368 ======================================================== 00:23:51.368 Latency(us) 00:23:51.368 Device Information : IOPS MiB/s Average min max 00:23:51.368 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1737.68 434.42 74562.60 55483.26 126207.59 00:23:51.368 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 601.02 150.26 220364.21 93437.52 337896.15 00:23:51.368 ======================================================== 00:23:51.368 Total : 2338.70 584.67 112032.22 55483.26 337896.15 00:23:51.368 00:23:51.368 17:06:02 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:51.368 EAL: No free 2048 kB hugepages reported on node 1 00:23:51.368 No valid NVMe controllers or AIO or URING devices found 00:23:51.368 Initializing NVMe Controllers 00:23:51.368 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:51.368 Controller IO queue size 128, less than required. 00:23:51.368 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:51.368 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:51.368 Controller IO queue size 128, less than required. 00:23:51.368 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:51.368 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:51.368 WARNING: Some requested NVMe devices were skipped 00:23:51.368 17:06:02 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:51.368 EAL: No free 2048 kB hugepages reported on node 1 00:23:53.895 Initializing NVMe Controllers 00:23:53.895 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:53.895 Controller IO queue size 128, less than required. 00:23:53.895 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:53.895 Controller IO queue size 128, less than required. 00:23:53.895 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:53.895 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:53.895 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:53.895 Initialization complete. Launching workers. 00:23:53.895 00:23:53.895 ==================== 00:23:53.895 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:53.895 TCP transport: 00:23:53.895 polls: 8864 00:23:53.895 idle_polls: 5854 00:23:53.895 sock_completions: 3010 00:23:53.895 nvme_completions: 5740 00:23:53.895 submitted_requests: 8788 00:23:53.895 queued_requests: 1 00:23:53.895 00:23:53.895 ==================== 00:23:53.895 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:53.895 TCP transport: 00:23:53.895 polls: 12144 00:23:53.895 idle_polls: 8447 00:23:53.895 sock_completions: 3697 00:23:53.895 nvme_completions: 6223 00:23:53.895 submitted_requests: 9470 00:23:53.895 queued_requests: 1 00:23:53.895 ======================================================== 00:23:53.895 Latency(us) 00:23:53.895 Device Information : IOPS MiB/s Average min max 00:23:53.895 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1498.24 374.56 86582.30 49215.42 151167.03 00:23:53.895 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1618.72 404.68 79717.94 45551.74 116498.86 00:23:53.895 ======================================================== 00:23:53.895 Total : 3116.96 779.24 83017.46 45551.74 151167.03 00:23:53.895 00:23:53.895 17:06:05 -- host/perf.sh@66 -- # sync 00:23:53.895 17:06:05 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:54.151 17:06:05 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:54.151 17:06:05 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:54.151 17:06:05 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:57.430 17:06:08 -- host/perf.sh@72 -- # ls_guid=8a255726-84a4-4121-9a3f-418fd6a47396 00:23:57.430 17:06:08 -- host/perf.sh@73 -- # get_lvs_free_mb 8a255726-84a4-4121-9a3f-418fd6a47396 00:23:57.430 17:06:08 -- common/autotest_common.sh@1353 -- # local lvs_uuid=8a255726-84a4-4121-9a3f-418fd6a47396 00:23:57.430 17:06:08 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:57.430 17:06:08 -- common/autotest_common.sh@1355 -- # local fc 00:23:57.430 17:06:08 -- common/autotest_common.sh@1356 -- # local cs 00:23:57.430 17:06:08 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:57.687 17:06:09 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:57.687 { 00:23:57.687 "uuid": "8a255726-84a4-4121-9a3f-418fd6a47396", 00:23:57.687 "name": "lvs_0", 00:23:57.687 "base_bdev": "Nvme0n1", 00:23:57.687 "total_data_clusters": 238234, 00:23:57.687 "free_clusters": 238234, 00:23:57.687 "block_size": 512, 00:23:57.687 "cluster_size": 4194304 00:23:57.687 } 00:23:57.687 ]' 00:23:57.687 17:06:09 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="8a255726-84a4-4121-9a3f-418fd6a47396") .free_clusters' 00:23:57.687 17:06:09 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:57.687 17:06:09 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="8a255726-84a4-4121-9a3f-418fd6a47396") .cluster_size' 00:23:57.687 17:06:09 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:57.687 17:06:09 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:57.687 17:06:09 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:57.687 952936 00:23:57.687 17:06:09 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:57.687 17:06:09 -- host/perf.sh@78 -- # free_mb=20480 00:23:57.687 17:06:09 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8a255726-84a4-4121-9a3f-418fd6a47396 lbd_0 20480 00:23:58.251 17:06:09 -- host/perf.sh@80 -- # lb_guid=4f4726c3-7476-4f77-84d9-1bdeb93de1ba 00:23:58.251 17:06:09 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 4f4726c3-7476-4f77-84d9-1bdeb93de1ba lvs_n_0 00:23:59.183 17:06:10 -- host/perf.sh@83 -- # ls_nested_guid=13760eb8-b787-4db4-aafc-4c2f6b5e4119 00:23:59.183 17:06:10 -- host/perf.sh@84 -- # get_lvs_free_mb 13760eb8-b787-4db4-aafc-4c2f6b5e4119 00:23:59.183 17:06:10 -- common/autotest_common.sh@1353 -- # local lvs_uuid=13760eb8-b787-4db4-aafc-4c2f6b5e4119 00:23:59.183 17:06:10 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:59.183 17:06:10 -- common/autotest_common.sh@1355 -- # local fc 00:23:59.183 17:06:10 -- common/autotest_common.sh@1356 -- # local cs 00:23:59.183 17:06:10 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:59.183 17:06:10 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:59.183 { 00:23:59.183 "uuid": "8a255726-84a4-4121-9a3f-418fd6a47396", 00:23:59.183 "name": "lvs_0", 00:23:59.183 "base_bdev": "Nvme0n1", 00:23:59.183 "total_data_clusters": 238234, 00:23:59.183 "free_clusters": 233114, 00:23:59.183 "block_size": 512, 00:23:59.183 "cluster_size": 4194304 00:23:59.183 }, 00:23:59.183 { 00:23:59.183 "uuid": "13760eb8-b787-4db4-aafc-4c2f6b5e4119", 00:23:59.183 "name": "lvs_n_0", 00:23:59.183 "base_bdev": "4f4726c3-7476-4f77-84d9-1bdeb93de1ba", 00:23:59.183 "total_data_clusters": 5114, 00:23:59.183 "free_clusters": 5114, 00:23:59.183 "block_size": 512, 00:23:59.183 "cluster_size": 4194304 00:23:59.183 } 00:23:59.183 ]' 00:23:59.183 17:06:10 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="13760eb8-b787-4db4-aafc-4c2f6b5e4119") .free_clusters' 00:23:59.440 17:06:10 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:59.440 17:06:10 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="13760eb8-b787-4db4-aafc-4c2f6b5e4119") .cluster_size' 00:23:59.440 17:06:10 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:59.440 17:06:10 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:59.440 17:06:10 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:59.440 20456 00:23:59.440 17:06:10 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:59.440 17:06:10 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 13760eb8-b787-4db4-aafc-4c2f6b5e4119 lbd_nest_0 20456 00:23:59.697 17:06:10 -- host/perf.sh@88 -- # lb_nested_guid=ef59c7fe-6571-4d3d-ae0e-7a6d877c2e05 00:23:59.697 17:06:10 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:59.954 17:06:11 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:59.954 17:06:11 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 ef59c7fe-6571-4d3d-ae0e-7a6d877c2e05 00:24:00.212 17:06:11 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:00.469 17:06:11 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:24:00.469 17:06:11 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:24:00.469 17:06:11 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:00.469 17:06:11 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:00.469 17:06:11 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:00.469 EAL: No free 2048 kB hugepages reported on node 1 00:24:12.660 Initializing NVMe Controllers 00:24:12.660 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:12.660 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:12.660 Initialization complete. Launching workers. 00:24:12.660 ======================================================== 00:24:12.660 Latency(us) 00:24:12.660 Device Information : IOPS MiB/s Average min max 00:24:12.660 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.80 0.02 21440.82 166.97 44909.75 00:24:12.660 ======================================================== 00:24:12.660 Total : 46.80 0.02 21440.82 166.97 44909.75 00:24:12.660 00:24:12.660 17:06:22 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:12.660 17:06:22 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:12.660 EAL: No free 2048 kB hugepages reported on node 1 00:24:22.619 Initializing NVMe Controllers 00:24:22.619 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:22.619 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:22.619 Initialization complete. Launching workers. 00:24:22.619 ======================================================== 00:24:22.619 Latency(us) 00:24:22.619 Device Information : IOPS MiB/s Average min max 00:24:22.619 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 76.40 9.55 13098.34 5011.28 51877.18 00:24:22.619 ======================================================== 00:24:22.619 Total : 76.40 9.55 13098.34 5011.28 51877.18 00:24:22.619 00:24:22.619 17:06:32 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:22.619 17:06:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:22.619 17:06:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:22.619 EAL: No free 2048 kB hugepages reported on node 1 00:24:32.580 Initializing NVMe Controllers 00:24:32.580 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:32.580 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:32.580 Initialization complete. Launching workers. 00:24:32.580 ======================================================== 00:24:32.580 Latency(us) 00:24:32.580 Device Information : IOPS MiB/s Average min max 00:24:32.580 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7933.01 3.87 4034.56 315.87 11134.78 00:24:32.580 ======================================================== 00:24:32.580 Total : 7933.01 3.87 4034.56 315.87 11134.78 00:24:32.580 00:24:32.580 17:06:42 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:32.580 17:06:42 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:32.580 EAL: No free 2048 kB hugepages reported on node 1 00:24:42.540 Initializing NVMe Controllers 00:24:42.540 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:42.540 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:42.540 Initialization complete. Launching workers. 00:24:42.540 ======================================================== 00:24:42.540 Latency(us) 00:24:42.540 Device Information : IOPS MiB/s Average min max 00:24:42.540 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3796.55 474.57 8429.48 629.28 18210.98 00:24:42.540 ======================================================== 00:24:42.540 Total : 3796.55 474.57 8429.48 629.28 18210.98 00:24:42.540 00:24:42.540 17:06:53 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:42.540 17:06:53 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:42.540 17:06:53 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:42.540 EAL: No free 2048 kB hugepages reported on node 1 00:24:52.499 Initializing NVMe Controllers 00:24:52.499 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:52.499 Controller IO queue size 128, less than required. 00:24:52.499 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:52.499 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:52.499 Initialization complete. Launching workers. 00:24:52.499 ======================================================== 00:24:52.499 Latency(us) 00:24:52.499 Device Information : IOPS MiB/s Average min max 00:24:52.499 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12151.20 5.93 10542.06 1771.55 47082.85 00:24:52.499 ======================================================== 00:24:52.499 Total : 12151.20 5.93 10542.06 1771.55 47082.85 00:24:52.499 00:24:52.499 17:07:03 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:52.499 17:07:03 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:52.499 EAL: No free 2048 kB hugepages reported on node 1 00:25:04.696 Initializing NVMe Controllers 00:25:04.696 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:04.696 Controller IO queue size 128, less than required. 00:25:04.696 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:04.696 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:04.696 Initialization complete. Launching workers. 00:25:04.696 ======================================================== 00:25:04.696 Latency(us) 00:25:04.696 Device Information : IOPS MiB/s Average min max 00:25:04.696 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1222.53 152.82 105329.94 22363.81 193833.50 00:25:04.696 ======================================================== 00:25:04.696 Total : 1222.53 152.82 105329.94 22363.81 193833.50 00:25:04.696 00:25:04.696 17:07:14 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:04.696 17:07:14 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ef59c7fe-6571-4d3d-ae0e-7a6d877c2e05 00:25:04.696 17:07:15 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:04.696 17:07:15 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4f4726c3-7476-4f77-84d9-1bdeb93de1ba 00:25:04.696 17:07:15 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:04.696 17:07:15 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:25:04.696 17:07:15 -- host/perf.sh@114 -- # nvmftestfini 00:25:04.696 17:07:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:04.696 17:07:15 -- nvmf/common.sh@116 -- # sync 00:25:04.696 17:07:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:04.696 17:07:15 -- nvmf/common.sh@119 -- # set +e 00:25:04.696 17:07:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:04.696 17:07:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:04.696 rmmod nvme_tcp 00:25:04.696 rmmod nvme_fabrics 00:25:04.696 rmmod nvme_keyring 00:25:04.696 17:07:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:04.696 17:07:15 -- nvmf/common.sh@123 -- # set -e 00:25:04.696 17:07:15 -- nvmf/common.sh@124 -- # return 0 00:25:04.696 17:07:15 -- nvmf/common.sh@477 -- # '[' -n 284389 ']' 00:25:04.696 17:07:15 -- nvmf/common.sh@478 -- # killprocess 284389 00:25:04.696 17:07:15 -- common/autotest_common.sh@936 -- # '[' -z 284389 ']' 00:25:04.696 17:07:15 -- common/autotest_common.sh@940 -- # kill -0 284389 00:25:04.696 17:07:15 -- common/autotest_common.sh@941 -- # uname 00:25:04.696 17:07:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:04.696 17:07:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 284389 00:25:04.696 17:07:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:04.696 17:07:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:04.696 17:07:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 284389' 00:25:04.697 killing process with pid 284389 00:25:04.697 17:07:16 -- common/autotest_common.sh@955 -- # kill 284389 00:25:04.697 17:07:16 -- common/autotest_common.sh@960 -- # wait 284389 00:25:06.596 17:07:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:06.596 17:07:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:06.596 17:07:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:06.596 17:07:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:06.596 17:07:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:06.596 17:07:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:06.596 17:07:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:06.596 17:07:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:08.503 17:07:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:08.503 00:25:08.503 real 1m32.057s 00:25:08.503 user 5m38.332s 00:25:08.503 sys 0m16.555s 00:25:08.503 17:07:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:08.503 17:07:19 -- common/autotest_common.sh@10 -- # set +x 00:25:08.503 ************************************ 00:25:08.503 END TEST nvmf_perf 00:25:08.503 ************************************ 00:25:08.503 17:07:19 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:08.503 17:07:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:08.503 17:07:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:08.503 17:07:19 -- common/autotest_common.sh@10 -- # set +x 00:25:08.503 ************************************ 00:25:08.503 START TEST nvmf_fio_host 00:25:08.503 ************************************ 00:25:08.503 17:07:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:08.503 * Looking for test storage... 00:25:08.503 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:08.503 17:07:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:08.503 17:07:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:08.503 17:07:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:08.503 17:07:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:08.503 17:07:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:08.503 17:07:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:08.503 17:07:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:08.503 17:07:19 -- scripts/common.sh@335 -- # IFS=.-: 00:25:08.503 17:07:19 -- scripts/common.sh@335 -- # read -ra ver1 00:25:08.503 17:07:19 -- scripts/common.sh@336 -- # IFS=.-: 00:25:08.503 17:07:19 -- scripts/common.sh@336 -- # read -ra ver2 00:25:08.503 17:07:19 -- scripts/common.sh@337 -- # local 'op=<' 00:25:08.503 17:07:19 -- scripts/common.sh@339 -- # ver1_l=2 00:25:08.503 17:07:19 -- scripts/common.sh@340 -- # ver2_l=1 00:25:08.503 17:07:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:08.503 17:07:19 -- scripts/common.sh@343 -- # case "$op" in 00:25:08.503 17:07:19 -- scripts/common.sh@344 -- # : 1 00:25:08.503 17:07:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:08.503 17:07:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:08.503 17:07:19 -- scripts/common.sh@364 -- # decimal 1 00:25:08.503 17:07:19 -- scripts/common.sh@352 -- # local d=1 00:25:08.503 17:07:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:08.503 17:07:19 -- scripts/common.sh@354 -- # echo 1 00:25:08.503 17:07:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:08.503 17:07:19 -- scripts/common.sh@365 -- # decimal 2 00:25:08.503 17:07:19 -- scripts/common.sh@352 -- # local d=2 00:25:08.503 17:07:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:08.503 17:07:19 -- scripts/common.sh@354 -- # echo 2 00:25:08.503 17:07:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:08.503 17:07:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:08.503 17:07:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:08.503 17:07:19 -- scripts/common.sh@367 -- # return 0 00:25:08.503 17:07:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:08.503 17:07:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:08.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:08.503 --rc genhtml_branch_coverage=1 00:25:08.503 --rc genhtml_function_coverage=1 00:25:08.503 --rc genhtml_legend=1 00:25:08.503 --rc geninfo_all_blocks=1 00:25:08.503 --rc geninfo_unexecuted_blocks=1 00:25:08.503 00:25:08.503 ' 00:25:08.503 17:07:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:08.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:08.503 --rc genhtml_branch_coverage=1 00:25:08.503 --rc genhtml_function_coverage=1 00:25:08.503 --rc genhtml_legend=1 00:25:08.503 --rc geninfo_all_blocks=1 00:25:08.503 --rc geninfo_unexecuted_blocks=1 00:25:08.503 00:25:08.503 ' 00:25:08.503 17:07:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:08.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:08.503 --rc genhtml_branch_coverage=1 00:25:08.503 --rc genhtml_function_coverage=1 00:25:08.503 --rc genhtml_legend=1 00:25:08.503 --rc geninfo_all_blocks=1 00:25:08.503 --rc geninfo_unexecuted_blocks=1 00:25:08.503 00:25:08.503 ' 00:25:08.503 17:07:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:08.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:08.503 --rc genhtml_branch_coverage=1 00:25:08.503 --rc genhtml_function_coverage=1 00:25:08.503 --rc genhtml_legend=1 00:25:08.503 --rc geninfo_all_blocks=1 00:25:08.503 --rc geninfo_unexecuted_blocks=1 00:25:08.503 00:25:08.503 ' 00:25:08.503 17:07:19 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:08.503 17:07:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:08.503 17:07:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:08.503 17:07:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:08.503 17:07:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.503 17:07:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.503 17:07:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.503 17:07:19 -- paths/export.sh@5 -- # export PATH 00:25:08.503 17:07:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.503 17:07:19 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:08.503 17:07:19 -- nvmf/common.sh@7 -- # uname -s 00:25:08.503 17:07:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:08.503 17:07:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:08.504 17:07:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:08.504 17:07:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:08.504 17:07:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:08.504 17:07:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:08.504 17:07:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:08.504 17:07:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:08.504 17:07:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:08.504 17:07:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:08.504 17:07:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:08.504 17:07:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:08.504 17:07:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:08.504 17:07:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:08.504 17:07:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:08.504 17:07:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:08.504 17:07:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:08.504 17:07:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:08.504 17:07:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:08.504 17:07:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.504 17:07:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.504 17:07:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.504 17:07:19 -- paths/export.sh@5 -- # export PATH 00:25:08.504 17:07:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.504 17:07:19 -- nvmf/common.sh@46 -- # : 0 00:25:08.504 17:07:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:08.504 17:07:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:08.504 17:07:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:08.504 17:07:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:08.504 17:07:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:08.504 17:07:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:08.504 17:07:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:08.504 17:07:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:08.504 17:07:19 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:08.504 17:07:19 -- host/fio.sh@14 -- # nvmftestinit 00:25:08.504 17:07:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:08.504 17:07:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:08.504 17:07:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:08.504 17:07:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:08.504 17:07:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:08.504 17:07:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:08.504 17:07:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:08.504 17:07:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:08.504 17:07:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:08.504 17:07:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:08.504 17:07:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:08.504 17:07:19 -- common/autotest_common.sh@10 -- # set +x 00:25:11.037 17:07:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:11.037 17:07:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:11.037 17:07:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:11.037 17:07:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:11.037 17:07:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:11.037 17:07:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:11.037 17:07:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:11.037 17:07:21 -- nvmf/common.sh@294 -- # net_devs=() 00:25:11.037 17:07:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:11.037 17:07:21 -- nvmf/common.sh@295 -- # e810=() 00:25:11.037 17:07:21 -- nvmf/common.sh@295 -- # local -ga e810 00:25:11.037 17:07:21 -- nvmf/common.sh@296 -- # x722=() 00:25:11.037 17:07:21 -- nvmf/common.sh@296 -- # local -ga x722 00:25:11.037 17:07:21 -- nvmf/common.sh@297 -- # mlx=() 00:25:11.037 17:07:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:11.037 17:07:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:11.037 17:07:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:11.037 17:07:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:11.037 17:07:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:11.037 17:07:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:11.037 17:07:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:11.037 17:07:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:11.038 17:07:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:11.038 17:07:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:11.038 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:11.038 17:07:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:11.038 17:07:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:11.038 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:11.038 17:07:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:11.038 17:07:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:11.038 17:07:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:11.038 17:07:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:11.038 17:07:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:11.038 17:07:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:11.038 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:11.038 17:07:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:11.038 17:07:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:11.038 17:07:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:11.038 17:07:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:11.038 17:07:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:11.038 17:07:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:11.038 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:11.038 17:07:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:11.038 17:07:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:11.038 17:07:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:11.038 17:07:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:11.038 17:07:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:11.038 17:07:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:11.038 17:07:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:11.038 17:07:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:11.038 17:07:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:11.038 17:07:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:11.038 17:07:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:11.038 17:07:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:11.038 17:07:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:11.038 17:07:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:11.038 17:07:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:11.038 17:07:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:11.038 17:07:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:11.038 17:07:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:11.038 17:07:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:11.038 17:07:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:11.038 17:07:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:11.038 17:07:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:11.038 17:07:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:11.038 17:07:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:11.038 17:07:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:11.038 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:11.038 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:25:11.038 00:25:11.038 --- 10.0.0.2 ping statistics --- 00:25:11.038 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:11.038 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:25:11.038 17:07:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:11.038 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:11.038 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:25:11.038 00:25:11.038 --- 10.0.0.1 ping statistics --- 00:25:11.038 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:11.038 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:25:11.038 17:07:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:11.038 17:07:22 -- nvmf/common.sh@410 -- # return 0 00:25:11.038 17:07:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:11.038 17:07:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:11.038 17:07:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:11.038 17:07:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:11.038 17:07:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:11.038 17:07:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:11.038 17:07:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:11.038 17:07:22 -- host/fio.sh@16 -- # [[ y != y ]] 00:25:11.038 17:07:22 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:25:11.038 17:07:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:11.038 17:07:22 -- common/autotest_common.sh@10 -- # set +x 00:25:11.038 17:07:22 -- host/fio.sh@24 -- # nvmfpid=297451 00:25:11.038 17:07:22 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:11.038 17:07:22 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:11.038 17:07:22 -- host/fio.sh@28 -- # waitforlisten 297451 00:25:11.038 17:07:22 -- common/autotest_common.sh@829 -- # '[' -z 297451 ']' 00:25:11.038 17:07:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:11.038 17:07:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:11.038 17:07:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:11.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:11.038 17:07:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:11.038 17:07:22 -- common/autotest_common.sh@10 -- # set +x 00:25:11.038 [2024-11-29 17:07:22.121892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:11.038 [2024-11-29 17:07:22.122017] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:11.038 EAL: No free 2048 kB hugepages reported on node 1 00:25:11.038 [2024-11-29 17:07:22.189526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:11.038 [2024-11-29 17:07:22.304518] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:11.038 [2024-11-29 17:07:22.304691] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:11.038 [2024-11-29 17:07:22.304713] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:11.038 [2024-11-29 17:07:22.304728] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:11.038 [2024-11-29 17:07:22.304811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:11.038 [2024-11-29 17:07:22.304881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:11.038 [2024-11-29 17:07:22.304997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:11.038 [2024-11-29 17:07:22.305000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:11.972 17:07:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:11.972 17:07:23 -- common/autotest_common.sh@862 -- # return 0 00:25:11.972 17:07:23 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:11.972 [2024-11-29 17:07:23.291115] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:11.972 17:07:23 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:25:11.972 17:07:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:11.972 17:07:23 -- common/autotest_common.sh@10 -- # set +x 00:25:11.972 17:07:23 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:25:12.230 Malloc1 00:25:12.230 17:07:23 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:12.488 17:07:23 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:12.746 17:07:24 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:13.004 [2024-11-29 17:07:24.342767] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:13.004 17:07:24 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:13.263 17:07:24 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:25:13.263 17:07:24 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:13.263 17:07:24 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:13.263 17:07:24 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:13.263 17:07:24 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:13.263 17:07:24 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:13.263 17:07:24 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:13.263 17:07:24 -- common/autotest_common.sh@1330 -- # shift 00:25:13.263 17:07:24 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:13.263 17:07:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:13.263 17:07:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:13.263 17:07:24 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:13.263 17:07:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:13.263 17:07:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:13.263 17:07:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:13.263 17:07:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:13.263 17:07:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:13.263 17:07:24 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:13.263 17:07:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:13.263 17:07:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:13.263 17:07:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:13.263 17:07:24 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:13.263 17:07:24 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:13.521 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:13.521 fio-3.35 00:25:13.521 Starting 1 thread 00:25:13.521 EAL: No free 2048 kB hugepages reported on node 1 00:25:16.051 00:25:16.051 test: (groupid=0, jobs=1): err= 0: pid=297953: Fri Nov 29 17:07:27 2024 00:25:16.051 read: IOPS=9520, BW=37.2MiB/s (39.0MB/s)(74.6MiB/2006msec) 00:25:16.051 slat (nsec): min=1901, max=159609, avg=2473.35, stdev=1824.16 00:25:16.051 clat (usec): min=2399, max=12781, avg=7367.42, stdev=596.29 00:25:16.051 lat (usec): min=2424, max=12783, avg=7369.90, stdev=596.20 00:25:16.051 clat percentiles (usec): 00:25:16.051 | 1.00th=[ 5997], 5.00th=[ 6390], 10.00th=[ 6652], 20.00th=[ 6915], 00:25:16.052 | 30.00th=[ 7111], 40.00th=[ 7242], 50.00th=[ 7373], 60.00th=[ 7504], 00:25:16.052 | 70.00th=[ 7635], 80.00th=[ 7832], 90.00th=[ 8094], 95.00th=[ 8225], 00:25:16.052 | 99.00th=[ 8717], 99.50th=[ 8848], 99.90th=[10683], 99.95th=[11994], 00:25:16.052 | 99.99th=[12780] 00:25:16.052 bw ( KiB/s): min=36704, max=38808, per=99.94%, avg=38058.00, stdev=935.31, samples=4 00:25:16.052 iops : min= 9176, max= 9702, avg=9514.50, stdev=233.83, samples=4 00:25:16.052 write: IOPS=9529, BW=37.2MiB/s (39.0MB/s)(74.7MiB/2006msec); 0 zone resets 00:25:16.052 slat (nsec): min=1998, max=129500, avg=2579.21, stdev=1321.24 00:25:16.052 clat (usec): min=1393, max=11561, avg=6011.97, stdev=499.45 00:25:16.052 lat (usec): min=1402, max=11563, avg=6014.55, stdev=499.40 00:25:16.052 clat percentiles (usec): 00:25:16.052 | 1.00th=[ 4883], 5.00th=[ 5276], 10.00th=[ 5473], 20.00th=[ 5669], 00:25:16.052 | 30.00th=[ 5800], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6128], 00:25:16.052 | 70.00th=[ 6259], 80.00th=[ 6390], 90.00th=[ 6587], 95.00th=[ 6718], 00:25:16.052 | 99.00th=[ 7111], 99.50th=[ 7242], 99.90th=[ 9110], 99.95th=[10552], 00:25:16.052 | 99.99th=[11469] 00:25:16.052 bw ( KiB/s): min=37656, max=38560, per=100.00%, avg=38118.00, stdev=430.88, samples=4 00:25:16.052 iops : min= 9414, max= 9640, avg=9529.50, stdev=107.72, samples=4 00:25:16.052 lat (msec) : 2=0.03%, 4=0.11%, 10=99.76%, 20=0.10% 00:25:16.052 cpu : usr=63.14%, sys=34.96%, ctx=107, majf=0, minf=41 00:25:16.052 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:16.052 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:16.052 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:16.052 issued rwts: total=19098,19117,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:16.052 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:16.052 00:25:16.052 Run status group 0 (all jobs): 00:25:16.052 READ: bw=37.2MiB/s (39.0MB/s), 37.2MiB/s-37.2MiB/s (39.0MB/s-39.0MB/s), io=74.6MiB (78.2MB), run=2006-2006msec 00:25:16.052 WRITE: bw=37.2MiB/s (39.0MB/s), 37.2MiB/s-37.2MiB/s (39.0MB/s-39.0MB/s), io=74.7MiB (78.3MB), run=2006-2006msec 00:25:16.052 17:07:27 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:16.052 17:07:27 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:16.052 17:07:27 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:16.052 17:07:27 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:16.052 17:07:27 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:16.052 17:07:27 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:16.052 17:07:27 -- common/autotest_common.sh@1330 -- # shift 00:25:16.052 17:07:27 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:16.052 17:07:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:16.052 17:07:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:16.052 17:07:27 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:16.052 17:07:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:16.052 17:07:27 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:16.052 17:07:27 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:16.052 17:07:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:16.052 17:07:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:16.052 17:07:27 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:16.052 17:07:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:16.052 17:07:27 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:16.052 17:07:27 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:16.052 17:07:27 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:16.052 17:07:27 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:16.052 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:25:16.052 fio-3.35 00:25:16.052 Starting 1 thread 00:25:16.052 EAL: No free 2048 kB hugepages reported on node 1 00:25:18.584 00:25:18.584 test: (groupid=0, jobs=1): err= 0: pid=298299: Fri Nov 29 17:07:29 2024 00:25:18.584 read: IOPS=8793, BW=137MiB/s (144MB/s)(276MiB/2006msec) 00:25:18.584 slat (nsec): min=2824, max=94712, avg=3618.51, stdev=2073.63 00:25:18.584 clat (usec): min=2453, max=16959, avg=8418.16, stdev=1963.52 00:25:18.584 lat (usec): min=2457, max=16963, avg=8421.78, stdev=1963.61 00:25:18.584 clat percentiles (usec): 00:25:18.584 | 1.00th=[ 4490], 5.00th=[ 5342], 10.00th=[ 5932], 20.00th=[ 6652], 00:25:18.584 | 30.00th=[ 7242], 40.00th=[ 7832], 50.00th=[ 8356], 60.00th=[ 8979], 00:25:18.584 | 70.00th=[ 9503], 80.00th=[10028], 90.00th=[11076], 95.00th=[11600], 00:25:18.584 | 99.00th=[12911], 99.50th=[13829], 99.90th=[16057], 99.95th=[16581], 00:25:18.584 | 99.99th=[16909] 00:25:18.584 bw ( KiB/s): min=63136, max=81056, per=51.12%, avg=71920.00, stdev=8574.63, samples=4 00:25:18.584 iops : min= 3946, max= 5066, avg=4495.00, stdev=535.91, samples=4 00:25:18.584 write: IOPS=5218, BW=81.5MiB/s (85.5MB/s)(146MiB/1796msec); 0 zone resets 00:25:18.584 slat (usec): min=30, max=145, avg=33.85, stdev= 5.61 00:25:18.584 clat (usec): min=4398, max=18296, avg=10805.06, stdev=1876.93 00:25:18.584 lat (usec): min=4431, max=18326, avg=10838.91, stdev=1876.74 00:25:18.584 clat percentiles (usec): 00:25:18.584 | 1.00th=[ 7111], 5.00th=[ 8160], 10.00th=[ 8586], 20.00th=[ 9241], 00:25:18.584 | 30.00th=[ 9765], 40.00th=[10159], 50.00th=[10552], 60.00th=[10945], 00:25:18.584 | 70.00th=[11600], 80.00th=[12256], 90.00th=[13566], 95.00th=[14222], 00:25:18.584 | 99.00th=[15795], 99.50th=[16581], 99.90th=[17695], 99.95th=[17957], 00:25:18.584 | 99.99th=[18220] 00:25:18.584 bw ( KiB/s): min=66592, max=83808, per=89.80%, avg=74976.00, stdev=8623.79, samples=4 00:25:18.584 iops : min= 4162, max= 5238, avg=4686.00, stdev=538.99, samples=4 00:25:18.584 lat (msec) : 4=0.27%, 10=63.91%, 20=35.82% 00:25:18.584 cpu : usr=75.72%, sys=23.03%, ctx=43, majf=0, minf=71 00:25:18.584 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:25:18.584 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:18.584 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:18.584 issued rwts: total=17640,9372,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:18.584 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:18.584 00:25:18.584 Run status group 0 (all jobs): 00:25:18.584 READ: bw=137MiB/s (144MB/s), 137MiB/s-137MiB/s (144MB/s-144MB/s), io=276MiB (289MB), run=2006-2006msec 00:25:18.584 WRITE: bw=81.5MiB/s (85.5MB/s), 81.5MiB/s-81.5MiB/s (85.5MB/s-85.5MB/s), io=146MiB (154MB), run=1796-1796msec 00:25:18.584 17:07:29 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:18.842 17:07:30 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:18.842 17:07:30 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:18.842 17:07:30 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:18.842 17:07:30 -- common/autotest_common.sh@1508 -- # bdfs=() 00:25:18.842 17:07:30 -- common/autotest_common.sh@1508 -- # local bdfs 00:25:18.842 17:07:30 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:18.842 17:07:30 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:18.842 17:07:30 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:25:18.842 17:07:30 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:25:18.842 17:07:30 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:25:18.842 17:07:30 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:22.125 Nvme0n1 00:25:22.125 17:07:33 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:25.407 17:07:36 -- host/fio.sh@53 -- # ls_guid=d5e60727-dde2-4ba9-bc11-4d89364ab05b 00:25:25.407 17:07:36 -- host/fio.sh@54 -- # get_lvs_free_mb d5e60727-dde2-4ba9-bc11-4d89364ab05b 00:25:25.407 17:07:36 -- common/autotest_common.sh@1353 -- # local lvs_uuid=d5e60727-dde2-4ba9-bc11-4d89364ab05b 00:25:25.407 17:07:36 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:25.407 17:07:36 -- common/autotest_common.sh@1355 -- # local fc 00:25:25.407 17:07:36 -- common/autotest_common.sh@1356 -- # local cs 00:25:25.407 17:07:36 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:25.407 17:07:36 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:25.407 { 00:25:25.407 "uuid": "d5e60727-dde2-4ba9-bc11-4d89364ab05b", 00:25:25.407 "name": "lvs_0", 00:25:25.407 "base_bdev": "Nvme0n1", 00:25:25.407 "total_data_clusters": 930, 00:25:25.407 "free_clusters": 930, 00:25:25.407 "block_size": 512, 00:25:25.407 "cluster_size": 1073741824 00:25:25.407 } 00:25:25.407 ]' 00:25:25.407 17:07:36 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="d5e60727-dde2-4ba9-bc11-4d89364ab05b") .free_clusters' 00:25:25.407 17:07:36 -- common/autotest_common.sh@1358 -- # fc=930 00:25:25.407 17:07:36 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="d5e60727-dde2-4ba9-bc11-4d89364ab05b") .cluster_size' 00:25:25.407 17:07:36 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:25.407 17:07:36 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:25.407 17:07:36 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:25.407 952320 00:25:25.407 17:07:36 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:25.664 831c8c44-c2f8-4bcf-ab57-1cbdd6bbd9a3 00:25:25.665 17:07:36 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:25.921 17:07:37 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:26.179 17:07:37 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:26.437 17:07:37 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:26.437 17:07:37 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:26.437 17:07:37 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:26.437 17:07:37 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:26.437 17:07:37 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:26.437 17:07:37 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:26.437 17:07:37 -- common/autotest_common.sh@1330 -- # shift 00:25:26.437 17:07:37 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:26.437 17:07:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:26.437 17:07:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:26.437 17:07:37 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:26.437 17:07:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:26.437 17:07:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:26.437 17:07:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:26.437 17:07:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:26.437 17:07:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:26.437 17:07:37 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:26.437 17:07:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:26.437 17:07:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:26.437 17:07:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:26.437 17:07:37 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:26.437 17:07:37 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:26.694 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:26.695 fio-3.35 00:25:26.695 Starting 1 thread 00:25:26.695 EAL: No free 2048 kB hugepages reported on node 1 00:25:29.222 00:25:29.222 test: (groupid=0, jobs=1): err= 0: pid=299734: Fri Nov 29 17:07:40 2024 00:25:29.222 read: IOPS=6308, BW=24.6MiB/s (25.8MB/s)(49.5MiB/2008msec) 00:25:29.222 slat (nsec): min=1983, max=131502, avg=2561.20, stdev=2019.74 00:25:29.222 clat (usec): min=788, max=170832, avg=11153.87, stdev=11369.89 00:25:29.222 lat (usec): min=791, max=170861, avg=11156.43, stdev=11370.10 00:25:29.222 clat percentiles (msec): 00:25:29.222 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:25:29.222 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:25:29.222 | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 12], 00:25:29.222 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:29.222 | 99.99th=[ 171] 00:25:29.222 bw ( KiB/s): min=17944, max=27928, per=99.91%, avg=25210.00, stdev=4850.55, samples=4 00:25:29.222 iops : min= 4486, max= 6982, avg=6302.50, stdev=1212.64, samples=4 00:25:29.222 write: IOPS=6301, BW=24.6MiB/s (25.8MB/s)(49.4MiB/2008msec); 0 zone resets 00:25:29.222 slat (nsec): min=2063, max=94994, avg=2692.63, stdev=1676.26 00:25:29.222 clat (usec): min=347, max=169148, avg=9046.34, stdev=10674.02 00:25:29.222 lat (usec): min=349, max=169153, avg=9049.03, stdev=10674.24 00:25:29.222 clat percentiles (msec): 00:25:29.222 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:25:29.222 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:25:29.222 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:25:29.222 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:29.222 | 99.99th=[ 169] 00:25:29.222 bw ( KiB/s): min=18928, max=27376, per=99.88%, avg=25178.00, stdev=4167.83, samples=4 00:25:29.222 iops : min= 4732, max= 6844, avg=6294.50, stdev=1041.96, samples=4 00:25:29.222 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:29.222 lat (msec) : 2=0.02%, 4=0.14%, 10=66.14%, 20=33.17%, 250=0.51% 00:25:29.222 cpu : usr=59.14%, sys=39.46%, ctx=122, majf=0, minf=41 00:25:29.222 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:29.222 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:29.222 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:29.222 issued rwts: total=12667,12654,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:29.222 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:29.222 00:25:29.222 Run status group 0 (all jobs): 00:25:29.222 READ: bw=24.6MiB/s (25.8MB/s), 24.6MiB/s-24.6MiB/s (25.8MB/s-25.8MB/s), io=49.5MiB (51.9MB), run=2008-2008msec 00:25:29.222 WRITE: bw=24.6MiB/s (25.8MB/s), 24.6MiB/s-24.6MiB/s (25.8MB/s-25.8MB/s), io=49.4MiB (51.8MB), run=2008-2008msec 00:25:29.222 17:07:40 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:29.481 17:07:40 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:30.853 17:07:41 -- host/fio.sh@64 -- # ls_nested_guid=7dbcf26f-a163-495f-ab37-b383ea183734 00:25:30.853 17:07:41 -- host/fio.sh@65 -- # get_lvs_free_mb 7dbcf26f-a163-495f-ab37-b383ea183734 00:25:30.853 17:07:41 -- common/autotest_common.sh@1353 -- # local lvs_uuid=7dbcf26f-a163-495f-ab37-b383ea183734 00:25:30.853 17:07:41 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:30.853 17:07:41 -- common/autotest_common.sh@1355 -- # local fc 00:25:30.853 17:07:41 -- common/autotest_common.sh@1356 -- # local cs 00:25:30.853 17:07:41 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:30.853 17:07:42 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:30.853 { 00:25:30.853 "uuid": "d5e60727-dde2-4ba9-bc11-4d89364ab05b", 00:25:30.853 "name": "lvs_0", 00:25:30.853 "base_bdev": "Nvme0n1", 00:25:30.853 "total_data_clusters": 930, 00:25:30.853 "free_clusters": 0, 00:25:30.853 "block_size": 512, 00:25:30.853 "cluster_size": 1073741824 00:25:30.853 }, 00:25:30.853 { 00:25:30.853 "uuid": "7dbcf26f-a163-495f-ab37-b383ea183734", 00:25:30.853 "name": "lvs_n_0", 00:25:30.853 "base_bdev": "831c8c44-c2f8-4bcf-ab57-1cbdd6bbd9a3", 00:25:30.853 "total_data_clusters": 237847, 00:25:30.853 "free_clusters": 237847, 00:25:30.853 "block_size": 512, 00:25:30.853 "cluster_size": 4194304 00:25:30.854 } 00:25:30.854 ]' 00:25:30.854 17:07:42 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="7dbcf26f-a163-495f-ab37-b383ea183734") .free_clusters' 00:25:30.854 17:07:42 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:30.854 17:07:42 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="7dbcf26f-a163-495f-ab37-b383ea183734") .cluster_size' 00:25:30.854 17:07:42 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:30.854 17:07:42 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:30.854 17:07:42 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:30.854 951388 00:25:30.854 17:07:42 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:31.419 017ad3db-8daf-4d90-a606-a176c15d06cb 00:25:31.419 17:07:42 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:31.677 17:07:43 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:31.934 17:07:43 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:32.192 17:07:43 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:32.192 17:07:43 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:32.192 17:07:43 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:32.192 17:07:43 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:32.192 17:07:43 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:32.192 17:07:43 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:32.192 17:07:43 -- common/autotest_common.sh@1330 -- # shift 00:25:32.192 17:07:43 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:32.192 17:07:43 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:32.192 17:07:43 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:32.192 17:07:43 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:32.192 17:07:43 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:32.192 17:07:43 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:32.192 17:07:43 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:32.192 17:07:43 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:32.192 17:07:43 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:32.192 17:07:43 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:32.192 17:07:43 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:32.192 17:07:43 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:32.192 17:07:43 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:32.192 17:07:43 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:32.192 17:07:43 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:32.451 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:32.451 fio-3.35 00:25:32.451 Starting 1 thread 00:25:32.451 EAL: No free 2048 kB hugepages reported on node 1 00:25:34.995 00:25:34.995 test: (groupid=0, jobs=1): err= 0: pid=300494: Fri Nov 29 17:07:46 2024 00:25:34.995 read: IOPS=6290, BW=24.6MiB/s (25.8MB/s)(49.3MiB/2007msec) 00:25:34.995 slat (nsec): min=1937, max=149647, avg=2540.56, stdev=2008.14 00:25:34.995 clat (usec): min=3928, max=18194, avg=11213.47, stdev=985.59 00:25:34.995 lat (usec): min=3957, max=18196, avg=11216.01, stdev=985.48 00:25:34.995 clat percentiles (usec): 00:25:34.995 | 1.00th=[ 8848], 5.00th=[ 9765], 10.00th=[10028], 20.00th=[10421], 00:25:34.995 | 30.00th=[10683], 40.00th=[10945], 50.00th=[11207], 60.00th=[11469], 00:25:34.995 | 70.00th=[11731], 80.00th=[11994], 90.00th=[12387], 95.00th=[12780], 00:25:34.995 | 99.00th=[13304], 99.50th=[13566], 99.90th=[17171], 99.95th=[17171], 00:25:34.995 | 99.99th=[18220] 00:25:34.995 bw ( KiB/s): min=24144, max=25536, per=99.79%, avg=25110.00, stdev=654.16, samples=4 00:25:34.995 iops : min= 6036, max= 6384, avg=6277.50, stdev=163.54, samples=4 00:25:34.995 write: IOPS=6281, BW=24.5MiB/s (25.7MB/s)(49.2MiB/2007msec); 0 zone resets 00:25:34.995 slat (usec): min=2, max=131, avg= 2.67, stdev= 1.59 00:25:34.995 clat (usec): min=2825, max=15486, avg=9047.98, stdev=814.95 00:25:34.995 lat (usec): min=2834, max=15489, avg=9050.65, stdev=814.95 00:25:34.995 clat percentiles (usec): 00:25:34.995 | 1.00th=[ 7111], 5.00th=[ 7832], 10.00th=[ 8094], 20.00th=[ 8455], 00:25:34.995 | 30.00th=[ 8717], 40.00th=[ 8848], 50.00th=[ 9110], 60.00th=[ 9241], 00:25:34.995 | 70.00th=[ 9372], 80.00th=[ 9634], 90.00th=[10028], 95.00th=[10290], 00:25:34.995 | 99.00th=[10814], 99.50th=[11076], 99.90th=[13173], 99.95th=[14484], 00:25:34.995 | 99.99th=[15270] 00:25:34.995 bw ( KiB/s): min=24920, max=25192, per=99.90%, avg=25098.00, stdev=128.40, samples=4 00:25:34.995 iops : min= 6230, max= 6298, avg=6274.50, stdev=32.10, samples=4 00:25:34.995 lat (msec) : 4=0.05%, 10=49.22%, 20=50.73% 00:25:34.995 cpu : usr=63.41%, sys=35.24%, ctx=98, majf=0, minf=41 00:25:34.995 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:34.995 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:34.995 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:34.995 issued rwts: total=12625,12606,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:34.995 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:34.995 00:25:34.995 Run status group 0 (all jobs): 00:25:34.995 READ: bw=24.6MiB/s (25.8MB/s), 24.6MiB/s-24.6MiB/s (25.8MB/s-25.8MB/s), io=49.3MiB (51.7MB), run=2007-2007msec 00:25:34.995 WRITE: bw=24.5MiB/s (25.7MB/s), 24.5MiB/s-24.5MiB/s (25.7MB/s-25.7MB/s), io=49.2MiB (51.6MB), run=2007-2007msec 00:25:34.995 17:07:46 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:34.995 17:07:46 -- host/fio.sh@74 -- # sync 00:25:34.995 17:07:46 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:39.178 17:07:50 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:39.178 17:07:50 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:42.454 17:07:53 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:42.454 17:07:53 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:44.350 17:07:55 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:44.350 17:07:55 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:44.350 17:07:55 -- host/fio.sh@86 -- # nvmftestfini 00:25:44.350 17:07:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:44.350 17:07:55 -- nvmf/common.sh@116 -- # sync 00:25:44.350 17:07:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:44.350 17:07:55 -- nvmf/common.sh@119 -- # set +e 00:25:44.350 17:07:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:44.350 17:07:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:44.350 rmmod nvme_tcp 00:25:44.350 rmmod nvme_fabrics 00:25:44.350 rmmod nvme_keyring 00:25:44.350 17:07:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:44.350 17:07:55 -- nvmf/common.sh@123 -- # set -e 00:25:44.350 17:07:55 -- nvmf/common.sh@124 -- # return 0 00:25:44.350 17:07:55 -- nvmf/common.sh@477 -- # '[' -n 297451 ']' 00:25:44.350 17:07:55 -- nvmf/common.sh@478 -- # killprocess 297451 00:25:44.350 17:07:55 -- common/autotest_common.sh@936 -- # '[' -z 297451 ']' 00:25:44.350 17:07:55 -- common/autotest_common.sh@940 -- # kill -0 297451 00:25:44.350 17:07:55 -- common/autotest_common.sh@941 -- # uname 00:25:44.350 17:07:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:44.350 17:07:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 297451 00:25:44.350 17:07:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:44.350 17:07:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:44.350 17:07:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 297451' 00:25:44.350 killing process with pid 297451 00:25:44.350 17:07:55 -- common/autotest_common.sh@955 -- # kill 297451 00:25:44.350 17:07:55 -- common/autotest_common.sh@960 -- # wait 297451 00:25:44.610 17:07:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:44.610 17:07:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:44.610 17:07:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:44.610 17:07:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:44.610 17:07:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:44.610 17:07:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:44.610 17:07:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:44.610 17:07:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.147 17:07:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:47.147 00:25:47.147 real 0m38.260s 00:25:47.147 user 2m26.591s 00:25:47.147 sys 0m7.130s 00:25:47.147 17:07:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:47.147 17:07:58 -- common/autotest_common.sh@10 -- # set +x 00:25:47.147 ************************************ 00:25:47.147 END TEST nvmf_fio_host 00:25:47.147 ************************************ 00:25:47.147 17:07:58 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:47.147 17:07:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:47.147 17:07:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:47.147 17:07:58 -- common/autotest_common.sh@10 -- # set +x 00:25:47.147 ************************************ 00:25:47.147 START TEST nvmf_failover 00:25:47.147 ************************************ 00:25:47.147 17:07:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:47.147 * Looking for test storage... 00:25:47.147 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:47.147 17:07:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:47.147 17:07:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:47.147 17:07:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:47.147 17:07:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:47.147 17:07:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:47.147 17:07:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:47.147 17:07:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:47.147 17:07:58 -- scripts/common.sh@335 -- # IFS=.-: 00:25:47.147 17:07:58 -- scripts/common.sh@335 -- # read -ra ver1 00:25:47.147 17:07:58 -- scripts/common.sh@336 -- # IFS=.-: 00:25:47.147 17:07:58 -- scripts/common.sh@336 -- # read -ra ver2 00:25:47.147 17:07:58 -- scripts/common.sh@337 -- # local 'op=<' 00:25:47.147 17:07:58 -- scripts/common.sh@339 -- # ver1_l=2 00:25:47.147 17:07:58 -- scripts/common.sh@340 -- # ver2_l=1 00:25:47.147 17:07:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:47.147 17:07:58 -- scripts/common.sh@343 -- # case "$op" in 00:25:47.147 17:07:58 -- scripts/common.sh@344 -- # : 1 00:25:47.147 17:07:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:47.147 17:07:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:47.147 17:07:58 -- scripts/common.sh@364 -- # decimal 1 00:25:47.147 17:07:58 -- scripts/common.sh@352 -- # local d=1 00:25:47.147 17:07:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:47.147 17:07:58 -- scripts/common.sh@354 -- # echo 1 00:25:47.147 17:07:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:47.147 17:07:58 -- scripts/common.sh@365 -- # decimal 2 00:25:47.147 17:07:58 -- scripts/common.sh@352 -- # local d=2 00:25:47.147 17:07:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:47.147 17:07:58 -- scripts/common.sh@354 -- # echo 2 00:25:47.147 17:07:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:47.147 17:07:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:47.147 17:07:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:47.147 17:07:58 -- scripts/common.sh@367 -- # return 0 00:25:47.147 17:07:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:47.147 17:07:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:47.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.147 --rc genhtml_branch_coverage=1 00:25:47.147 --rc genhtml_function_coverage=1 00:25:47.147 --rc genhtml_legend=1 00:25:47.147 --rc geninfo_all_blocks=1 00:25:47.147 --rc geninfo_unexecuted_blocks=1 00:25:47.147 00:25:47.147 ' 00:25:47.147 17:07:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:47.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.147 --rc genhtml_branch_coverage=1 00:25:47.147 --rc genhtml_function_coverage=1 00:25:47.147 --rc genhtml_legend=1 00:25:47.147 --rc geninfo_all_blocks=1 00:25:47.147 --rc geninfo_unexecuted_blocks=1 00:25:47.147 00:25:47.147 ' 00:25:47.147 17:07:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:47.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.147 --rc genhtml_branch_coverage=1 00:25:47.147 --rc genhtml_function_coverage=1 00:25:47.147 --rc genhtml_legend=1 00:25:47.147 --rc geninfo_all_blocks=1 00:25:47.147 --rc geninfo_unexecuted_blocks=1 00:25:47.147 00:25:47.147 ' 00:25:47.147 17:07:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:47.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.147 --rc genhtml_branch_coverage=1 00:25:47.147 --rc genhtml_function_coverage=1 00:25:47.147 --rc genhtml_legend=1 00:25:47.147 --rc geninfo_all_blocks=1 00:25:47.147 --rc geninfo_unexecuted_blocks=1 00:25:47.147 00:25:47.147 ' 00:25:47.147 17:07:58 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:47.147 17:07:58 -- nvmf/common.sh@7 -- # uname -s 00:25:47.147 17:07:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:47.147 17:07:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:47.147 17:07:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:47.147 17:07:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:47.147 17:07:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:47.147 17:07:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:47.147 17:07:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:47.147 17:07:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:47.147 17:07:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:47.147 17:07:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:47.148 17:07:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.148 17:07:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.148 17:07:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:47.148 17:07:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:47.148 17:07:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:47.148 17:07:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:47.148 17:07:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:47.148 17:07:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:47.148 17:07:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:47.148 17:07:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.148 17:07:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.148 17:07:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.148 17:07:58 -- paths/export.sh@5 -- # export PATH 00:25:47.148 17:07:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.148 17:07:58 -- nvmf/common.sh@46 -- # : 0 00:25:47.148 17:07:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:47.148 17:07:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:47.148 17:07:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:47.148 17:07:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:47.148 17:07:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:47.148 17:07:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:47.148 17:07:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:47.148 17:07:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:47.148 17:07:58 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:47.148 17:07:58 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:47.148 17:07:58 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:47.148 17:07:58 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:47.148 17:07:58 -- host/failover.sh@18 -- # nvmftestinit 00:25:47.148 17:07:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:47.148 17:07:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:47.148 17:07:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:47.148 17:07:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:47.148 17:07:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:47.148 17:07:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:47.148 17:07:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:47.148 17:07:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.148 17:07:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:47.148 17:07:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:47.148 17:07:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:47.148 17:07:58 -- common/autotest_common.sh@10 -- # set +x 00:25:49.051 17:08:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:49.051 17:08:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:49.051 17:08:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:49.051 17:08:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:49.051 17:08:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:49.051 17:08:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:49.051 17:08:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:49.051 17:08:00 -- nvmf/common.sh@294 -- # net_devs=() 00:25:49.051 17:08:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:49.051 17:08:00 -- nvmf/common.sh@295 -- # e810=() 00:25:49.051 17:08:00 -- nvmf/common.sh@295 -- # local -ga e810 00:25:49.051 17:08:00 -- nvmf/common.sh@296 -- # x722=() 00:25:49.051 17:08:00 -- nvmf/common.sh@296 -- # local -ga x722 00:25:49.051 17:08:00 -- nvmf/common.sh@297 -- # mlx=() 00:25:49.051 17:08:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:49.051 17:08:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:49.051 17:08:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:49.051 17:08:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:49.051 17:08:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:49.051 17:08:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.051 17:08:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:49.051 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:49.051 17:08:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.051 17:08:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:49.051 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:49.051 17:08:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:49.051 17:08:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.051 17:08:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.051 17:08:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.051 17:08:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.051 17:08:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:49.051 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:49.051 17:08:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.051 17:08:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.051 17:08:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.051 17:08:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.051 17:08:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.051 17:08:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:49.051 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:49.051 17:08:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.051 17:08:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:49.051 17:08:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:49.051 17:08:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:49.051 17:08:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:49.051 17:08:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:49.051 17:08:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:49.051 17:08:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:49.051 17:08:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:49.051 17:08:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:49.051 17:08:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:49.051 17:08:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:49.051 17:08:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:49.051 17:08:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:49.051 17:08:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:49.051 17:08:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:49.051 17:08:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:49.051 17:08:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:49.051 17:08:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:49.051 17:08:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:49.051 17:08:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:49.051 17:08:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:49.051 17:08:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:49.051 17:08:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:49.051 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:49.051 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.317 ms 00:25:49.051 00:25:49.051 --- 10.0.0.2 ping statistics --- 00:25:49.051 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.051 rtt min/avg/max/mdev = 0.317/0.317/0.317/0.000 ms 00:25:49.051 17:08:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:49.051 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:49.051 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:25:49.051 00:25:49.051 --- 10.0.0.1 ping statistics --- 00:25:49.051 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.051 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:25:49.051 17:08:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:49.051 17:08:00 -- nvmf/common.sh@410 -- # return 0 00:25:49.051 17:08:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:49.051 17:08:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:49.051 17:08:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:49.051 17:08:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:49.051 17:08:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:49.051 17:08:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:49.051 17:08:00 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:49.051 17:08:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:49.051 17:08:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:49.051 17:08:00 -- common/autotest_common.sh@10 -- # set +x 00:25:49.051 17:08:00 -- nvmf/common.sh@469 -- # nvmfpid=303821 00:25:49.051 17:08:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:49.051 17:08:00 -- nvmf/common.sh@470 -- # waitforlisten 303821 00:25:49.051 17:08:00 -- common/autotest_common.sh@829 -- # '[' -z 303821 ']' 00:25:49.051 17:08:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:49.051 17:08:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:49.051 17:08:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:49.051 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:49.051 17:08:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:49.051 17:08:00 -- common/autotest_common.sh@10 -- # set +x 00:25:49.051 [2024-11-29 17:08:00.382299] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:49.052 [2024-11-29 17:08:00.382369] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:49.052 EAL: No free 2048 kB hugepages reported on node 1 00:25:49.052 [2024-11-29 17:08:00.448309] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:49.310 [2024-11-29 17:08:00.560068] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:49.310 [2024-11-29 17:08:00.560216] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:49.310 [2024-11-29 17:08:00.560233] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:49.310 [2024-11-29 17:08:00.560246] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:49.310 [2024-11-29 17:08:00.560333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:49.310 [2024-11-29 17:08:00.560460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:49.310 [2024-11-29 17:08:00.560463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:50.242 17:08:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:50.242 17:08:01 -- common/autotest_common.sh@862 -- # return 0 00:25:50.242 17:08:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:50.242 17:08:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:50.242 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:50.242 17:08:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:50.242 17:08:01 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:50.242 [2024-11-29 17:08:01.595636] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:50.242 17:08:01 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:50.500 Malloc0 00:25:50.500 17:08:01 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:50.758 17:08:02 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:51.016 17:08:02 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:51.274 [2024-11-29 17:08:02.622914] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:51.274 17:08:02 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:51.532 [2024-11-29 17:08:02.867635] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:51.532 17:08:02 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:51.790 [2024-11-29 17:08:03.132533] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:51.790 17:08:03 -- host/failover.sh@31 -- # bdevperf_pid=304248 00:25:51.790 17:08:03 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:51.790 17:08:03 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:51.790 17:08:03 -- host/failover.sh@34 -- # waitforlisten 304248 /var/tmp/bdevperf.sock 00:25:51.790 17:08:03 -- common/autotest_common.sh@829 -- # '[' -z 304248 ']' 00:25:51.790 17:08:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:51.790 17:08:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:51.790 17:08:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:51.790 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:51.790 17:08:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:51.790 17:08:03 -- common/autotest_common.sh@10 -- # set +x 00:25:52.723 17:08:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:52.723 17:08:04 -- common/autotest_common.sh@862 -- # return 0 00:25:52.723 17:08:04 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:53.289 NVMe0n1 00:25:53.289 17:08:04 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:53.547 00:25:53.547 17:08:04 -- host/failover.sh@39 -- # run_test_pid=304395 00:25:53.547 17:08:04 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:53.547 17:08:04 -- host/failover.sh@41 -- # sleep 1 00:25:54.479 17:08:05 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:54.738 [2024-11-29 17:08:06.072506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 [2024-11-29 17:08:06.072767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af3cb0 is same with the state(5) to be set 00:25:54.738 17:08:06 -- host/failover.sh@45 -- # sleep 3 00:25:58.018 17:08:09 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:58.018 00:25:58.276 17:08:09 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:58.276 [2024-11-29 17:08:09.692130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.276 [2024-11-29 17:08:09.692755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af53a0 is same with the state(5) to be set 00:25:58.534 17:08:09 -- host/failover.sh@50 -- # sleep 3 00:26:01.814 17:08:12 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:01.814 [2024-11-29 17:08:12.987023] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:01.814 17:08:13 -- host/failover.sh@55 -- # sleep 1 00:26:02.748 17:08:14 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:03.006 [2024-11-29 17:08:14.292140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.006 [2024-11-29 17:08:14.292455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 [2024-11-29 17:08:14.292767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af5a80 is same with the state(5) to be set 00:26:03.007 17:08:14 -- host/failover.sh@59 -- # wait 304395 00:26:09.570 0 00:26:09.570 17:08:19 -- host/failover.sh@61 -- # killprocess 304248 00:26:09.570 17:08:19 -- common/autotest_common.sh@936 -- # '[' -z 304248 ']' 00:26:09.570 17:08:19 -- common/autotest_common.sh@940 -- # kill -0 304248 00:26:09.570 17:08:19 -- common/autotest_common.sh@941 -- # uname 00:26:09.570 17:08:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:09.570 17:08:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 304248 00:26:09.570 17:08:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:09.570 17:08:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:09.570 17:08:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 304248' 00:26:09.570 killing process with pid 304248 00:26:09.570 17:08:20 -- common/autotest_common.sh@955 -- # kill 304248 00:26:09.570 17:08:20 -- common/autotest_common.sh@960 -- # wait 304248 00:26:09.570 17:08:20 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:09.570 [2024-11-29 17:08:03.187933] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:09.570 [2024-11-29 17:08:03.188064] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid304248 ] 00:26:09.570 EAL: No free 2048 kB hugepages reported on node 1 00:26:09.570 [2024-11-29 17:08:03.246136] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:09.570 [2024-11-29 17:08:03.351706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:09.570 Running I/O for 15 seconds... 00:26:09.570 [2024-11-29 17:08:06.073075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:118208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.570 [2024-11-29 17:08:06.073116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.570 [2024-11-29 17:08:06.073146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.570 [2024-11-29 17:08:06.073162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.570 [2024-11-29 17:08:06.073179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:118232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.570 [2024-11-29 17:08:06.073193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.570 [2024-11-29 17:08:06.073209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:118280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.570 [2024-11-29 17:08:06.073223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.570 [2024-11-29 17:08:06.073238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:118296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.570 [2024-11-29 17:08:06.073253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.570 [2024-11-29 17:08:06.073269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.570 [2024-11-29 17:08:06.073283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.570 [2024-11-29 17:08:06.073299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:118336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.570 [2024-11-29 17:08:06.073313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.570 [2024-11-29 17:08:06.073328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:118352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.570 [2024-11-29 17:08:06.073342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.570 [2024-11-29 17:08:06.073357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:118360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.570 [2024-11-29 17:08:06.073386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.570 [2024-11-29 17:08:06.073401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:118408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.073445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:118416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.073484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:118424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.073515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:117664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:117688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:117712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:117736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:117768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:118432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.073756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:118440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.073783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:118448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.073810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:118456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.073842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:118464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:117816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:117824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.073975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.073992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:117832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:117848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:117856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:117864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:117872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:117880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:117896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:117904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:117912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:117920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:117936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:118480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:118488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.074487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:118496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.074515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:118504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.074542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:118512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.571 [2024-11-29 17:08:06.074569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:118520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.571 [2024-11-29 17:08:06.074597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.571 [2024-11-29 17:08:06.074612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:118528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.074628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:118536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.074658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:118544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.074687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:118552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.074715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.074742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:118568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.074770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:118576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.074798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:118584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.074826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:118592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.074854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:118600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.074882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:118608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.074910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:117960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.074937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.074952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:117968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.074979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:117976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:117984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:118032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:118040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:118072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:118088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:118128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:118136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:118144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:118152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:118184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:118192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:118624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.075465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:118632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.075495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:118640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.075524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:118648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.075552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:118656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:118672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.075641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:118680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.075670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:118688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:118696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.572 [2024-11-29 17:08:06.075735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:118704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:118712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.572 [2024-11-29 17:08:06.075796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.572 [2024-11-29 17:08:06.075811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:118720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.075824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.075838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:118728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.075851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.075866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:118736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.075879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.075894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:118744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.075907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.075921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.075935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.075950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:118760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.075986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:118768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:118776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:118784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:118792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:118800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.076139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:118808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.076173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:118816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.076201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:118824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.076230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:118832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:118840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.076303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:118856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.076359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:118864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:118872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:118880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.076442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:118888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.573 [2024-11-29 17:08:06.076470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:118904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:118200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:118248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:118256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:118264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:118312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:118344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:118368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.076950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.573 [2024-11-29 17:08:06.076988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.573 [2024-11-29 17:08:06.077022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11126a0 is same with the state(5) to be set 00:26:09.573 [2024-11-29 17:08:06.077041] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:09.573 [2024-11-29 17:08:06.077053] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:09.574 [2024-11-29 17:08:06.077065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118400 len:8 PRP1 0x0 PRP2 0x0 00:26:09.574 [2024-11-29 17:08:06.077078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:06.077137] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x11126a0 was disconnected and freed. reset controller. 00:26:09.574 [2024-11-29 17:08:06.077163] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:09.574 [2024-11-29 17:08:06.077200] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.574 [2024-11-29 17:08:06.077219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:06.077234] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.574 [2024-11-29 17:08:06.077253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:06.077273] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.574 [2024-11-29 17:08:06.077286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:06.077300] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.574 [2024-11-29 17:08:06.077312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:06.077326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:09.574 [2024-11-29 17:08:06.077365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f3870 (9): Bad file descriptor 00:26:09.574 [2024-11-29 17:08:06.079675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:09.574 [2024-11-29 17:08:06.193380] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:09.574 [2024-11-29 17:08:09.692971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:6200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:6224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:6248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:6256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:5472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:5552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:5568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:5592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:5616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:5656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:5664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:5672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:5688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:5696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:5736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:5824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:5832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:6304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:6320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:6336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:6352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:6360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:6400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.574 [2024-11-29 17:08:09.693927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:6408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.574 [2024-11-29 17:08:09.693950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.693988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:6448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:6456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:6464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.575 [2024-11-29 17:08:09.694064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:6488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.575 [2024-11-29 17:08:09.694149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:6496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:6504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.575 [2024-11-29 17:08:09.694208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:6520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.575 [2024-11-29 17:08:09.694289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:6528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:6536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:6544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:6568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:6576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:6584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.575 [2024-11-29 17:08:09.694513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:6592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:6600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.575 [2024-11-29 17:08:09.694570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:6608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.575 [2024-11-29 17:08:09.694599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:6616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.575 [2024-11-29 17:08:09.694625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:5856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:5920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:5928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:5944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:6624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:6632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.575 [2024-11-29 17:08:09.694898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:6640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.575 [2024-11-29 17:08:09.694933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.575 [2024-11-29 17:08:09.694948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:6648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.694986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:6656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.695018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:6664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.695046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:6680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:6688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:6696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.695158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:6704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:6712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:6720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:6728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.695285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:6736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.695312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.695345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:6752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.695371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:6768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:6792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.695511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:6800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:5976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:5984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:5992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:6000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:6016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:6048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:6056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:6072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:6096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:6128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:6136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:6168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.695949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.695991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:6184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.696007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.696023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:6808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.696037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.696056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:6816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.576 [2024-11-29 17:08:09.696070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.696084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:6824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.696098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.696112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:6832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.576 [2024-11-29 17:08:09.696126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.576 [2024-11-29 17:08:09.696141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:6208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:6216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:6232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:6240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:6264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:6272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:6288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:6840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.577 [2024-11-29 17:08:09.696398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:6848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.577 [2024-11-29 17:08:09.696424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:6856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.577 [2024-11-29 17:08:09.696456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:6864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:6872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:6880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.577 [2024-11-29 17:08:09.696538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:6888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.577 [2024-11-29 17:08:09.696565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:6296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:6312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:6368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:6384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:6424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:6432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:09.696754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10ffd10 is same with the state(5) to be set 00:26:09.577 [2024-11-29 17:08:09.696787] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:09.577 [2024-11-29 17:08:09.696804] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:09.577 [2024-11-29 17:08:09.696831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6440 len:8 PRP1 0x0 PRP2 0x0 00:26:09.577 [2024-11-29 17:08:09.696844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.696906] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10ffd10 was disconnected and freed. reset controller. 00:26:09.577 [2024-11-29 17:08:09.696924] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:26:09.577 [2024-11-29 17:08:09.696978] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.577 [2024-11-29 17:08:09.696999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.697015] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.577 [2024-11-29 17:08:09.697028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.697042] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.577 [2024-11-29 17:08:09.697055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.697069] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.577 [2024-11-29 17:08:09.697082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:09.697096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:09.577 [2024-11-29 17:08:09.699219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:09.577 [2024-11-29 17:08:09.699274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f3870 (9): Bad file descriptor 00:26:09.577 [2024-11-29 17:08:09.849674] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:09.577 [2024-11-29 17:08:14.292894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:110272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.292936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:14.292992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:109544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.293010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:14.293027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:109552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.293042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:14.293058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:109592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.293072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:14.293087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:109608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.293107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:14.293123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:109624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.293152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:14.293168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:109632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.293181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:14.293196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:109688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.293210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:14.293224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:109696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.293238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.577 [2024-11-29 17:08:14.293268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:110312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.577 [2024-11-29 17:08:14.293280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:110320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:110336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:110344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:110352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:110360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:110376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:110384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:109704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:109712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:109720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:109736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:109744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:109752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:109768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:109784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:109792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:109808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:109824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:109832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:109856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:109864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:109872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:109888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:110408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.293972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.293989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:110424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.294002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:110432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.294030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:110448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.294058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:110472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.294085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:110504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.578 [2024-11-29 17:08:14.294114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:110512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.578 [2024-11-29 17:08:14.294142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:110520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.578 [2024-11-29 17:08:14.294170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:110528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.578 [2024-11-29 17:08:14.294198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:110536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.578 [2024-11-29 17:08:14.294231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:110544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.578 [2024-11-29 17:08:14.294273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:110552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.578 [2024-11-29 17:08:14.294301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:110560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.578 [2024-11-29 17:08:14.294329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:110568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.294359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:110576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.294388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:110584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.578 [2024-11-29 17:08:14.294418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.578 [2024-11-29 17:08:14.294434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:110592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.578 [2024-11-29 17:08:14.294448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:110600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.294476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:110608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.294503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:109912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:109920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:109944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:109960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:109968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:110000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:110008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:110016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:110616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:110624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.294788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:110632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:110640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:110648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:110656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.294898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:110664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:110672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.294979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.294996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:110680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:110688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.295038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:110696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:110704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.295094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:110712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.295121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:110720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:110728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.295178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:110736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.295206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:110744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.579 [2024-11-29 17:08:14.295233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:110752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:110024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:110064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:110080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:110096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:110112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:110120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.579 [2024-11-29 17:08:14.295467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:110136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.579 [2024-11-29 17:08:14.295480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:110168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:110760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.295534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:110768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.295561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:110776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.295589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:110784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.295616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:110176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:110192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:110208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:110224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:110232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:110240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:110248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:110256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:110792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.295874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:110800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.295901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:110808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.295929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.295970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:110816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.295987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:110824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:110832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.296062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:110840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:110848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.296126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:110856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:110864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.296185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:110872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:110264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:110280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:110288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:110296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:110304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:110328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:110368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:110392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:110880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:09.580 [2024-11-29 17:08:14.296514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:110888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:110896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:110400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:110416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:110440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:110456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.580 [2024-11-29 17:08:14.296694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:110464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.580 [2024-11-29 17:08:14.296707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.581 [2024-11-29 17:08:14.296722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:110480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.581 [2024-11-29 17:08:14.296735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.581 [2024-11-29 17:08:14.296750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:110488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:09.581 [2024-11-29 17:08:14.296762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.581 [2024-11-29 17:08:14.296776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1116630 is same with the state(5) to be set 00:26:09.581 [2024-11-29 17:08:14.296793] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:09.581 [2024-11-29 17:08:14.296804] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:09.581 [2024-11-29 17:08:14.296815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:110496 len:8 PRP1 0x0 PRP2 0x0 00:26:09.581 [2024-11-29 17:08:14.296843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.581 [2024-11-29 17:08:14.296905] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1116630 was disconnected and freed. reset controller. 00:26:09.581 [2024-11-29 17:08:14.296924] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:26:09.581 [2024-11-29 17:08:14.296981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.581 [2024-11-29 17:08:14.297006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.581 [2024-11-29 17:08:14.297044] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.581 [2024-11-29 17:08:14.297060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.581 [2024-11-29 17:08:14.297074] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.581 [2024-11-29 17:08:14.297087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.581 [2024-11-29 17:08:14.297100] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.581 [2024-11-29 17:08:14.297113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.581 [2024-11-29 17:08:14.297127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:09.581 [2024-11-29 17:08:14.299321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:09.581 [2024-11-29 17:08:14.299362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f3870 (9): Bad file descriptor 00:26:09.581 [2024-11-29 17:08:14.374611] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:09.581 00:26:09.581 Latency(us) 00:26:09.581 [2024-11-29T16:08:21.012Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:09.581 [2024-11-29T16:08:21.012Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:09.581 Verification LBA range: start 0x0 length 0x4000 00:26:09.581 NVMe0n1 : 15.01 12354.12 48.26 1337.89 0.00 9331.80 628.05 16311.18 00:26:09.581 [2024-11-29T16:08:21.012Z] =================================================================================================================== 00:26:09.581 [2024-11-29T16:08:21.012Z] Total : 12354.12 48.26 1337.89 0.00 9331.80 628.05 16311.18 00:26:09.581 Received shutdown signal, test time was about 15.000000 seconds 00:26:09.581 00:26:09.581 Latency(us) 00:26:09.581 [2024-11-29T16:08:21.012Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:09.581 [2024-11-29T16:08:21.012Z] =================================================================================================================== 00:26:09.581 [2024-11-29T16:08:21.012Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:09.581 17:08:20 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:26:09.581 17:08:20 -- host/failover.sh@65 -- # count=3 00:26:09.581 17:08:20 -- host/failover.sh@67 -- # (( count != 3 )) 00:26:09.581 17:08:20 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:26:09.581 17:08:20 -- host/failover.sh@73 -- # bdevperf_pid=306294 00:26:09.581 17:08:20 -- host/failover.sh@75 -- # waitforlisten 306294 /var/tmp/bdevperf.sock 00:26:09.581 17:08:20 -- common/autotest_common.sh@829 -- # '[' -z 306294 ']' 00:26:09.581 17:08:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:09.581 17:08:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:09.581 17:08:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:09.581 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:09.581 17:08:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:09.581 17:08:20 -- common/autotest_common.sh@10 -- # set +x 00:26:10.151 17:08:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:10.151 17:08:21 -- common/autotest_common.sh@862 -- # return 0 00:26:10.151 17:08:21 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:10.151 [2024-11-29 17:08:21.516486] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:10.152 17:08:21 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:10.411 [2024-11-29 17:08:21.769150] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:26:10.411 17:08:21 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:10.976 NVMe0n1 00:26:10.976 17:08:22 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:11.541 00:26:11.541 17:08:22 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:11.798 00:26:11.798 17:08:23 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:11.798 17:08:23 -- host/failover.sh@82 -- # grep -q NVMe0 00:26:12.056 17:08:23 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:12.313 17:08:23 -- host/failover.sh@87 -- # sleep 3 00:26:15.587 17:08:26 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:15.587 17:08:26 -- host/failover.sh@88 -- # grep -q NVMe0 00:26:15.587 17:08:26 -- host/failover.sh@90 -- # run_test_pid=307117 00:26:15.587 17:08:26 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:15.587 17:08:26 -- host/failover.sh@92 -- # wait 307117 00:26:16.959 0 00:26:16.959 17:08:28 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:16.959 [2024-11-29 17:08:20.320902] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:16.959 [2024-11-29 17:08:20.321023] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid306294 ] 00:26:16.959 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.959 [2024-11-29 17:08:20.382535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.959 [2024-11-29 17:08:20.489760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:16.959 [2024-11-29 17:08:23.632282] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:16.959 [2024-11-29 17:08:23.632375] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:16.959 [2024-11-29 17:08:23.632399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:16.959 [2024-11-29 17:08:23.632416] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:16.959 [2024-11-29 17:08:23.632431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:16.959 [2024-11-29 17:08:23.632445] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:16.959 [2024-11-29 17:08:23.632458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:16.959 [2024-11-29 17:08:23.632473] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:16.959 [2024-11-29 17:08:23.632487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:16.959 [2024-11-29 17:08:23.632502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:16.959 [2024-11-29 17:08:23.632542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:16.959 [2024-11-29 17:08:23.632574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa0870 (9): Bad file descriptor 00:26:16.959 [2024-11-29 17:08:23.638603] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:16.959 Running I/O for 1 seconds... 00:26:16.959 00:26:16.959 Latency(us) 00:26:16.959 [2024-11-29T16:08:28.390Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:16.959 [2024-11-29T16:08:28.390Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:16.959 Verification LBA range: start 0x0 length 0x4000 00:26:16.959 NVMe0n1 : 1.01 12828.88 50.11 0.00 0.00 9926.39 1796.17 15631.55 00:26:16.959 [2024-11-29T16:08:28.390Z] =================================================================================================================== 00:26:16.959 [2024-11-29T16:08:28.390Z] Total : 12828.88 50.11 0.00 0.00 9926.39 1796.17 15631.55 00:26:16.959 17:08:28 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:16.959 17:08:28 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:16.959 17:08:28 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:17.523 17:08:28 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:17.523 17:08:28 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:17.523 17:08:28 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:17.780 17:08:29 -- host/failover.sh@101 -- # sleep 3 00:26:21.060 17:08:32 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:21.060 17:08:32 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:21.060 17:08:32 -- host/failover.sh@108 -- # killprocess 306294 00:26:21.060 17:08:32 -- common/autotest_common.sh@936 -- # '[' -z 306294 ']' 00:26:21.060 17:08:32 -- common/autotest_common.sh@940 -- # kill -0 306294 00:26:21.060 17:08:32 -- common/autotest_common.sh@941 -- # uname 00:26:21.060 17:08:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:21.060 17:08:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 306294 00:26:21.060 17:08:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:21.060 17:08:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:21.060 17:08:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 306294' 00:26:21.060 killing process with pid 306294 00:26:21.060 17:08:32 -- common/autotest_common.sh@955 -- # kill 306294 00:26:21.060 17:08:32 -- common/autotest_common.sh@960 -- # wait 306294 00:26:21.318 17:08:32 -- host/failover.sh@110 -- # sync 00:26:21.318 17:08:32 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:21.576 17:08:32 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:21.576 17:08:32 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:21.576 17:08:32 -- host/failover.sh@116 -- # nvmftestfini 00:26:21.576 17:08:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:21.576 17:08:32 -- nvmf/common.sh@116 -- # sync 00:26:21.576 17:08:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:21.576 17:08:32 -- nvmf/common.sh@119 -- # set +e 00:26:21.576 17:08:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:21.576 17:08:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:21.576 rmmod nvme_tcp 00:26:21.576 rmmod nvme_fabrics 00:26:21.576 rmmod nvme_keyring 00:26:21.834 17:08:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:21.834 17:08:33 -- nvmf/common.sh@123 -- # set -e 00:26:21.834 17:08:33 -- nvmf/common.sh@124 -- # return 0 00:26:21.834 17:08:33 -- nvmf/common.sh@477 -- # '[' -n 303821 ']' 00:26:21.834 17:08:33 -- nvmf/common.sh@478 -- # killprocess 303821 00:26:21.834 17:08:33 -- common/autotest_common.sh@936 -- # '[' -z 303821 ']' 00:26:21.834 17:08:33 -- common/autotest_common.sh@940 -- # kill -0 303821 00:26:21.834 17:08:33 -- common/autotest_common.sh@941 -- # uname 00:26:21.834 17:08:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:21.834 17:08:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 303821 00:26:21.834 17:08:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:21.834 17:08:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:21.834 17:08:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 303821' 00:26:21.834 killing process with pid 303821 00:26:21.834 17:08:33 -- common/autotest_common.sh@955 -- # kill 303821 00:26:21.834 17:08:33 -- common/autotest_common.sh@960 -- # wait 303821 00:26:22.092 17:08:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:22.092 17:08:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:22.092 17:08:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:22.092 17:08:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:22.092 17:08:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:22.092 17:08:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:22.092 17:08:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:22.092 17:08:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:23.995 17:08:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:23.995 00:26:23.995 real 0m37.364s 00:26:23.995 user 2m11.911s 00:26:23.995 sys 0m6.207s 00:26:23.995 17:08:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:23.995 17:08:35 -- common/autotest_common.sh@10 -- # set +x 00:26:23.995 ************************************ 00:26:23.995 END TEST nvmf_failover 00:26:23.995 ************************************ 00:26:23.995 17:08:35 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:23.995 17:08:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:23.995 17:08:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:23.995 17:08:35 -- common/autotest_common.sh@10 -- # set +x 00:26:23.995 ************************************ 00:26:23.995 START TEST nvmf_discovery 00:26:23.995 ************************************ 00:26:23.995 17:08:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:24.254 * Looking for test storage... 00:26:24.254 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:24.254 17:08:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:24.254 17:08:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:24.254 17:08:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:24.254 17:08:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:24.254 17:08:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:24.254 17:08:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:24.254 17:08:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:24.254 17:08:35 -- scripts/common.sh@335 -- # IFS=.-: 00:26:24.254 17:08:35 -- scripts/common.sh@335 -- # read -ra ver1 00:26:24.254 17:08:35 -- scripts/common.sh@336 -- # IFS=.-: 00:26:24.254 17:08:35 -- scripts/common.sh@336 -- # read -ra ver2 00:26:24.254 17:08:35 -- scripts/common.sh@337 -- # local 'op=<' 00:26:24.254 17:08:35 -- scripts/common.sh@339 -- # ver1_l=2 00:26:24.254 17:08:35 -- scripts/common.sh@340 -- # ver2_l=1 00:26:24.254 17:08:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:24.254 17:08:35 -- scripts/common.sh@343 -- # case "$op" in 00:26:24.254 17:08:35 -- scripts/common.sh@344 -- # : 1 00:26:24.254 17:08:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:24.254 17:08:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:24.254 17:08:35 -- scripts/common.sh@364 -- # decimal 1 00:26:24.254 17:08:35 -- scripts/common.sh@352 -- # local d=1 00:26:24.254 17:08:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:24.254 17:08:35 -- scripts/common.sh@354 -- # echo 1 00:26:24.254 17:08:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:24.254 17:08:35 -- scripts/common.sh@365 -- # decimal 2 00:26:24.254 17:08:35 -- scripts/common.sh@352 -- # local d=2 00:26:24.254 17:08:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:24.254 17:08:35 -- scripts/common.sh@354 -- # echo 2 00:26:24.254 17:08:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:24.254 17:08:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:24.254 17:08:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:24.254 17:08:35 -- scripts/common.sh@367 -- # return 0 00:26:24.254 17:08:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:24.254 17:08:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:24.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.254 --rc genhtml_branch_coverage=1 00:26:24.254 --rc genhtml_function_coverage=1 00:26:24.254 --rc genhtml_legend=1 00:26:24.254 --rc geninfo_all_blocks=1 00:26:24.254 --rc geninfo_unexecuted_blocks=1 00:26:24.254 00:26:24.254 ' 00:26:24.254 17:08:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:24.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.254 --rc genhtml_branch_coverage=1 00:26:24.254 --rc genhtml_function_coverage=1 00:26:24.254 --rc genhtml_legend=1 00:26:24.254 --rc geninfo_all_blocks=1 00:26:24.254 --rc geninfo_unexecuted_blocks=1 00:26:24.254 00:26:24.254 ' 00:26:24.254 17:08:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:24.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.254 --rc genhtml_branch_coverage=1 00:26:24.254 --rc genhtml_function_coverage=1 00:26:24.254 --rc genhtml_legend=1 00:26:24.254 --rc geninfo_all_blocks=1 00:26:24.254 --rc geninfo_unexecuted_blocks=1 00:26:24.254 00:26:24.254 ' 00:26:24.254 17:08:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:24.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.254 --rc genhtml_branch_coverage=1 00:26:24.254 --rc genhtml_function_coverage=1 00:26:24.254 --rc genhtml_legend=1 00:26:24.254 --rc geninfo_all_blocks=1 00:26:24.254 --rc geninfo_unexecuted_blocks=1 00:26:24.254 00:26:24.254 ' 00:26:24.254 17:08:35 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:24.254 17:08:35 -- nvmf/common.sh@7 -- # uname -s 00:26:24.254 17:08:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:24.254 17:08:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:24.254 17:08:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:24.254 17:08:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:24.254 17:08:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:24.254 17:08:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:24.254 17:08:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:24.254 17:08:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:24.254 17:08:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:24.254 17:08:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:24.254 17:08:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:24.254 17:08:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:24.254 17:08:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:24.254 17:08:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:24.254 17:08:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:24.254 17:08:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:24.254 17:08:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:24.254 17:08:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:24.254 17:08:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:24.254 17:08:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.254 17:08:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.254 17:08:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.254 17:08:35 -- paths/export.sh@5 -- # export PATH 00:26:24.254 17:08:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.254 17:08:35 -- nvmf/common.sh@46 -- # : 0 00:26:24.254 17:08:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:24.254 17:08:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:24.254 17:08:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:24.254 17:08:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:24.254 17:08:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:24.254 17:08:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:24.254 17:08:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:24.254 17:08:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:24.254 17:08:35 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:24.254 17:08:35 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:24.254 17:08:35 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:24.254 17:08:35 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:24.254 17:08:35 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:24.254 17:08:35 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:24.254 17:08:35 -- host/discovery.sh@25 -- # nvmftestinit 00:26:24.254 17:08:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:24.254 17:08:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:24.254 17:08:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:24.254 17:08:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:24.254 17:08:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:24.254 17:08:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:24.254 17:08:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:24.254 17:08:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:24.254 17:08:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:24.254 17:08:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:24.254 17:08:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:24.254 17:08:35 -- common/autotest_common.sh@10 -- # set +x 00:26:26.155 17:08:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:26.155 17:08:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:26.155 17:08:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:26.155 17:08:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:26.155 17:08:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:26.155 17:08:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:26.155 17:08:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:26.155 17:08:37 -- nvmf/common.sh@294 -- # net_devs=() 00:26:26.155 17:08:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:26.155 17:08:37 -- nvmf/common.sh@295 -- # e810=() 00:26:26.155 17:08:37 -- nvmf/common.sh@295 -- # local -ga e810 00:26:26.155 17:08:37 -- nvmf/common.sh@296 -- # x722=() 00:26:26.155 17:08:37 -- nvmf/common.sh@296 -- # local -ga x722 00:26:26.155 17:08:37 -- nvmf/common.sh@297 -- # mlx=() 00:26:26.155 17:08:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:26.155 17:08:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:26.155 17:08:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:26.155 17:08:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:26.155 17:08:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:26.155 17:08:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:26.155 17:08:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:26.155 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:26.155 17:08:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:26.155 17:08:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:26.155 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:26.155 17:08:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:26.155 17:08:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:26.155 17:08:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:26.155 17:08:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:26.155 17:08:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:26.155 17:08:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:26.155 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:26.155 17:08:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:26.155 17:08:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:26.155 17:08:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:26.155 17:08:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:26.155 17:08:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:26.155 17:08:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:26.155 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:26.155 17:08:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:26.155 17:08:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:26.155 17:08:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:26.155 17:08:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:26.155 17:08:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:26.155 17:08:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:26.155 17:08:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:26.155 17:08:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:26.155 17:08:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:26.155 17:08:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:26.155 17:08:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:26.155 17:08:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:26.155 17:08:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:26.155 17:08:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:26.155 17:08:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:26.155 17:08:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:26.155 17:08:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:26.155 17:08:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:26.155 17:08:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:26.155 17:08:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:26.413 17:08:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:26.413 17:08:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:26.413 17:08:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:26.413 17:08:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:26.413 17:08:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:26.413 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:26.413 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:26:26.413 00:26:26.413 --- 10.0.0.2 ping statistics --- 00:26:26.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:26.413 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:26:26.413 17:08:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:26.413 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:26.413 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:26:26.413 00:26:26.413 --- 10.0.0.1 ping statistics --- 00:26:26.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:26.413 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:26:26.413 17:08:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:26.413 17:08:37 -- nvmf/common.sh@410 -- # return 0 00:26:26.413 17:08:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:26.413 17:08:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:26.413 17:08:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:26.413 17:08:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:26.413 17:08:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:26.413 17:08:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:26.413 17:08:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:26.413 17:08:37 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:26.413 17:08:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:26.413 17:08:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:26.413 17:08:37 -- common/autotest_common.sh@10 -- # set +x 00:26:26.413 17:08:37 -- nvmf/common.sh@469 -- # nvmfpid=309760 00:26:26.413 17:08:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:26.413 17:08:37 -- nvmf/common.sh@470 -- # waitforlisten 309760 00:26:26.413 17:08:37 -- common/autotest_common.sh@829 -- # '[' -z 309760 ']' 00:26:26.413 17:08:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:26.413 17:08:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:26.413 17:08:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:26.413 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:26.413 17:08:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:26.413 17:08:37 -- common/autotest_common.sh@10 -- # set +x 00:26:26.413 [2024-11-29 17:08:37.712337] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:26.413 [2024-11-29 17:08:37.712403] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:26.413 EAL: No free 2048 kB hugepages reported on node 1 00:26:26.413 [2024-11-29 17:08:37.776340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:26.670 [2024-11-29 17:08:37.887910] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:26.670 [2024-11-29 17:08:37.888101] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:26.670 [2024-11-29 17:08:37.888120] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:26.670 [2024-11-29 17:08:37.888133] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:26.670 [2024-11-29 17:08:37.888166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:27.601 17:08:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:27.601 17:08:38 -- common/autotest_common.sh@862 -- # return 0 00:26:27.601 17:08:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:27.601 17:08:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:27.601 17:08:38 -- common/autotest_common.sh@10 -- # set +x 00:26:27.601 17:08:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:27.601 17:08:38 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:27.601 17:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.601 17:08:38 -- common/autotest_common.sh@10 -- # set +x 00:26:27.601 [2024-11-29 17:08:38.763713] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:27.601 17:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.601 17:08:38 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:27.601 17:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.601 17:08:38 -- common/autotest_common.sh@10 -- # set +x 00:26:27.601 [2024-11-29 17:08:38.771943] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:27.601 17:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.601 17:08:38 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:27.601 17:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.601 17:08:38 -- common/autotest_common.sh@10 -- # set +x 00:26:27.601 null0 00:26:27.601 17:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.601 17:08:38 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:27.601 17:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.601 17:08:38 -- common/autotest_common.sh@10 -- # set +x 00:26:27.601 null1 00:26:27.601 17:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.601 17:08:38 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:27.601 17:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.601 17:08:38 -- common/autotest_common.sh@10 -- # set +x 00:26:27.601 17:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.601 17:08:38 -- host/discovery.sh@45 -- # hostpid=309912 00:26:27.601 17:08:38 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:27.601 17:08:38 -- host/discovery.sh@46 -- # waitforlisten 309912 /tmp/host.sock 00:26:27.601 17:08:38 -- common/autotest_common.sh@829 -- # '[' -z 309912 ']' 00:26:27.601 17:08:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:27.601 17:08:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:27.601 17:08:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:27.601 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:27.601 17:08:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:27.601 17:08:38 -- common/autotest_common.sh@10 -- # set +x 00:26:27.601 [2024-11-29 17:08:38.840854] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:27.601 [2024-11-29 17:08:38.840917] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid309912 ] 00:26:27.601 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.601 [2024-11-29 17:08:38.902096] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:27.601 [2024-11-29 17:08:39.015830] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:27.601 [2024-11-29 17:08:39.016045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:28.535 17:08:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:28.535 17:08:39 -- common/autotest_common.sh@862 -- # return 0 00:26:28.535 17:08:39 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:28.535 17:08:39 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:28.535 17:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.535 17:08:39 -- common/autotest_common.sh@10 -- # set +x 00:26:28.535 17:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.535 17:08:39 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:28.535 17:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.535 17:08:39 -- common/autotest_common.sh@10 -- # set +x 00:26:28.535 17:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.535 17:08:39 -- host/discovery.sh@72 -- # notify_id=0 00:26:28.535 17:08:39 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:28.535 17:08:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:28.535 17:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.535 17:08:39 -- common/autotest_common.sh@10 -- # set +x 00:26:28.535 17:08:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:28.535 17:08:39 -- host/discovery.sh@59 -- # sort 00:26:28.535 17:08:39 -- host/discovery.sh@59 -- # xargs 00:26:28.535 17:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.535 17:08:39 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:28.535 17:08:39 -- host/discovery.sh@79 -- # get_bdev_list 00:26:28.535 17:08:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.535 17:08:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:28.535 17:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.535 17:08:39 -- host/discovery.sh@55 -- # sort 00:26:28.535 17:08:39 -- common/autotest_common.sh@10 -- # set +x 00:26:28.535 17:08:39 -- host/discovery.sh@55 -- # xargs 00:26:28.535 17:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.535 17:08:39 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:28.535 17:08:39 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:28.535 17:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.535 17:08:39 -- common/autotest_common.sh@10 -- # set +x 00:26:28.535 17:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.535 17:08:39 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:28.535 17:08:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:28.535 17:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.535 17:08:39 -- common/autotest_common.sh@10 -- # set +x 00:26:28.535 17:08:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:28.535 17:08:39 -- host/discovery.sh@59 -- # sort 00:26:28.535 17:08:39 -- host/discovery.sh@59 -- # xargs 00:26:28.535 17:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.535 17:08:39 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:28.535 17:08:39 -- host/discovery.sh@83 -- # get_bdev_list 00:26:28.535 17:08:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.535 17:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.535 17:08:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:28.535 17:08:39 -- common/autotest_common.sh@10 -- # set +x 00:26:28.535 17:08:39 -- host/discovery.sh@55 -- # sort 00:26:28.535 17:08:39 -- host/discovery.sh@55 -- # xargs 00:26:28.535 17:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.793 17:08:39 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:28.793 17:08:39 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:28.793 17:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.793 17:08:39 -- common/autotest_common.sh@10 -- # set +x 00:26:28.793 17:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.793 17:08:39 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:28.793 17:08:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:28.793 17:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.793 17:08:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:28.793 17:08:39 -- common/autotest_common.sh@10 -- # set +x 00:26:28.793 17:08:39 -- host/discovery.sh@59 -- # sort 00:26:28.793 17:08:39 -- host/discovery.sh@59 -- # xargs 00:26:28.793 17:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.793 17:08:40 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:28.793 17:08:40 -- host/discovery.sh@87 -- # get_bdev_list 00:26:28.793 17:08:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.793 17:08:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:28.793 17:08:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.793 17:08:40 -- common/autotest_common.sh@10 -- # set +x 00:26:28.793 17:08:40 -- host/discovery.sh@55 -- # sort 00:26:28.793 17:08:40 -- host/discovery.sh@55 -- # xargs 00:26:28.793 17:08:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.793 17:08:40 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:28.793 17:08:40 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:28.793 17:08:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.793 17:08:40 -- common/autotest_common.sh@10 -- # set +x 00:26:28.794 [2024-11-29 17:08:40.071648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:28.794 17:08:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.794 17:08:40 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:28.794 17:08:40 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:28.794 17:08:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.794 17:08:40 -- common/autotest_common.sh@10 -- # set +x 00:26:28.794 17:08:40 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:28.794 17:08:40 -- host/discovery.sh@59 -- # sort 00:26:28.794 17:08:40 -- host/discovery.sh@59 -- # xargs 00:26:28.794 17:08:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.794 17:08:40 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:28.794 17:08:40 -- host/discovery.sh@93 -- # get_bdev_list 00:26:28.794 17:08:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.794 17:08:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:28.794 17:08:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.794 17:08:40 -- host/discovery.sh@55 -- # sort 00:26:28.794 17:08:40 -- common/autotest_common.sh@10 -- # set +x 00:26:28.794 17:08:40 -- host/discovery.sh@55 -- # xargs 00:26:28.794 17:08:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.794 17:08:40 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:28.794 17:08:40 -- host/discovery.sh@94 -- # get_notification_count 00:26:28.794 17:08:40 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:28.794 17:08:40 -- host/discovery.sh@74 -- # jq '. | length' 00:26:28.794 17:08:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.794 17:08:40 -- common/autotest_common.sh@10 -- # set +x 00:26:28.794 17:08:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.794 17:08:40 -- host/discovery.sh@74 -- # notification_count=0 00:26:28.794 17:08:40 -- host/discovery.sh@75 -- # notify_id=0 00:26:28.794 17:08:40 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:28.794 17:08:40 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:28.794 17:08:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.794 17:08:40 -- common/autotest_common.sh@10 -- # set +x 00:26:28.794 17:08:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.794 17:08:40 -- host/discovery.sh@100 -- # sleep 1 00:26:29.727 [2024-11-29 17:08:40.863633] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:29.727 [2024-11-29 17:08:40.863665] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:29.727 [2024-11-29 17:08:40.863695] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:29.727 [2024-11-29 17:08:40.949994] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:29.985 [2024-11-29 17:08:41.174092] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:29.985 [2024-11-29 17:08:41.174117] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:29.985 17:08:41 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:29.985 17:08:41 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:29.985 17:08:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.985 17:08:41 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:29.985 17:08:41 -- common/autotest_common.sh@10 -- # set +x 00:26:29.985 17:08:41 -- host/discovery.sh@59 -- # sort 00:26:29.985 17:08:41 -- host/discovery.sh@59 -- # xargs 00:26:29.985 17:08:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.985 17:08:41 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:29.985 17:08:41 -- host/discovery.sh@102 -- # get_bdev_list 00:26:29.985 17:08:41 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:29.985 17:08:41 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:29.985 17:08:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.985 17:08:41 -- common/autotest_common.sh@10 -- # set +x 00:26:29.985 17:08:41 -- host/discovery.sh@55 -- # sort 00:26:29.985 17:08:41 -- host/discovery.sh@55 -- # xargs 00:26:29.985 17:08:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.985 17:08:41 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:29.985 17:08:41 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:29.986 17:08:41 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:29.986 17:08:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.986 17:08:41 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:29.986 17:08:41 -- common/autotest_common.sh@10 -- # set +x 00:26:29.986 17:08:41 -- host/discovery.sh@63 -- # sort -n 00:26:29.986 17:08:41 -- host/discovery.sh@63 -- # xargs 00:26:29.986 17:08:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.986 17:08:41 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:29.986 17:08:41 -- host/discovery.sh@104 -- # get_notification_count 00:26:29.986 17:08:41 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:29.986 17:08:41 -- host/discovery.sh@74 -- # jq '. | length' 00:26:29.986 17:08:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.986 17:08:41 -- common/autotest_common.sh@10 -- # set +x 00:26:29.986 17:08:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.986 17:08:41 -- host/discovery.sh@74 -- # notification_count=1 00:26:29.986 17:08:41 -- host/discovery.sh@75 -- # notify_id=1 00:26:29.986 17:08:41 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:29.986 17:08:41 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:29.986 17:08:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.986 17:08:41 -- common/autotest_common.sh@10 -- # set +x 00:26:29.986 17:08:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.986 17:08:41 -- host/discovery.sh@109 -- # sleep 1 00:26:31.360 17:08:42 -- host/discovery.sh@110 -- # get_bdev_list 00:26:31.360 17:08:42 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:31.360 17:08:42 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:31.360 17:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.360 17:08:42 -- common/autotest_common.sh@10 -- # set +x 00:26:31.360 17:08:42 -- host/discovery.sh@55 -- # sort 00:26:31.360 17:08:42 -- host/discovery.sh@55 -- # xargs 00:26:31.360 17:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.360 17:08:42 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:31.360 17:08:42 -- host/discovery.sh@111 -- # get_notification_count 00:26:31.360 17:08:42 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:31.360 17:08:42 -- host/discovery.sh@74 -- # jq '. | length' 00:26:31.360 17:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.360 17:08:42 -- common/autotest_common.sh@10 -- # set +x 00:26:31.360 17:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.360 17:08:42 -- host/discovery.sh@74 -- # notification_count=1 00:26:31.360 17:08:42 -- host/discovery.sh@75 -- # notify_id=2 00:26:31.360 17:08:42 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:31.360 17:08:42 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:31.360 17:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.360 17:08:42 -- common/autotest_common.sh@10 -- # set +x 00:26:31.360 [2024-11-29 17:08:42.470797] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:31.360 [2024-11-29 17:08:42.471176] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:31.360 [2024-11-29 17:08:42.471219] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:31.360 17:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.360 17:08:42 -- host/discovery.sh@117 -- # sleep 1 00:26:31.360 [2024-11-29 17:08:42.557454] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:31.621 [2024-11-29 17:08:42.860964] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:31.621 [2024-11-29 17:08:42.861006] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:31.621 [2024-11-29 17:08:42.861015] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:32.187 17:08:43 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:32.187 17:08:43 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:32.187 17:08:43 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:32.187 17:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.187 17:08:43 -- host/discovery.sh@59 -- # sort 00:26:32.187 17:08:43 -- common/autotest_common.sh@10 -- # set +x 00:26:32.187 17:08:43 -- host/discovery.sh@59 -- # xargs 00:26:32.187 17:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.187 17:08:43 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:32.187 17:08:43 -- host/discovery.sh@119 -- # get_bdev_list 00:26:32.187 17:08:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.187 17:08:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:32.187 17:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.187 17:08:43 -- common/autotest_common.sh@10 -- # set +x 00:26:32.187 17:08:43 -- host/discovery.sh@55 -- # sort 00:26:32.187 17:08:43 -- host/discovery.sh@55 -- # xargs 00:26:32.187 17:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.187 17:08:43 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:32.187 17:08:43 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:32.187 17:08:43 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:32.187 17:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.187 17:08:43 -- common/autotest_common.sh@10 -- # set +x 00:26:32.187 17:08:43 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:32.187 17:08:43 -- host/discovery.sh@63 -- # sort -n 00:26:32.187 17:08:43 -- host/discovery.sh@63 -- # xargs 00:26:32.187 17:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.187 17:08:43 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:32.187 17:08:43 -- host/discovery.sh@121 -- # get_notification_count 00:26:32.187 17:08:43 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:32.187 17:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.187 17:08:43 -- common/autotest_common.sh@10 -- # set +x 00:26:32.187 17:08:43 -- host/discovery.sh@74 -- # jq '. | length' 00:26:32.187 17:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.445 17:08:43 -- host/discovery.sh@74 -- # notification_count=0 00:26:32.445 17:08:43 -- host/discovery.sh@75 -- # notify_id=2 00:26:32.445 17:08:43 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:32.445 17:08:43 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:32.445 17:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.445 17:08:43 -- common/autotest_common.sh@10 -- # set +x 00:26:32.445 [2024-11-29 17:08:43.638443] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:32.445 [2024-11-29 17:08:43.638475] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:32.445 17:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.445 17:08:43 -- host/discovery.sh@127 -- # sleep 1 00:26:32.445 [2024-11-29 17:08:43.647616] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:32.445 [2024-11-29 17:08:43.647652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:32.445 [2024-11-29 17:08:43.647695] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:32.445 [2024-11-29 17:08:43.647709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:32.445 [2024-11-29 17:08:43.647723] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:32.445 [2024-11-29 17:08:43.647736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:32.445 [2024-11-29 17:08:43.647751] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:32.445 [2024-11-29 17:08:43.647764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:32.445 [2024-11-29 17:08:43.647777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1997810 is same with the state(5) to be set 00:26:32.445 [2024-11-29 17:08:43.657618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1997810 (9): Bad file descriptor 00:26:32.445 [2024-11-29 17:08:43.667668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:32.445 [2024-11-29 17:08:43.667892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.445 [2024-11-29 17:08:43.668042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.445 [2024-11-29 17:08:43.668071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1997810 with addr=10.0.0.2, port=4420 00:26:32.445 [2024-11-29 17:08:43.668088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1997810 is same with the state(5) to be set 00:26:32.445 [2024-11-29 17:08:43.668113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1997810 (9): Bad file descriptor 00:26:32.445 [2024-11-29 17:08:43.668135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:32.445 [2024-11-29 17:08:43.668149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:32.445 [2024-11-29 17:08:43.668165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:32.445 [2024-11-29 17:08:43.668185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:32.445 [2024-11-29 17:08:43.677757] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:32.445 [2024-11-29 17:08:43.677971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.445 [2024-11-29 17:08:43.678107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.445 [2024-11-29 17:08:43.678134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1997810 with addr=10.0.0.2, port=4420 00:26:32.446 [2024-11-29 17:08:43.678151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1997810 is same with the state(5) to be set 00:26:32.446 [2024-11-29 17:08:43.678174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1997810 (9): Bad file descriptor 00:26:32.446 [2024-11-29 17:08:43.678195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:32.446 [2024-11-29 17:08:43.678209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:32.446 [2024-11-29 17:08:43.678222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:32.446 [2024-11-29 17:08:43.678241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:32.446 [2024-11-29 17:08:43.687853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:32.446 [2024-11-29 17:08:43.688109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.446 [2024-11-29 17:08:43.688238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.446 [2024-11-29 17:08:43.688265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1997810 with addr=10.0.0.2, port=4420 00:26:32.446 [2024-11-29 17:08:43.688281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1997810 is same with the state(5) to be set 00:26:32.446 [2024-11-29 17:08:43.688304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1997810 (9): Bad file descriptor 00:26:32.446 [2024-11-29 17:08:43.688325] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:32.446 [2024-11-29 17:08:43.688340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:32.446 [2024-11-29 17:08:43.688353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:32.446 [2024-11-29 17:08:43.688372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:32.446 [2024-11-29 17:08:43.697944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:32.446 [2024-11-29 17:08:43.698096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.446 [2024-11-29 17:08:43.698213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.446 [2024-11-29 17:08:43.698240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1997810 with addr=10.0.0.2, port=4420 00:26:32.446 [2024-11-29 17:08:43.698256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1997810 is same with the state(5) to be set 00:26:32.446 [2024-11-29 17:08:43.698279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1997810 (9): Bad file descriptor 00:26:32.446 [2024-11-29 17:08:43.698300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:32.446 [2024-11-29 17:08:43.698314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:32.446 [2024-11-29 17:08:43.698328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:32.446 [2024-11-29 17:08:43.698346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:32.446 [2024-11-29 17:08:43.708021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:32.446 [2024-11-29 17:08:43.708824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.446 [2024-11-29 17:08:43.709027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.446 [2024-11-29 17:08:43.709060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1997810 with addr=10.0.0.2, port=4420 00:26:32.446 [2024-11-29 17:08:43.709079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1997810 is same with the state(5) to be set 00:26:32.446 [2024-11-29 17:08:43.709102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1997810 (9): Bad file descriptor 00:26:32.446 [2024-11-29 17:08:43.709138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:32.446 [2024-11-29 17:08:43.709156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:32.446 [2024-11-29 17:08:43.709170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:32.446 [2024-11-29 17:08:43.709190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:32.446 [2024-11-29 17:08:43.718091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:32.446 [2024-11-29 17:08:43.718281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.446 [2024-11-29 17:08:43.718455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.446 [2024-11-29 17:08:43.718482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1997810 with addr=10.0.0.2, port=4420 00:26:32.446 [2024-11-29 17:08:43.718499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1997810 is same with the state(5) to be set 00:26:32.446 [2024-11-29 17:08:43.718535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1997810 (9): Bad file descriptor 00:26:32.446 [2024-11-29 17:08:43.718559] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:32.446 [2024-11-29 17:08:43.718573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:32.446 [2024-11-29 17:08:43.718587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:32.446 [2024-11-29 17:08:43.718620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:32.446 [2024-11-29 17:08:43.724180] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:32.446 [2024-11-29 17:08:43.724209] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:33.378 17:08:44 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:33.378 17:08:44 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:33.378 17:08:44 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:33.378 17:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.378 17:08:44 -- host/discovery.sh@59 -- # sort 00:26:33.378 17:08:44 -- common/autotest_common.sh@10 -- # set +x 00:26:33.378 17:08:44 -- host/discovery.sh@59 -- # xargs 00:26:33.378 17:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.378 17:08:44 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:33.378 17:08:44 -- host/discovery.sh@129 -- # get_bdev_list 00:26:33.378 17:08:44 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:33.378 17:08:44 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:33.378 17:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.378 17:08:44 -- common/autotest_common.sh@10 -- # set +x 00:26:33.378 17:08:44 -- host/discovery.sh@55 -- # sort 00:26:33.378 17:08:44 -- host/discovery.sh@55 -- # xargs 00:26:33.378 17:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.378 17:08:44 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:33.378 17:08:44 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:33.378 17:08:44 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:33.378 17:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.378 17:08:44 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:33.378 17:08:44 -- common/autotest_common.sh@10 -- # set +x 00:26:33.378 17:08:44 -- host/discovery.sh@63 -- # sort -n 00:26:33.378 17:08:44 -- host/discovery.sh@63 -- # xargs 00:26:33.378 17:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.378 17:08:44 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:33.378 17:08:44 -- host/discovery.sh@131 -- # get_notification_count 00:26:33.378 17:08:44 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:33.378 17:08:44 -- host/discovery.sh@74 -- # jq '. | length' 00:26:33.378 17:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.378 17:08:44 -- common/autotest_common.sh@10 -- # set +x 00:26:33.378 17:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.635 17:08:44 -- host/discovery.sh@74 -- # notification_count=0 00:26:33.635 17:08:44 -- host/discovery.sh@75 -- # notify_id=2 00:26:33.635 17:08:44 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:33.635 17:08:44 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:33.635 17:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.635 17:08:44 -- common/autotest_common.sh@10 -- # set +x 00:26:33.635 17:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.635 17:08:44 -- host/discovery.sh@135 -- # sleep 1 00:26:34.566 17:08:45 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:34.566 17:08:45 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:34.566 17:08:45 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:34.566 17:08:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.566 17:08:45 -- common/autotest_common.sh@10 -- # set +x 00:26:34.566 17:08:45 -- host/discovery.sh@59 -- # sort 00:26:34.566 17:08:45 -- host/discovery.sh@59 -- # xargs 00:26:34.566 17:08:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.566 17:08:45 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:34.566 17:08:45 -- host/discovery.sh@137 -- # get_bdev_list 00:26:34.566 17:08:45 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.566 17:08:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.566 17:08:45 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:34.566 17:08:45 -- common/autotest_common.sh@10 -- # set +x 00:26:34.566 17:08:45 -- host/discovery.sh@55 -- # sort 00:26:34.566 17:08:45 -- host/discovery.sh@55 -- # xargs 00:26:34.566 17:08:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.566 17:08:45 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:34.566 17:08:45 -- host/discovery.sh@138 -- # get_notification_count 00:26:34.566 17:08:45 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:34.566 17:08:45 -- host/discovery.sh@74 -- # jq '. | length' 00:26:34.566 17:08:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.566 17:08:45 -- common/autotest_common.sh@10 -- # set +x 00:26:34.566 17:08:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.566 17:08:45 -- host/discovery.sh@74 -- # notification_count=2 00:26:34.566 17:08:45 -- host/discovery.sh@75 -- # notify_id=4 00:26:34.566 17:08:45 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:34.566 17:08:45 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:34.566 17:08:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.566 17:08:45 -- common/autotest_common.sh@10 -- # set +x 00:26:35.940 [2024-11-29 17:08:47.020064] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:35.940 [2024-11-29 17:08:47.020086] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:35.940 [2024-11-29 17:08:47.020106] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:35.940 [2024-11-29 17:08:47.106380] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:35.940 [2024-11-29 17:08:47.213544] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:35.940 [2024-11-29 17:08:47.213584] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:35.940 17:08:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.940 17:08:47 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:35.940 17:08:47 -- common/autotest_common.sh@650 -- # local es=0 00:26:35.940 17:08:47 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:35.940 17:08:47 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:35.940 17:08:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:35.940 17:08:47 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:35.940 17:08:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:35.940 17:08:47 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:35.940 17:08:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.940 17:08:47 -- common/autotest_common.sh@10 -- # set +x 00:26:35.940 request: 00:26:35.940 { 00:26:35.940 "name": "nvme", 00:26:35.940 "trtype": "tcp", 00:26:35.940 "traddr": "10.0.0.2", 00:26:35.940 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:35.940 "adrfam": "ipv4", 00:26:35.940 "trsvcid": "8009", 00:26:35.940 "wait_for_attach": true, 00:26:35.940 "method": "bdev_nvme_start_discovery", 00:26:35.940 "req_id": 1 00:26:35.940 } 00:26:35.940 Got JSON-RPC error response 00:26:35.940 response: 00:26:35.940 { 00:26:35.940 "code": -17, 00:26:35.940 "message": "File exists" 00:26:35.940 } 00:26:35.940 17:08:47 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:35.940 17:08:47 -- common/autotest_common.sh@653 -- # es=1 00:26:35.940 17:08:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:35.940 17:08:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:35.940 17:08:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:35.940 17:08:47 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:35.940 17:08:47 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:35.940 17:08:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.940 17:08:47 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:35.940 17:08:47 -- common/autotest_common.sh@10 -- # set +x 00:26:35.940 17:08:47 -- host/discovery.sh@67 -- # sort 00:26:35.940 17:08:47 -- host/discovery.sh@67 -- # xargs 00:26:35.940 17:08:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.940 17:08:47 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:35.940 17:08:47 -- host/discovery.sh@147 -- # get_bdev_list 00:26:35.940 17:08:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:35.940 17:08:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.940 17:08:47 -- common/autotest_common.sh@10 -- # set +x 00:26:35.940 17:08:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:35.940 17:08:47 -- host/discovery.sh@55 -- # sort 00:26:35.940 17:08:47 -- host/discovery.sh@55 -- # xargs 00:26:35.940 17:08:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.940 17:08:47 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:35.940 17:08:47 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:35.940 17:08:47 -- common/autotest_common.sh@650 -- # local es=0 00:26:35.940 17:08:47 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:35.940 17:08:47 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:35.940 17:08:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:35.940 17:08:47 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:35.940 17:08:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:35.940 17:08:47 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:35.940 17:08:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.940 17:08:47 -- common/autotest_common.sh@10 -- # set +x 00:26:35.940 request: 00:26:35.940 { 00:26:35.940 "name": "nvme_second", 00:26:35.940 "trtype": "tcp", 00:26:35.940 "traddr": "10.0.0.2", 00:26:35.940 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:35.940 "adrfam": "ipv4", 00:26:35.940 "trsvcid": "8009", 00:26:35.940 "wait_for_attach": true, 00:26:35.941 "method": "bdev_nvme_start_discovery", 00:26:35.941 "req_id": 1 00:26:35.941 } 00:26:35.941 Got JSON-RPC error response 00:26:35.941 response: 00:26:35.941 { 00:26:35.941 "code": -17, 00:26:35.941 "message": "File exists" 00:26:35.941 } 00:26:35.941 17:08:47 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:35.941 17:08:47 -- common/autotest_common.sh@653 -- # es=1 00:26:35.941 17:08:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:35.941 17:08:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:35.941 17:08:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:35.941 17:08:47 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:35.941 17:08:47 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:35.941 17:08:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.941 17:08:47 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:35.941 17:08:47 -- common/autotest_common.sh@10 -- # set +x 00:26:35.941 17:08:47 -- host/discovery.sh@67 -- # sort 00:26:35.941 17:08:47 -- host/discovery.sh@67 -- # xargs 00:26:35.941 17:08:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.941 17:08:47 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:35.941 17:08:47 -- host/discovery.sh@153 -- # get_bdev_list 00:26:35.941 17:08:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:35.941 17:08:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.941 17:08:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:35.941 17:08:47 -- common/autotest_common.sh@10 -- # set +x 00:26:35.941 17:08:47 -- host/discovery.sh@55 -- # sort 00:26:35.941 17:08:47 -- host/discovery.sh@55 -- # xargs 00:26:36.199 17:08:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.199 17:08:47 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:36.199 17:08:47 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:36.199 17:08:47 -- common/autotest_common.sh@650 -- # local es=0 00:26:36.199 17:08:47 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:36.199 17:08:47 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:36.199 17:08:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:36.199 17:08:47 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:36.199 17:08:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:36.199 17:08:47 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:36.199 17:08:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.199 17:08:47 -- common/autotest_common.sh@10 -- # set +x 00:26:37.133 [2024-11-29 17:08:48.408912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:37.134 [2024-11-29 17:08:48.409063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:37.134 [2024-11-29 17:08:48.409092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19a30a0 with addr=10.0.0.2, port=8010 00:26:37.134 [2024-11-29 17:08:48.409113] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:37.134 [2024-11-29 17:08:48.409128] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:37.134 [2024-11-29 17:08:48.409140] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:38.067 [2024-11-29 17:08:49.411381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:38.067 [2024-11-29 17:08:49.411483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:38.067 [2024-11-29 17:08:49.411513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1987d30 with addr=10.0.0.2, port=8010 00:26:38.067 [2024-11-29 17:08:49.411535] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:38.067 [2024-11-29 17:08:49.411549] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:38.067 [2024-11-29 17:08:49.411563] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:39.000 [2024-11-29 17:08:50.413622] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:39.000 request: 00:26:39.000 { 00:26:39.000 "name": "nvme_second", 00:26:39.000 "trtype": "tcp", 00:26:39.000 "traddr": "10.0.0.2", 00:26:39.000 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:39.000 "adrfam": "ipv4", 00:26:39.000 "trsvcid": "8010", 00:26:39.000 "attach_timeout_ms": 3000, 00:26:39.000 "method": "bdev_nvme_start_discovery", 00:26:39.000 "req_id": 1 00:26:39.000 } 00:26:39.000 Got JSON-RPC error response 00:26:39.000 response: 00:26:39.000 { 00:26:39.000 "code": -110, 00:26:39.000 "message": "Connection timed out" 00:26:39.000 } 00:26:39.000 17:08:50 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:39.000 17:08:50 -- common/autotest_common.sh@653 -- # es=1 00:26:39.000 17:08:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:39.000 17:08:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:39.000 17:08:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:39.000 17:08:50 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:39.000 17:08:50 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:39.000 17:08:50 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:39.000 17:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.000 17:08:50 -- host/discovery.sh@67 -- # sort 00:26:39.000 17:08:50 -- common/autotest_common.sh@10 -- # set +x 00:26:39.000 17:08:50 -- host/discovery.sh@67 -- # xargs 00:26:39.000 17:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.259 17:08:50 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:39.259 17:08:50 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:39.259 17:08:50 -- host/discovery.sh@162 -- # kill 309912 00:26:39.259 17:08:50 -- host/discovery.sh@163 -- # nvmftestfini 00:26:39.259 17:08:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:39.259 17:08:50 -- nvmf/common.sh@116 -- # sync 00:26:39.259 17:08:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:39.259 17:08:50 -- nvmf/common.sh@119 -- # set +e 00:26:39.259 17:08:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:39.259 17:08:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:39.259 rmmod nvme_tcp 00:26:39.259 rmmod nvme_fabrics 00:26:39.259 rmmod nvme_keyring 00:26:39.259 17:08:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:39.259 17:08:50 -- nvmf/common.sh@123 -- # set -e 00:26:39.259 17:08:50 -- nvmf/common.sh@124 -- # return 0 00:26:39.259 17:08:50 -- nvmf/common.sh@477 -- # '[' -n 309760 ']' 00:26:39.259 17:08:50 -- nvmf/common.sh@478 -- # killprocess 309760 00:26:39.259 17:08:50 -- common/autotest_common.sh@936 -- # '[' -z 309760 ']' 00:26:39.259 17:08:50 -- common/autotest_common.sh@940 -- # kill -0 309760 00:26:39.259 17:08:50 -- common/autotest_common.sh@941 -- # uname 00:26:39.259 17:08:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:39.259 17:08:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 309760 00:26:39.259 17:08:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:39.259 17:08:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:39.259 17:08:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 309760' 00:26:39.259 killing process with pid 309760 00:26:39.259 17:08:50 -- common/autotest_common.sh@955 -- # kill 309760 00:26:39.259 17:08:50 -- common/autotest_common.sh@960 -- # wait 309760 00:26:39.517 17:08:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:39.517 17:08:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:39.517 17:08:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:39.517 17:08:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:39.517 17:08:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:39.517 17:08:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:39.517 17:08:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:39.517 17:08:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:41.620 17:08:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:41.620 00:26:41.620 real 0m17.460s 00:26:41.620 user 0m27.082s 00:26:41.620 sys 0m2.891s 00:26:41.620 17:08:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:41.620 17:08:52 -- common/autotest_common.sh@10 -- # set +x 00:26:41.620 ************************************ 00:26:41.620 END TEST nvmf_discovery 00:26:41.620 ************************************ 00:26:41.620 17:08:52 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:41.620 17:08:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:41.620 17:08:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:41.620 17:08:52 -- common/autotest_common.sh@10 -- # set +x 00:26:41.620 ************************************ 00:26:41.620 START TEST nvmf_discovery_remove_ifc 00:26:41.620 ************************************ 00:26:41.620 17:08:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:41.620 * Looking for test storage... 00:26:41.620 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:41.620 17:08:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:41.620 17:08:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:41.620 17:08:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:41.620 17:08:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:41.620 17:08:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:41.620 17:08:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:41.620 17:08:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:41.620 17:08:53 -- scripts/common.sh@335 -- # IFS=.-: 00:26:41.620 17:08:53 -- scripts/common.sh@335 -- # read -ra ver1 00:26:41.620 17:08:53 -- scripts/common.sh@336 -- # IFS=.-: 00:26:41.620 17:08:53 -- scripts/common.sh@336 -- # read -ra ver2 00:26:41.620 17:08:53 -- scripts/common.sh@337 -- # local 'op=<' 00:26:41.620 17:08:53 -- scripts/common.sh@339 -- # ver1_l=2 00:26:41.620 17:08:53 -- scripts/common.sh@340 -- # ver2_l=1 00:26:41.620 17:08:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:41.620 17:08:53 -- scripts/common.sh@343 -- # case "$op" in 00:26:41.620 17:08:53 -- scripts/common.sh@344 -- # : 1 00:26:41.620 17:08:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:41.620 17:08:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:41.620 17:08:53 -- scripts/common.sh@364 -- # decimal 1 00:26:41.620 17:08:53 -- scripts/common.sh@352 -- # local d=1 00:26:41.620 17:08:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:41.620 17:08:53 -- scripts/common.sh@354 -- # echo 1 00:26:41.900 17:08:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:41.900 17:08:53 -- scripts/common.sh@365 -- # decimal 2 00:26:41.900 17:08:53 -- scripts/common.sh@352 -- # local d=2 00:26:41.900 17:08:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:41.900 17:08:53 -- scripts/common.sh@354 -- # echo 2 00:26:41.900 17:08:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:41.900 17:08:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:41.900 17:08:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:41.900 17:08:53 -- scripts/common.sh@367 -- # return 0 00:26:41.900 17:08:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:41.900 17:08:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:41.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:41.900 --rc genhtml_branch_coverage=1 00:26:41.900 --rc genhtml_function_coverage=1 00:26:41.900 --rc genhtml_legend=1 00:26:41.900 --rc geninfo_all_blocks=1 00:26:41.900 --rc geninfo_unexecuted_blocks=1 00:26:41.900 00:26:41.900 ' 00:26:41.900 17:08:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:41.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:41.900 --rc genhtml_branch_coverage=1 00:26:41.900 --rc genhtml_function_coverage=1 00:26:41.900 --rc genhtml_legend=1 00:26:41.900 --rc geninfo_all_blocks=1 00:26:41.900 --rc geninfo_unexecuted_blocks=1 00:26:41.900 00:26:41.900 ' 00:26:41.900 17:08:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:41.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:41.900 --rc genhtml_branch_coverage=1 00:26:41.900 --rc genhtml_function_coverage=1 00:26:41.900 --rc genhtml_legend=1 00:26:41.900 --rc geninfo_all_blocks=1 00:26:41.900 --rc geninfo_unexecuted_blocks=1 00:26:41.900 00:26:41.900 ' 00:26:41.900 17:08:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:41.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:41.900 --rc genhtml_branch_coverage=1 00:26:41.900 --rc genhtml_function_coverage=1 00:26:41.900 --rc genhtml_legend=1 00:26:41.900 --rc geninfo_all_blocks=1 00:26:41.900 --rc geninfo_unexecuted_blocks=1 00:26:41.900 00:26:41.900 ' 00:26:41.900 17:08:53 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:41.900 17:08:53 -- nvmf/common.sh@7 -- # uname -s 00:26:41.900 17:08:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:41.901 17:08:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:41.901 17:08:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:41.901 17:08:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:41.901 17:08:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:41.901 17:08:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:41.901 17:08:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:41.901 17:08:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:41.901 17:08:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:41.901 17:08:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:41.901 17:08:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:41.901 17:08:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:41.901 17:08:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:41.901 17:08:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:41.901 17:08:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:41.901 17:08:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:41.901 17:08:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:41.901 17:08:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:41.901 17:08:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:41.901 17:08:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:41.901 17:08:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:41.901 17:08:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:41.901 17:08:53 -- paths/export.sh@5 -- # export PATH 00:26:41.901 17:08:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:41.901 17:08:53 -- nvmf/common.sh@46 -- # : 0 00:26:41.901 17:08:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:41.901 17:08:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:41.901 17:08:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:41.901 17:08:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:41.901 17:08:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:41.901 17:08:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:41.901 17:08:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:41.901 17:08:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:41.901 17:08:53 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:41.901 17:08:53 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:41.901 17:08:53 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:41.901 17:08:53 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:41.901 17:08:53 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:41.901 17:08:53 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:41.901 17:08:53 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:41.901 17:08:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:41.901 17:08:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:41.901 17:08:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:41.901 17:08:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:41.901 17:08:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:41.901 17:08:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:41.901 17:08:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:41.901 17:08:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:41.901 17:08:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:41.901 17:08:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:41.901 17:08:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:41.901 17:08:53 -- common/autotest_common.sh@10 -- # set +x 00:26:43.832 17:08:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:43.832 17:08:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:43.832 17:08:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:43.832 17:08:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:43.832 17:08:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:43.832 17:08:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:43.832 17:08:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:43.832 17:08:55 -- nvmf/common.sh@294 -- # net_devs=() 00:26:43.832 17:08:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:43.832 17:08:55 -- nvmf/common.sh@295 -- # e810=() 00:26:43.832 17:08:55 -- nvmf/common.sh@295 -- # local -ga e810 00:26:43.832 17:08:55 -- nvmf/common.sh@296 -- # x722=() 00:26:43.832 17:08:55 -- nvmf/common.sh@296 -- # local -ga x722 00:26:43.832 17:08:55 -- nvmf/common.sh@297 -- # mlx=() 00:26:43.832 17:08:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:43.832 17:08:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:43.832 17:08:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:43.832 17:08:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:43.832 17:08:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:43.832 17:08:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:43.832 17:08:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:43.832 17:08:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:43.832 17:08:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:43.832 17:08:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:43.832 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:43.832 17:08:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:43.832 17:08:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:43.832 17:08:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:43.832 17:08:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:43.832 17:08:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:43.832 17:08:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:43.832 17:08:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:43.832 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:43.832 17:08:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:43.833 17:08:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:43.833 17:08:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:43.833 17:08:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:43.833 17:08:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:43.833 17:08:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:43.833 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:43.833 17:08:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:43.833 17:08:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:43.833 17:08:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:43.833 17:08:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:43.833 17:08:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:43.833 17:08:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:43.833 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:43.833 17:08:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:43.833 17:08:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:43.833 17:08:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:43.833 17:08:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:43.833 17:08:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:43.833 17:08:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:43.833 17:08:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:43.833 17:08:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:43.833 17:08:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:43.833 17:08:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:43.833 17:08:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:43.833 17:08:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:43.833 17:08:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:43.833 17:08:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:43.833 17:08:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:43.833 17:08:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:43.833 17:08:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:43.833 17:08:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:43.833 17:08:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:43.833 17:08:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:43.833 17:08:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:43.833 17:08:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:43.833 17:08:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:43.833 17:08:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:43.833 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:43.833 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.159 ms 00:26:43.833 00:26:43.833 --- 10.0.0.2 ping statistics --- 00:26:43.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:43.833 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:26:43.833 17:08:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:43.833 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:43.833 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:26:43.833 00:26:43.833 --- 10.0.0.1 ping statistics --- 00:26:43.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:43.833 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:26:43.833 17:08:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:43.833 17:08:55 -- nvmf/common.sh@410 -- # return 0 00:26:43.833 17:08:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:43.833 17:08:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:43.833 17:08:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:43.833 17:08:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:43.833 17:08:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:43.833 17:08:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:43.833 17:08:55 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:43.833 17:08:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:43.833 17:08:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:43.833 17:08:55 -- common/autotest_common.sh@10 -- # set +x 00:26:43.833 17:08:55 -- nvmf/common.sh@469 -- # nvmfpid=313526 00:26:43.833 17:08:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:43.833 17:08:55 -- nvmf/common.sh@470 -- # waitforlisten 313526 00:26:43.833 17:08:55 -- common/autotest_common.sh@829 -- # '[' -z 313526 ']' 00:26:43.833 17:08:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:43.833 17:08:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:43.833 17:08:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:43.833 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:43.833 17:08:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:43.833 17:08:55 -- common/autotest_common.sh@10 -- # set +x 00:26:44.091 [2024-11-29 17:08:55.268020] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:44.091 [2024-11-29 17:08:55.268107] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:44.091 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.091 [2024-11-29 17:08:55.334697] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:44.091 [2024-11-29 17:08:55.447543] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:44.091 [2024-11-29 17:08:55.447718] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:44.091 [2024-11-29 17:08:55.447738] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:44.091 [2024-11-29 17:08:55.447753] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:44.091 [2024-11-29 17:08:55.447784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:45.025 17:08:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:45.025 17:08:56 -- common/autotest_common.sh@862 -- # return 0 00:26:45.025 17:08:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:45.025 17:08:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:45.025 17:08:56 -- common/autotest_common.sh@10 -- # set +x 00:26:45.025 17:08:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:45.025 17:08:56 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:45.025 17:08:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.025 17:08:56 -- common/autotest_common.sh@10 -- # set +x 00:26:45.025 [2024-11-29 17:08:56.261773] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:45.025 [2024-11-29 17:08:56.269976] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:45.025 null0 00:26:45.025 [2024-11-29 17:08:56.301889] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:45.025 17:08:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.025 17:08:56 -- host/discovery_remove_ifc.sh@59 -- # hostpid=313640 00:26:45.025 17:08:56 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:45.025 17:08:56 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 313640 /tmp/host.sock 00:26:45.025 17:08:56 -- common/autotest_common.sh@829 -- # '[' -z 313640 ']' 00:26:45.025 17:08:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:45.025 17:08:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:45.025 17:08:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:45.025 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:45.025 17:08:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:45.025 17:08:56 -- common/autotest_common.sh@10 -- # set +x 00:26:45.025 [2024-11-29 17:08:56.366398] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:45.025 [2024-11-29 17:08:56.366473] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid313640 ] 00:26:45.025 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.025 [2024-11-29 17:08:56.426280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:45.283 [2024-11-29 17:08:56.533204] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:45.283 [2024-11-29 17:08:56.533362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:45.283 17:08:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:45.283 17:08:56 -- common/autotest_common.sh@862 -- # return 0 00:26:45.283 17:08:56 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:45.283 17:08:56 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:45.283 17:08:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.283 17:08:56 -- common/autotest_common.sh@10 -- # set +x 00:26:45.283 17:08:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.283 17:08:56 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:45.283 17:08:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.283 17:08:56 -- common/autotest_common.sh@10 -- # set +x 00:26:45.283 17:08:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.283 17:08:56 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:45.283 17:08:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.283 17:08:56 -- common/autotest_common.sh@10 -- # set +x 00:26:46.657 [2024-11-29 17:08:57.740675] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:46.657 [2024-11-29 17:08:57.740719] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:46.657 [2024-11-29 17:08:57.740748] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:46.657 [2024-11-29 17:08:57.868185] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:46.657 [2024-11-29 17:08:58.050068] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:46.657 [2024-11-29 17:08:58.050115] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:46.657 [2024-11-29 17:08:58.050150] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:46.657 [2024-11-29 17:08:58.050172] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:46.657 [2024-11-29 17:08:58.050202] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:46.657 17:08:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.657 17:08:58 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:46.657 17:08:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:46.657 17:08:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:46.657 17:08:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:46.657 17:08:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:46.657 17:08:58 -- common/autotest_common.sh@10 -- # set +x 00:26:46.657 17:08:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:46.657 17:08:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:46.657 17:08:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:46.915 17:08:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:46.915 17:08:58 -- common/autotest_common.sh@10 -- # set +x 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:46.915 17:08:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:46.915 17:08:58 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:47.848 17:08:59 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:47.848 17:08:59 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:47.848 17:08:59 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:47.848 17:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:47.848 17:08:59 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:47.848 17:08:59 -- common/autotest_common.sh@10 -- # set +x 00:26:47.848 17:08:59 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:47.848 17:08:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:47.848 17:08:59 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:47.848 17:08:59 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:49.221 17:09:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:49.221 17:09:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:49.221 17:09:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:49.221 17:09:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.221 17:09:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:49.221 17:09:00 -- common/autotest_common.sh@10 -- # set +x 00:26:49.221 17:09:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:49.221 17:09:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.221 17:09:00 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:49.221 17:09:00 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:50.155 17:09:01 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:50.155 17:09:01 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:50.155 17:09:01 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:50.155 17:09:01 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:50.155 17:09:01 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:50.155 17:09:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:50.155 17:09:01 -- common/autotest_common.sh@10 -- # set +x 00:26:50.155 17:09:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:50.155 17:09:01 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:50.155 17:09:01 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:51.088 17:09:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:51.088 17:09:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:51.088 17:09:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:51.088 17:09:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:51.088 17:09:02 -- common/autotest_common.sh@10 -- # set +x 00:26:51.088 17:09:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:51.088 17:09:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:51.088 17:09:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:51.088 17:09:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:51.088 17:09:02 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:52.022 17:09:03 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:52.022 17:09:03 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:52.022 17:09:03 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:52.022 17:09:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:52.022 17:09:03 -- common/autotest_common.sh@10 -- # set +x 00:26:52.022 17:09:03 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:52.022 17:09:03 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:52.022 17:09:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:52.022 17:09:03 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:52.022 17:09:03 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:52.281 [2024-11-29 17:09:03.491851] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:52.281 [2024-11-29 17:09:03.491918] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:52.281 [2024-11-29 17:09:03.491963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.281 [2024-11-29 17:09:03.491985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:52.281 [2024-11-29 17:09:03.491999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.281 [2024-11-29 17:09:03.492013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:52.281 [2024-11-29 17:09:03.492026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.281 [2024-11-29 17:09:03.492049] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:52.281 [2024-11-29 17:09:03.492063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.281 [2024-11-29 17:09:03.492077] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:52.281 [2024-11-29 17:09:03.492089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.281 [2024-11-29 17:09:03.492102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1827430 is same with the state(5) to be set 00:26:52.281 [2024-11-29 17:09:03.501869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1827430 (9): Bad file descriptor 00:26:52.281 [2024-11-29 17:09:03.511976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:0 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.281 [2024-11-29 17:09:03.512001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.281 [2024-11-29 17:09:03.512052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:0 len:64 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.281 [2024-11-29 17:09:03.512069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.281 [2024-11-29 17:09:03.512086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:0 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.281 [2024-11-29 17:09:03.512101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.281 [2024-11-29 17:09:03.512209] bdev_nvme.c:1582:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1860d40 was disconnected and freed in a reset ctrlr sequence. 00:26:52.281 [2024-11-29 17:09:03.512231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:53.215 17:09:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:53.215 17:09:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:53.215 17:09:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:53.215 17:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:53.215 17:09:04 -- common/autotest_common.sh@10 -- # set +x 00:26:53.215 17:09:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:53.215 17:09:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:53.215 [2024-11-29 17:09:04.551008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:54.148 [2024-11-29 17:09:05.575021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:54.148 [2024-11-29 17:09:05.575084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1827430 with addr=10.0.0.2, port=4420 00:26:54.148 [2024-11-29 17:09:05.575115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1827430 is same with the state(5) to be set 00:26:54.148 [2024-11-29 17:09:05.575218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:54.148 [2024-11-29 17:09:05.575242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:54.148 [2024-11-29 17:09:05.575259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:54.148 [2024-11-29 17:09:05.575275] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:54.148 [2024-11-29 17:09:05.575698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1827430 (9): Bad file descriptor 00:26:54.148 [2024-11-29 17:09:05.575773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.148 [2024-11-29 17:09:05.575833] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:54.148 [2024-11-29 17:09:05.575873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:54.148 [2024-11-29 17:09:05.575899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:54.148 [2024-11-29 17:09:05.575921] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:54.148 [2024-11-29 17:09:05.575935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:54.148 [2024-11-29 17:09:05.575951] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:54.148 [2024-11-29 17:09:05.575987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:54.148 [2024-11-29 17:09:05.576004] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:54.148 [2024-11-29 17:09:05.576036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:54.148 [2024-11-29 17:09:05.576050] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:54.148 [2024-11-29 17:09:05.576064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:54.148 [2024-11-29 17:09:05.576092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:54.148 [2024-11-29 17:09:05.576133] bdev.c:4968:_tmp_bdev_event_cb: *NOTICE*: Unexpected event type: 0 00:26:54.148 [2024-11-29 17:09:05.576221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1827840 (9): Bad file descriptor 00:26:54.148 [2024-11-29 17:09:05.577282] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:54.148 [2024-11-29 17:09:05.577318] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:54.406 17:09:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:54.406 17:09:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:54.406 17:09:05 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:55.339 [2024-11-29 17:09:06.578271] bdev_raid.c:3350:raid_bdev_examine_load_sb_cb: *ERROR*: Failed to examine bdev nvme0n1: Input/output error 00:26:55.339 [2024-11-29 17:09:06.578325] vbdev_gpt.c: 468:gpt_bdev_complete: *ERROR*: Gpt: bdev=nvme0n1 io error status=0 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:55.339 17:09:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:55.339 17:09:06 -- common/autotest_common.sh@10 -- # set +x 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:55.339 17:09:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:55.339 17:09:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.339 17:09:06 -- common/autotest_common.sh@10 -- # set +x 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:55.339 17:09:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:55.339 17:09:06 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:56.274 [2024-11-29 17:09:07.637063] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:56.274 [2024-11-29 17:09:07.637087] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:56.274 [2024-11-29 17:09:07.637113] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:56.532 17:09:07 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:56.532 17:09:07 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:56.532 17:09:07 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:56.532 17:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:56.532 17:09:07 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:56.532 17:09:07 -- common/autotest_common.sh@10 -- # set +x 00:26:56.532 17:09:07 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:56.532 [2024-11-29 17:09:07.723405] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:56.532 17:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:56.532 17:09:07 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:56.532 17:09:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:56.532 [2024-11-29 17:09:07.785400] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:56.532 [2024-11-29 17:09:07.785452] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:56.532 [2024-11-29 17:09:07.785488] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:56.532 [2024-11-29 17:09:07.785513] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:56.532 [2024-11-29 17:09:07.785528] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:56.532 [2024-11-29 17:09:07.793987] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x18340a0 was disconnected and freed. delete nvme_qpair. 00:26:57.465 17:09:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:57.465 17:09:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:57.465 17:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.465 17:09:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:57.465 17:09:08 -- common/autotest_common.sh@10 -- # set +x 00:26:57.465 17:09:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:57.465 17:09:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:57.465 17:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.465 17:09:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:57.465 17:09:08 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:57.465 17:09:08 -- host/discovery_remove_ifc.sh@90 -- # killprocess 313640 00:26:57.465 17:09:08 -- common/autotest_common.sh@936 -- # '[' -z 313640 ']' 00:26:57.465 17:09:08 -- common/autotest_common.sh@940 -- # kill -0 313640 00:26:57.465 17:09:08 -- common/autotest_common.sh@941 -- # uname 00:26:57.465 17:09:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:57.465 17:09:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 313640 00:26:57.465 17:09:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:57.465 17:09:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:57.465 17:09:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 313640' 00:26:57.465 killing process with pid 313640 00:26:57.465 17:09:08 -- common/autotest_common.sh@955 -- # kill 313640 00:26:57.465 17:09:08 -- common/autotest_common.sh@960 -- # wait 313640 00:26:57.724 17:09:09 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:57.724 17:09:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:57.724 17:09:09 -- nvmf/common.sh@116 -- # sync 00:26:57.724 17:09:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:57.724 17:09:09 -- nvmf/common.sh@119 -- # set +e 00:26:57.724 17:09:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:57.724 17:09:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:57.724 rmmod nvme_tcp 00:26:57.724 rmmod nvme_fabrics 00:26:57.724 rmmod nvme_keyring 00:26:57.724 17:09:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:57.724 17:09:09 -- nvmf/common.sh@123 -- # set -e 00:26:57.724 17:09:09 -- nvmf/common.sh@124 -- # return 0 00:26:57.724 17:09:09 -- nvmf/common.sh@477 -- # '[' -n 313526 ']' 00:26:57.724 17:09:09 -- nvmf/common.sh@478 -- # killprocess 313526 00:26:57.724 17:09:09 -- common/autotest_common.sh@936 -- # '[' -z 313526 ']' 00:26:57.724 17:09:09 -- common/autotest_common.sh@940 -- # kill -0 313526 00:26:57.724 17:09:09 -- common/autotest_common.sh@941 -- # uname 00:26:57.724 17:09:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:57.724 17:09:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 313526 00:26:57.982 17:09:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:57.982 17:09:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:57.982 17:09:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 313526' 00:26:57.982 killing process with pid 313526 00:26:57.982 17:09:09 -- common/autotest_common.sh@955 -- # kill 313526 00:26:57.982 17:09:09 -- common/autotest_common.sh@960 -- # wait 313526 00:26:57.982 [2024-11-29 17:09:09.174878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x246fb50 is same with the state(5) to be set 00:26:57.982 [2024-11-29 17:09:09.174922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x246fb50 is same with the state(5) to be set 00:26:58.241 17:09:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:58.241 17:09:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:58.241 17:09:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:58.241 17:09:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:58.241 17:09:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:58.241 17:09:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:58.241 17:09:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:58.241 17:09:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:00.144 17:09:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:00.144 00:27:00.144 real 0m18.542s 00:27:00.144 user 0m25.488s 00:27:00.144 sys 0m3.206s 00:27:00.144 17:09:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:00.144 17:09:11 -- common/autotest_common.sh@10 -- # set +x 00:27:00.144 ************************************ 00:27:00.144 END TEST nvmf_discovery_remove_ifc 00:27:00.144 ************************************ 00:27:00.144 17:09:11 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:27:00.144 17:09:11 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:27:00.144 17:09:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:00.144 17:09:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:00.144 17:09:11 -- common/autotest_common.sh@10 -- # set +x 00:27:00.144 ************************************ 00:27:00.144 START TEST nvmf_digest 00:27:00.144 ************************************ 00:27:00.144 17:09:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:27:00.144 * Looking for test storage... 00:27:00.144 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:00.144 17:09:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:00.144 17:09:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:00.144 17:09:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:00.402 17:09:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:00.402 17:09:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:00.402 17:09:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:00.402 17:09:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:00.402 17:09:11 -- scripts/common.sh@335 -- # IFS=.-: 00:27:00.402 17:09:11 -- scripts/common.sh@335 -- # read -ra ver1 00:27:00.402 17:09:11 -- scripts/common.sh@336 -- # IFS=.-: 00:27:00.402 17:09:11 -- scripts/common.sh@336 -- # read -ra ver2 00:27:00.402 17:09:11 -- scripts/common.sh@337 -- # local 'op=<' 00:27:00.402 17:09:11 -- scripts/common.sh@339 -- # ver1_l=2 00:27:00.402 17:09:11 -- scripts/common.sh@340 -- # ver2_l=1 00:27:00.402 17:09:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:00.402 17:09:11 -- scripts/common.sh@343 -- # case "$op" in 00:27:00.402 17:09:11 -- scripts/common.sh@344 -- # : 1 00:27:00.402 17:09:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:00.402 17:09:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:00.402 17:09:11 -- scripts/common.sh@364 -- # decimal 1 00:27:00.402 17:09:11 -- scripts/common.sh@352 -- # local d=1 00:27:00.402 17:09:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:00.402 17:09:11 -- scripts/common.sh@354 -- # echo 1 00:27:00.402 17:09:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:00.402 17:09:11 -- scripts/common.sh@365 -- # decimal 2 00:27:00.402 17:09:11 -- scripts/common.sh@352 -- # local d=2 00:27:00.402 17:09:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:00.402 17:09:11 -- scripts/common.sh@354 -- # echo 2 00:27:00.402 17:09:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:00.402 17:09:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:00.402 17:09:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:00.402 17:09:11 -- scripts/common.sh@367 -- # return 0 00:27:00.402 17:09:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:00.402 17:09:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:00.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:00.402 --rc genhtml_branch_coverage=1 00:27:00.402 --rc genhtml_function_coverage=1 00:27:00.402 --rc genhtml_legend=1 00:27:00.402 --rc geninfo_all_blocks=1 00:27:00.402 --rc geninfo_unexecuted_blocks=1 00:27:00.402 00:27:00.402 ' 00:27:00.402 17:09:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:00.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:00.402 --rc genhtml_branch_coverage=1 00:27:00.402 --rc genhtml_function_coverage=1 00:27:00.402 --rc genhtml_legend=1 00:27:00.402 --rc geninfo_all_blocks=1 00:27:00.402 --rc geninfo_unexecuted_blocks=1 00:27:00.402 00:27:00.402 ' 00:27:00.402 17:09:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:00.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:00.402 --rc genhtml_branch_coverage=1 00:27:00.402 --rc genhtml_function_coverage=1 00:27:00.402 --rc genhtml_legend=1 00:27:00.402 --rc geninfo_all_blocks=1 00:27:00.402 --rc geninfo_unexecuted_blocks=1 00:27:00.402 00:27:00.402 ' 00:27:00.403 17:09:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:00.403 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:00.403 --rc genhtml_branch_coverage=1 00:27:00.403 --rc genhtml_function_coverage=1 00:27:00.403 --rc genhtml_legend=1 00:27:00.403 --rc geninfo_all_blocks=1 00:27:00.403 --rc geninfo_unexecuted_blocks=1 00:27:00.403 00:27:00.403 ' 00:27:00.403 17:09:11 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:00.403 17:09:11 -- nvmf/common.sh@7 -- # uname -s 00:27:00.403 17:09:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:00.403 17:09:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:00.403 17:09:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:00.403 17:09:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:00.403 17:09:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:00.403 17:09:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:00.403 17:09:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:00.403 17:09:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:00.403 17:09:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:00.403 17:09:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:00.403 17:09:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:00.403 17:09:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:00.403 17:09:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:00.403 17:09:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:00.403 17:09:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:00.403 17:09:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:00.403 17:09:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:00.403 17:09:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:00.403 17:09:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:00.403 17:09:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.403 17:09:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.403 17:09:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.403 17:09:11 -- paths/export.sh@5 -- # export PATH 00:27:00.403 17:09:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.403 17:09:11 -- nvmf/common.sh@46 -- # : 0 00:27:00.403 17:09:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:00.403 17:09:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:00.403 17:09:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:00.403 17:09:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:00.403 17:09:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:00.403 17:09:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:00.403 17:09:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:00.403 17:09:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:00.403 17:09:11 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:27:00.403 17:09:11 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:27:00.403 17:09:11 -- host/digest.sh@16 -- # runtime=2 00:27:00.403 17:09:11 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:27:00.403 17:09:11 -- host/digest.sh@132 -- # nvmftestinit 00:27:00.403 17:09:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:00.403 17:09:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:00.403 17:09:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:00.403 17:09:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:00.403 17:09:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:00.403 17:09:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:00.403 17:09:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:00.403 17:09:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:00.403 17:09:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:00.403 17:09:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:00.403 17:09:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:00.403 17:09:11 -- common/autotest_common.sh@10 -- # set +x 00:27:02.304 17:09:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:02.304 17:09:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:02.304 17:09:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:02.304 17:09:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:02.304 17:09:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:02.305 17:09:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:02.305 17:09:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:02.305 17:09:13 -- nvmf/common.sh@294 -- # net_devs=() 00:27:02.305 17:09:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:02.305 17:09:13 -- nvmf/common.sh@295 -- # e810=() 00:27:02.305 17:09:13 -- nvmf/common.sh@295 -- # local -ga e810 00:27:02.305 17:09:13 -- nvmf/common.sh@296 -- # x722=() 00:27:02.305 17:09:13 -- nvmf/common.sh@296 -- # local -ga x722 00:27:02.305 17:09:13 -- nvmf/common.sh@297 -- # mlx=() 00:27:02.305 17:09:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:02.305 17:09:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:02.305 17:09:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:02.305 17:09:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:02.305 17:09:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:02.305 17:09:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:02.305 17:09:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:02.305 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:02.305 17:09:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:02.305 17:09:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:02.305 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:02.305 17:09:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:02.305 17:09:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:02.305 17:09:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:02.305 17:09:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:02.305 17:09:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:02.305 17:09:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:02.305 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:02.305 17:09:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:02.305 17:09:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:02.305 17:09:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:02.305 17:09:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:02.305 17:09:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:02.305 17:09:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:02.305 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:02.305 17:09:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:02.305 17:09:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:02.305 17:09:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:02.305 17:09:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:02.305 17:09:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:02.305 17:09:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:02.305 17:09:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:02.305 17:09:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:02.305 17:09:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:02.305 17:09:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:02.305 17:09:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:02.305 17:09:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:02.305 17:09:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:02.305 17:09:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:02.305 17:09:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:02.305 17:09:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:02.305 17:09:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:02.305 17:09:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:02.565 17:09:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:02.565 17:09:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:02.565 17:09:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:02.565 17:09:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:02.565 17:09:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:02.565 17:09:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:02.565 17:09:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:02.565 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:02.565 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.359 ms 00:27:02.565 00:27:02.565 --- 10.0.0.2 ping statistics --- 00:27:02.565 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:02.565 rtt min/avg/max/mdev = 0.359/0.359/0.359/0.000 ms 00:27:02.565 17:09:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:02.565 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:02.565 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:27:02.565 00:27:02.565 --- 10.0.0.1 ping statistics --- 00:27:02.565 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:02.565 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:27:02.565 17:09:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:02.565 17:09:13 -- nvmf/common.sh@410 -- # return 0 00:27:02.565 17:09:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:02.565 17:09:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:02.565 17:09:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:02.565 17:09:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:02.565 17:09:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:02.565 17:09:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:02.565 17:09:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:02.565 17:09:13 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:27:02.565 17:09:13 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:27:02.565 17:09:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:02.565 17:09:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:02.565 17:09:13 -- common/autotest_common.sh@10 -- # set +x 00:27:02.565 ************************************ 00:27:02.565 START TEST nvmf_digest_clean 00:27:02.565 ************************************ 00:27:02.565 17:09:13 -- common/autotest_common.sh@1114 -- # run_digest 00:27:02.565 17:09:13 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:27:02.565 17:09:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:02.565 17:09:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:02.565 17:09:13 -- common/autotest_common.sh@10 -- # set +x 00:27:02.824 17:09:13 -- nvmf/common.sh@469 -- # nvmfpid=317830 00:27:02.824 17:09:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:02.824 17:09:13 -- nvmf/common.sh@470 -- # waitforlisten 317830 00:27:02.824 17:09:13 -- common/autotest_common.sh@829 -- # '[' -z 317830 ']' 00:27:02.824 17:09:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:02.824 17:09:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:02.824 17:09:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:02.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:02.824 17:09:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:02.824 17:09:14 -- common/autotest_common.sh@10 -- # set +x 00:27:02.824 [2024-11-29 17:09:14.042909] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:02.824 [2024-11-29 17:09:14.042998] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:02.824 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.824 [2024-11-29 17:09:14.110002] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:02.824 [2024-11-29 17:09:14.222332] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:02.824 [2024-11-29 17:09:14.222525] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:02.824 [2024-11-29 17:09:14.222546] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:02.824 [2024-11-29 17:09:14.222561] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:02.824 [2024-11-29 17:09:14.222600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:02.824 17:09:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:02.824 17:09:14 -- common/autotest_common.sh@862 -- # return 0 00:27:02.824 17:09:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:02.824 17:09:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:02.824 17:09:14 -- common/autotest_common.sh@10 -- # set +x 00:27:03.082 17:09:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:03.082 17:09:14 -- host/digest.sh@120 -- # common_target_config 00:27:03.082 17:09:14 -- host/digest.sh@43 -- # rpc_cmd 00:27:03.082 17:09:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.082 17:09:14 -- common/autotest_common.sh@10 -- # set +x 00:27:03.082 null0 00:27:03.082 [2024-11-29 17:09:14.393082] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:03.082 [2024-11-29 17:09:14.417312] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:03.082 17:09:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.082 17:09:14 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:27:03.083 17:09:14 -- host/digest.sh@77 -- # local rw bs qd 00:27:03.083 17:09:14 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:03.083 17:09:14 -- host/digest.sh@80 -- # rw=randread 00:27:03.083 17:09:14 -- host/digest.sh@80 -- # bs=4096 00:27:03.083 17:09:14 -- host/digest.sh@80 -- # qd=128 00:27:03.083 17:09:14 -- host/digest.sh@82 -- # bperfpid=317863 00:27:03.083 17:09:14 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:27:03.083 17:09:14 -- host/digest.sh@83 -- # waitforlisten 317863 /var/tmp/bperf.sock 00:27:03.083 17:09:14 -- common/autotest_common.sh@829 -- # '[' -z 317863 ']' 00:27:03.083 17:09:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:03.083 17:09:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:03.083 17:09:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:03.083 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:03.083 17:09:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:03.083 17:09:14 -- common/autotest_common.sh@10 -- # set +x 00:27:03.083 [2024-11-29 17:09:14.459867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:03.083 [2024-11-29 17:09:14.459927] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid317863 ] 00:27:03.083 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.341 [2024-11-29 17:09:14.521618] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:03.342 [2024-11-29 17:09:14.630251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:03.342 17:09:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:03.342 17:09:14 -- common/autotest_common.sh@862 -- # return 0 00:27:03.342 17:09:14 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:03.342 17:09:14 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:03.342 17:09:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:03.907 17:09:15 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:03.907 17:09:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:04.164 nvme0n1 00:27:04.164 17:09:15 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:04.164 17:09:15 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:04.422 Running I/O for 2 seconds... 00:27:06.322 00:27:06.322 Latency(us) 00:27:06.322 [2024-11-29T16:09:17.753Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:06.322 [2024-11-29T16:09:17.753Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:06.322 nvme0n1 : 2.00 15678.78 61.25 0.00 0.00 8153.02 3713.71 18835.53 00:27:06.322 [2024-11-29T16:09:17.753Z] =================================================================================================================== 00:27:06.322 [2024-11-29T16:09:17.753Z] Total : 15678.78 61.25 0.00 0.00 8153.02 3713.71 18835.53 00:27:06.322 0 00:27:06.322 17:09:17 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:06.322 17:09:17 -- host/digest.sh@92 -- # get_accel_stats 00:27:06.322 17:09:17 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:06.322 17:09:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:06.322 17:09:17 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:06.322 | select(.opcode=="crc32c") 00:27:06.322 | "\(.module_name) \(.executed)"' 00:27:06.579 17:09:17 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:06.579 17:09:17 -- host/digest.sh@93 -- # exp_module=software 00:27:06.579 17:09:17 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:06.579 17:09:17 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:06.579 17:09:17 -- host/digest.sh@97 -- # killprocess 317863 00:27:06.579 17:09:17 -- common/autotest_common.sh@936 -- # '[' -z 317863 ']' 00:27:06.579 17:09:17 -- common/autotest_common.sh@940 -- # kill -0 317863 00:27:06.579 17:09:17 -- common/autotest_common.sh@941 -- # uname 00:27:06.579 17:09:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:06.579 17:09:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 317863 00:27:06.579 17:09:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:06.579 17:09:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:06.579 17:09:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 317863' 00:27:06.579 killing process with pid 317863 00:27:06.579 17:09:17 -- common/autotest_common.sh@955 -- # kill 317863 00:27:06.579 Received shutdown signal, test time was about 2.000000 seconds 00:27:06.579 00:27:06.579 Latency(us) 00:27:06.579 [2024-11-29T16:09:18.010Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:06.579 [2024-11-29T16:09:18.010Z] =================================================================================================================== 00:27:06.579 [2024-11-29T16:09:18.010Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:06.579 17:09:17 -- common/autotest_common.sh@960 -- # wait 317863 00:27:06.837 17:09:18 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:27:06.837 17:09:18 -- host/digest.sh@77 -- # local rw bs qd 00:27:06.837 17:09:18 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:06.837 17:09:18 -- host/digest.sh@80 -- # rw=randread 00:27:06.837 17:09:18 -- host/digest.sh@80 -- # bs=131072 00:27:06.837 17:09:18 -- host/digest.sh@80 -- # qd=16 00:27:06.837 17:09:18 -- host/digest.sh@82 -- # bperfpid=318396 00:27:06.837 17:09:18 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:06.837 17:09:18 -- host/digest.sh@83 -- # waitforlisten 318396 /var/tmp/bperf.sock 00:27:06.837 17:09:18 -- common/autotest_common.sh@829 -- # '[' -z 318396 ']' 00:27:06.837 17:09:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:06.837 17:09:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:06.837 17:09:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:06.837 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:06.837 17:09:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:06.837 17:09:18 -- common/autotest_common.sh@10 -- # set +x 00:27:06.837 [2024-11-29 17:09:18.255015] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:06.837 [2024-11-29 17:09:18.255117] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid318396 ] 00:27:06.837 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:06.837 Zero copy mechanism will not be used. 00:27:07.095 EAL: No free 2048 kB hugepages reported on node 1 00:27:07.095 [2024-11-29 17:09:18.318620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:07.095 [2024-11-29 17:09:18.424742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:07.095 17:09:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:07.095 17:09:18 -- common/autotest_common.sh@862 -- # return 0 00:27:07.095 17:09:18 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:07.095 17:09:18 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:07.095 17:09:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:07.661 17:09:18 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:07.661 17:09:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:07.919 nvme0n1 00:27:07.919 17:09:19 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:07.919 17:09:19 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:08.177 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:08.177 Zero copy mechanism will not be used. 00:27:08.177 Running I/O for 2 seconds... 00:27:10.079 00:27:10.079 Latency(us) 00:27:10.079 [2024-11-29T16:09:21.510Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.079 [2024-11-29T16:09:21.510Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:10.079 nvme0n1 : 2.00 5623.66 702.96 0.00 0.00 2840.83 770.65 9757.58 00:27:10.079 [2024-11-29T16:09:21.510Z] =================================================================================================================== 00:27:10.079 [2024-11-29T16:09:21.510Z] Total : 5623.66 702.96 0.00 0.00 2840.83 770.65 9757.58 00:27:10.079 0 00:27:10.079 17:09:21 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:10.079 17:09:21 -- host/digest.sh@92 -- # get_accel_stats 00:27:10.079 17:09:21 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:10.079 17:09:21 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:10.079 | select(.opcode=="crc32c") 00:27:10.079 | "\(.module_name) \(.executed)"' 00:27:10.079 17:09:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:10.337 17:09:21 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:10.337 17:09:21 -- host/digest.sh@93 -- # exp_module=software 00:27:10.337 17:09:21 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:10.337 17:09:21 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:10.337 17:09:21 -- host/digest.sh@97 -- # killprocess 318396 00:27:10.337 17:09:21 -- common/autotest_common.sh@936 -- # '[' -z 318396 ']' 00:27:10.337 17:09:21 -- common/autotest_common.sh@940 -- # kill -0 318396 00:27:10.337 17:09:21 -- common/autotest_common.sh@941 -- # uname 00:27:10.337 17:09:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:10.337 17:09:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 318396 00:27:10.337 17:09:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:10.337 17:09:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:10.337 17:09:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 318396' 00:27:10.337 killing process with pid 318396 00:27:10.337 17:09:21 -- common/autotest_common.sh@955 -- # kill 318396 00:27:10.337 Received shutdown signal, test time was about 2.000000 seconds 00:27:10.337 00:27:10.337 Latency(us) 00:27:10.337 [2024-11-29T16:09:21.768Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.337 [2024-11-29T16:09:21.768Z] =================================================================================================================== 00:27:10.337 [2024-11-29T16:09:21.768Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:10.337 17:09:21 -- common/autotest_common.sh@960 -- # wait 318396 00:27:10.596 17:09:21 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:27:10.596 17:09:21 -- host/digest.sh@77 -- # local rw bs qd 00:27:10.596 17:09:21 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:10.596 17:09:21 -- host/digest.sh@80 -- # rw=randwrite 00:27:10.596 17:09:21 -- host/digest.sh@80 -- # bs=4096 00:27:10.596 17:09:21 -- host/digest.sh@80 -- # qd=128 00:27:10.596 17:09:21 -- host/digest.sh@82 -- # bperfpid=318823 00:27:10.596 17:09:21 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:27:10.596 17:09:21 -- host/digest.sh@83 -- # waitforlisten 318823 /var/tmp/bperf.sock 00:27:10.596 17:09:21 -- common/autotest_common.sh@829 -- # '[' -z 318823 ']' 00:27:10.596 17:09:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:10.596 17:09:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:10.596 17:09:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:10.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:10.596 17:09:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:10.596 17:09:21 -- common/autotest_common.sh@10 -- # set +x 00:27:10.596 [2024-11-29 17:09:22.009511] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:10.596 [2024-11-29 17:09:22.009583] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid318823 ] 00:27:10.855 EAL: No free 2048 kB hugepages reported on node 1 00:27:10.855 [2024-11-29 17:09:22.066471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:10.855 [2024-11-29 17:09:22.171743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:10.855 17:09:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:10.855 17:09:22 -- common/autotest_common.sh@862 -- # return 0 00:27:10.855 17:09:22 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:10.855 17:09:22 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:10.855 17:09:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:11.420 17:09:22 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:11.420 17:09:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:11.678 nvme0n1 00:27:11.678 17:09:22 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:11.678 17:09:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:11.678 Running I/O for 2 seconds... 00:27:14.206 00:27:14.206 Latency(us) 00:27:14.206 [2024-11-29T16:09:25.637Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.206 [2024-11-29T16:09:25.637Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:14.206 nvme0n1 : 2.00 20863.07 81.50 0.00 0.00 6125.96 2536.49 13495.56 00:27:14.206 [2024-11-29T16:09:25.637Z] =================================================================================================================== 00:27:14.206 [2024-11-29T16:09:25.637Z] Total : 20863.07 81.50 0.00 0.00 6125.96 2536.49 13495.56 00:27:14.206 0 00:27:14.206 17:09:25 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:14.206 17:09:25 -- host/digest.sh@92 -- # get_accel_stats 00:27:14.206 17:09:25 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:14.206 17:09:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:14.206 17:09:25 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:14.206 | select(.opcode=="crc32c") 00:27:14.206 | "\(.module_name) \(.executed)"' 00:27:14.206 17:09:25 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:14.206 17:09:25 -- host/digest.sh@93 -- # exp_module=software 00:27:14.206 17:09:25 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:14.206 17:09:25 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:14.206 17:09:25 -- host/digest.sh@97 -- # killprocess 318823 00:27:14.206 17:09:25 -- common/autotest_common.sh@936 -- # '[' -z 318823 ']' 00:27:14.206 17:09:25 -- common/autotest_common.sh@940 -- # kill -0 318823 00:27:14.206 17:09:25 -- common/autotest_common.sh@941 -- # uname 00:27:14.206 17:09:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:14.206 17:09:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 318823 00:27:14.206 17:09:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:14.206 17:09:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:14.206 17:09:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 318823' 00:27:14.206 killing process with pid 318823 00:27:14.206 17:09:25 -- common/autotest_common.sh@955 -- # kill 318823 00:27:14.206 Received shutdown signal, test time was about 2.000000 seconds 00:27:14.206 00:27:14.206 Latency(us) 00:27:14.206 [2024-11-29T16:09:25.637Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.206 [2024-11-29T16:09:25.637Z] =================================================================================================================== 00:27:14.206 [2024-11-29T16:09:25.637Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:14.206 17:09:25 -- common/autotest_common.sh@960 -- # wait 318823 00:27:14.464 17:09:25 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:27:14.464 17:09:25 -- host/digest.sh@77 -- # local rw bs qd 00:27:14.464 17:09:25 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:14.464 17:09:25 -- host/digest.sh@80 -- # rw=randwrite 00:27:14.464 17:09:25 -- host/digest.sh@80 -- # bs=131072 00:27:14.464 17:09:25 -- host/digest.sh@80 -- # qd=16 00:27:14.464 17:09:25 -- host/digest.sh@82 -- # bperfpid=319239 00:27:14.464 17:09:25 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:14.464 17:09:25 -- host/digest.sh@83 -- # waitforlisten 319239 /var/tmp/bperf.sock 00:27:14.464 17:09:25 -- common/autotest_common.sh@829 -- # '[' -z 319239 ']' 00:27:14.464 17:09:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:14.464 17:09:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:14.464 17:09:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:14.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:14.464 17:09:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:14.464 17:09:25 -- common/autotest_common.sh@10 -- # set +x 00:27:14.464 [2024-11-29 17:09:25.694683] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:14.464 [2024-11-29 17:09:25.694757] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid319239 ] 00:27:14.464 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:14.464 Zero copy mechanism will not be used. 00:27:14.464 EAL: No free 2048 kB hugepages reported on node 1 00:27:14.464 [2024-11-29 17:09:25.756273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:14.464 [2024-11-29 17:09:25.863999] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:14.722 17:09:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:14.722 17:09:25 -- common/autotest_common.sh@862 -- # return 0 00:27:14.722 17:09:25 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:14.722 17:09:25 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:14.722 17:09:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:14.980 17:09:26 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:14.980 17:09:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:15.238 nvme0n1 00:27:15.238 17:09:26 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:15.238 17:09:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:15.496 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:15.496 Zero copy mechanism will not be used. 00:27:15.496 Running I/O for 2 seconds... 00:27:17.395 00:27:17.395 Latency(us) 00:27:17.395 [2024-11-29T16:09:28.826Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.395 [2024-11-29T16:09:28.826Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:17.395 nvme0n1 : 2.00 5161.81 645.23 0.00 0.00 3091.66 2548.62 9175.04 00:27:17.395 [2024-11-29T16:09:28.826Z] =================================================================================================================== 00:27:17.395 [2024-11-29T16:09:28.826Z] Total : 5161.81 645.23 0.00 0.00 3091.66 2548.62 9175.04 00:27:17.395 0 00:27:17.395 17:09:28 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:17.395 17:09:28 -- host/digest.sh@92 -- # get_accel_stats 00:27:17.395 17:09:28 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:17.395 17:09:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:17.395 17:09:28 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:17.395 | select(.opcode=="crc32c") 00:27:17.395 | "\(.module_name) \(.executed)"' 00:27:17.653 17:09:28 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:17.653 17:09:28 -- host/digest.sh@93 -- # exp_module=software 00:27:17.653 17:09:28 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:17.653 17:09:28 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:17.653 17:09:28 -- host/digest.sh@97 -- # killprocess 319239 00:27:17.653 17:09:28 -- common/autotest_common.sh@936 -- # '[' -z 319239 ']' 00:27:17.653 17:09:28 -- common/autotest_common.sh@940 -- # kill -0 319239 00:27:17.653 17:09:28 -- common/autotest_common.sh@941 -- # uname 00:27:17.653 17:09:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:17.653 17:09:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 319239 00:27:17.653 17:09:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:17.653 17:09:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:17.653 17:09:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 319239' 00:27:17.653 killing process with pid 319239 00:27:17.653 17:09:29 -- common/autotest_common.sh@955 -- # kill 319239 00:27:17.653 Received shutdown signal, test time was about 2.000000 seconds 00:27:17.653 00:27:17.653 Latency(us) 00:27:17.653 [2024-11-29T16:09:29.084Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.653 [2024-11-29T16:09:29.084Z] =================================================================================================================== 00:27:17.653 [2024-11-29T16:09:29.084Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:17.653 17:09:29 -- common/autotest_common.sh@960 -- # wait 319239 00:27:17.911 17:09:29 -- host/digest.sh@126 -- # killprocess 317830 00:27:17.911 17:09:29 -- common/autotest_common.sh@936 -- # '[' -z 317830 ']' 00:27:17.911 17:09:29 -- common/autotest_common.sh@940 -- # kill -0 317830 00:27:17.911 17:09:29 -- common/autotest_common.sh@941 -- # uname 00:27:17.911 17:09:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:17.911 17:09:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 317830 00:27:17.911 17:09:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:17.911 17:09:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:17.911 17:09:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 317830' 00:27:17.911 killing process with pid 317830 00:27:17.911 17:09:29 -- common/autotest_common.sh@955 -- # kill 317830 00:27:17.911 17:09:29 -- common/autotest_common.sh@960 -- # wait 317830 00:27:18.169 00:27:18.169 real 0m15.584s 00:27:18.169 user 0m30.369s 00:27:18.169 sys 0m4.408s 00:27:18.169 17:09:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:18.169 17:09:29 -- common/autotest_common.sh@10 -- # set +x 00:27:18.169 ************************************ 00:27:18.169 END TEST nvmf_digest_clean 00:27:18.169 ************************************ 00:27:18.428 17:09:29 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:18.428 17:09:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:18.428 17:09:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:18.428 17:09:29 -- common/autotest_common.sh@10 -- # set +x 00:27:18.428 ************************************ 00:27:18.428 START TEST nvmf_digest_error 00:27:18.428 ************************************ 00:27:18.428 17:09:29 -- common/autotest_common.sh@1114 -- # run_digest_error 00:27:18.428 17:09:29 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:18.428 17:09:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:18.428 17:09:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:18.428 17:09:29 -- common/autotest_common.sh@10 -- # set +x 00:27:18.428 17:09:29 -- nvmf/common.sh@469 -- # nvmfpid=319803 00:27:18.428 17:09:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:18.428 17:09:29 -- nvmf/common.sh@470 -- # waitforlisten 319803 00:27:18.428 17:09:29 -- common/autotest_common.sh@829 -- # '[' -z 319803 ']' 00:27:18.428 17:09:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:18.428 17:09:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:18.428 17:09:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:18.428 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:18.428 17:09:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:18.428 17:09:29 -- common/autotest_common.sh@10 -- # set +x 00:27:18.428 [2024-11-29 17:09:29.647435] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:18.428 [2024-11-29 17:09:29.647510] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:18.428 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.428 [2024-11-29 17:09:29.709805] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:18.428 [2024-11-29 17:09:29.815112] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:18.428 [2024-11-29 17:09:29.815257] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:18.428 [2024-11-29 17:09:29.815276] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:18.428 [2024-11-29 17:09:29.815288] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:18.428 [2024-11-29 17:09:29.815314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:18.686 17:09:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:18.686 17:09:29 -- common/autotest_common.sh@862 -- # return 0 00:27:18.686 17:09:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:18.686 17:09:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:18.686 17:09:29 -- common/autotest_common.sh@10 -- # set +x 00:27:18.686 17:09:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:18.686 17:09:29 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:18.686 17:09:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:18.686 17:09:29 -- common/autotest_common.sh@10 -- # set +x 00:27:18.686 [2024-11-29 17:09:29.903968] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:18.686 17:09:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:18.686 17:09:29 -- host/digest.sh@104 -- # common_target_config 00:27:18.686 17:09:29 -- host/digest.sh@43 -- # rpc_cmd 00:27:18.686 17:09:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:18.686 17:09:29 -- common/autotest_common.sh@10 -- # set +x 00:27:18.686 null0 00:27:18.686 [2024-11-29 17:09:30.023795] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:18.686 [2024-11-29 17:09:30.048094] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:18.686 17:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:18.686 17:09:30 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:18.686 17:09:30 -- host/digest.sh@54 -- # local rw bs qd 00:27:18.686 17:09:30 -- host/digest.sh@56 -- # rw=randread 00:27:18.686 17:09:30 -- host/digest.sh@56 -- # bs=4096 00:27:18.686 17:09:30 -- host/digest.sh@56 -- # qd=128 00:27:18.686 17:09:30 -- host/digest.sh@58 -- # bperfpid=319829 00:27:18.686 17:09:30 -- host/digest.sh@60 -- # waitforlisten 319829 /var/tmp/bperf.sock 00:27:18.686 17:09:30 -- common/autotest_common.sh@829 -- # '[' -z 319829 ']' 00:27:18.686 17:09:30 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:18.686 17:09:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:18.686 17:09:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:18.686 17:09:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:18.686 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:18.686 17:09:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:18.686 17:09:30 -- common/autotest_common.sh@10 -- # set +x 00:27:18.686 [2024-11-29 17:09:30.097251] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:18.686 [2024-11-29 17:09:30.097355] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid319829 ] 00:27:18.945 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.945 [2024-11-29 17:09:30.164023] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:18.945 [2024-11-29 17:09:30.279549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:19.878 17:09:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:19.878 17:09:31 -- common/autotest_common.sh@862 -- # return 0 00:27:19.878 17:09:31 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:19.878 17:09:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:20.135 17:09:31 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:20.136 17:09:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.136 17:09:31 -- common/autotest_common.sh@10 -- # set +x 00:27:20.136 17:09:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.136 17:09:31 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:20.136 17:09:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:20.394 nvme0n1 00:27:20.394 17:09:31 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:20.394 17:09:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.394 17:09:31 -- common/autotest_common.sh@10 -- # set +x 00:27:20.394 17:09:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.394 17:09:31 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:20.394 17:09:31 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:20.652 Running I/O for 2 seconds... 00:27:20.652 [2024-11-29 17:09:31.890568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.652 [2024-11-29 17:09:31.890620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5031 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.652 [2024-11-29 17:09:31.890642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.652 [2024-11-29 17:09:31.903751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.652 [2024-11-29 17:09:31.903783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:12511 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.652 [2024-11-29 17:09:31.903812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.652 [2024-11-29 17:09:31.914157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.652 [2024-11-29 17:09:31.914189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:1547 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.652 [2024-11-29 17:09:31.914206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.652 [2024-11-29 17:09:31.929346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.652 [2024-11-29 17:09:31.929377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19657 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.652 [2024-11-29 17:09:31.929393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.652 [2024-11-29 17:09:31.944275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.652 [2024-11-29 17:09:31.944304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:5177 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.652 [2024-11-29 17:09:31.944320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.652 [2024-11-29 17:09:31.958858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.652 [2024-11-29 17:09:31.958887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21024 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.652 [2024-11-29 17:09:31.958903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.652 [2024-11-29 17:09:31.973852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.652 [2024-11-29 17:09:31.973882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21619 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.652 [2024-11-29 17:09:31.973898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.652 [2024-11-29 17:09:31.989248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.652 [2024-11-29 17:09:31.989277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4533 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.652 [2024-11-29 17:09:31.989309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.652 [2024-11-29 17:09:32.004850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.652 [2024-11-29 17:09:32.004887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4470 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.653 [2024-11-29 17:09:32.004908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.653 [2024-11-29 17:09:32.020566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.653 [2024-11-29 17:09:32.020600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:3436 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.653 [2024-11-29 17:09:32.020619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.653 [2024-11-29 17:09:32.035807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.653 [2024-11-29 17:09:32.035848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13932 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.653 [2024-11-29 17:09:32.035868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.653 [2024-11-29 17:09:32.048238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.653 [2024-11-29 17:09:32.048273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:10161 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.653 [2024-11-29 17:09:32.048307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.653 [2024-11-29 17:09:32.059144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.653 [2024-11-29 17:09:32.059173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12758 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.653 [2024-11-29 17:09:32.059190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.653 [2024-11-29 17:09:32.074553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.653 [2024-11-29 17:09:32.074589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20954 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.653 [2024-11-29 17:09:32.074610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.911 [2024-11-29 17:09:32.090839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.911 [2024-11-29 17:09:32.090876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:900 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.911 [2024-11-29 17:09:32.090896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.911 [2024-11-29 17:09:32.107798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.911 [2024-11-29 17:09:32.107833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:17831 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.911 [2024-11-29 17:09:32.107852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.911 [2024-11-29 17:09:32.121287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.911 [2024-11-29 17:09:32.121318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:6527 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.911 [2024-11-29 17:09:32.121352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.911 [2024-11-29 17:09:32.133115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.911 [2024-11-29 17:09:32.133145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:7593 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.911 [2024-11-29 17:09:32.133162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.911 [2024-11-29 17:09:32.147384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.911 [2024-11-29 17:09:32.147419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:7164 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.911 [2024-11-29 17:09:32.147437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.911 [2024-11-29 17:09:32.159292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.911 [2024-11-29 17:09:32.159327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:24756 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.911 [2024-11-29 17:09:32.159346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.911 [2024-11-29 17:09:32.176023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.911 [2024-11-29 17:09:32.176053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:1098 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.911 [2024-11-29 17:09:32.176069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.189350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.189384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:17488 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.189403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.203256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.203300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:5827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.203320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.214912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.214946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:25125 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.214973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.230517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.230552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:22461 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.230572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.247779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.247814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23664 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.247833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.264929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.264971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.264992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.281568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.281602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:1395 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.281627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.296970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.297017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:15633 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.297033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.308265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.308299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:5599 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.308318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.322405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.322439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:4205 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.322457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.912 [2024-11-29 17:09:32.337888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:20.912 [2024-11-29 17:09:32.337923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20042 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.912 [2024-11-29 17:09:32.337942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.349700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.349733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:813 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.349752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.366352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.366387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:5022 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.366406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.381884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.381918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:4253 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.381937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.396772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.396806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:25222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.396824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.412518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.412565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:11432 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.412582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.424022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.424052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:11746 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.424068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.436029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.436059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:25020 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.436076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.450371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.450404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:2099 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.450423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.465341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.465375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:15817 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.465394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.476159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.476189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:20495 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.476222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.489490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.489523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:16935 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.489541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.506476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.506510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:12173 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.506530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.524079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.524125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:1673 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.524148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.541418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.541454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:11959 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.541474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.556750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.556785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:2798 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.556803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.575007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.575036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:9469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.575052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.171 [2024-11-29 17:09:32.591642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.171 [2024-11-29 17:09:32.591678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:15503 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.171 [2024-11-29 17:09:32.591697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.603341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.603384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:18846 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.603403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.617244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.617288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:18896 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.617307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.634855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.634889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18207 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.634908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.650187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.650241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22833 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.650258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.661112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.661146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:9656 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.661163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.676693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.676727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:23357 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.676746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.693501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.693537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.693556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.709013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.709066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:24441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.709085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.719753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.719787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17192 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.719806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.734864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.734897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:5205 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.734916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.750412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.750447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.750466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.765260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.765294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:16925 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.765312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.782126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.782154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:19265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.782170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.799629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.799663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:12520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.799682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.816270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.816304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:2718 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.430 [2024-11-29 17:09:32.816324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.430 [2024-11-29 17:09:32.832245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.430 [2024-11-29 17:09:32.832293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:18821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.431 [2024-11-29 17:09:32.832312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.431 [2024-11-29 17:09:32.848739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.431 [2024-11-29 17:09:32.848773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17032 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.431 [2024-11-29 17:09:32.848792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:32.862651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:32.862685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:5491 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:32.862704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:32.874830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:32.874864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:2911 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:32.874882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:32.891760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:32.891795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17865 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:32.891814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:32.908475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:32.908509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:12976 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:32.908529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:32.925688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:32.925722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19752 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:32.925749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:32.942746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:32.942780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:6317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:32.942799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:32.959663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:32.959699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:9390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:32.959718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:32.975129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:32.975160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:24731 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:32.975177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:32.993376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:32.993410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:10213 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:32.993429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:33.009681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:33.009712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:1091 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:33.009728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:33.025773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:33.025809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17327 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:33.025829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:33.042473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:33.042507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:607 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:33.042525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:33.059052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.689 [2024-11-29 17:09:33.059079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:22586 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.689 [2024-11-29 17:09:33.059095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.689 [2024-11-29 17:09:33.075642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.690 [2024-11-29 17:09:33.075677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:9229 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.690 [2024-11-29 17:09:33.075696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.690 [2024-11-29 17:09:33.092249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.690 [2024-11-29 17:09:33.092292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:8688 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.690 [2024-11-29 17:09:33.092308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.690 [2024-11-29 17:09:33.109237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.690 [2024-11-29 17:09:33.109286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:4413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.690 [2024-11-29 17:09:33.109305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.126518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.126552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:24935 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.126571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.143533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.143568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.143587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.159821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.159856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16972 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.159881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.177707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.177742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:7083 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.177766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.194441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.194475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:3419 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.194495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.209696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.209732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:18648 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.209763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.227978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.228024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:19785 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.228043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.243185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.243216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:16202 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.243233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.254356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.254390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:15030 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.254412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.269821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.269854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:161 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.269874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.286786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.286819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:12061 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.286837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.303546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.303579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:2800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.303602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.948 [2024-11-29 17:09:33.320563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.948 [2024-11-29 17:09:33.320597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:3781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.948 [2024-11-29 17:09:33.320621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.949 [2024-11-29 17:09:33.335802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.949 [2024-11-29 17:09:33.335836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:15915 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.949 [2024-11-29 17:09:33.335855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.949 [2024-11-29 17:09:33.347652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.949 [2024-11-29 17:09:33.347692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:23985 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.949 [2024-11-29 17:09:33.347712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.949 [2024-11-29 17:09:33.364185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:21.949 [2024-11-29 17:09:33.364214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:13469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.949 [2024-11-29 17:09:33.364233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.381065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.381095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:17292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.381111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.397973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.398018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:6738 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.398034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.414676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.414710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10908 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.414728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.431368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.431402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2953 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.431421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.448070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.448099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23990 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.448118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.464894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.464929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:17954 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.464948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.481830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.481864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:2343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.481883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.498696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.498730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:7700 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.498750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.515338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.515384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:15014 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.515402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.530704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.530738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:9429 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.530760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.207 [2024-11-29 17:09:33.548221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.207 [2024-11-29 17:09:33.548265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:7239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.207 [2024-11-29 17:09:33.548285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.208 [2024-11-29 17:09:33.559425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.208 [2024-11-29 17:09:33.559458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:18387 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.208 [2024-11-29 17:09:33.559477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.208 [2024-11-29 17:09:33.575870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.208 [2024-11-29 17:09:33.575903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:13929 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.208 [2024-11-29 17:09:33.575922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.208 [2024-11-29 17:09:33.592817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.208 [2024-11-29 17:09:33.592852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:3544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.208 [2024-11-29 17:09:33.592878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.208 [2024-11-29 17:09:33.609826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.208 [2024-11-29 17:09:33.609859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:18598 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.208 [2024-11-29 17:09:33.609878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.208 [2024-11-29 17:09:33.626592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.208 [2024-11-29 17:09:33.626626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:15240 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.208 [2024-11-29 17:09:33.626656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.644087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.644116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:13761 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.644133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.659762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.659797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22214 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.659823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.671380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.671414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:15002 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.671433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.689717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.689751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19753 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.689771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.705749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.705784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:23579 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.705808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.723642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.723683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1386 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.723702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.740868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.740903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14379 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.740923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.757799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.757833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:6104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.757851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.774765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.774805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:22936 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.774825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.791934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.791979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:11713 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.792013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.803669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.803703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:16143 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.803722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.819511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.819545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5096 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.819564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.836157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.836186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:20743 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.836202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.853342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.853388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:9204 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.853407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.466 [2024-11-29 17:09:33.866552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e9bb0) 00:27:22.466 [2024-11-29 17:09:33.866586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:14000 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.466 [2024-11-29 17:09:33.866605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.724 00:27:22.724 Latency(us) 00:27:22.724 [2024-11-29T16:09:34.155Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:22.724 [2024-11-29T16:09:34.155Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:22.724 nvme0n1 : 2.05 16145.58 63.07 0.00 0.00 7764.48 3398.16 56312.41 00:27:22.724 [2024-11-29T16:09:34.155Z] =================================================================================================================== 00:27:22.724 [2024-11-29T16:09:34.155Z] Total : 16145.58 63.07 0.00 0.00 7764.48 3398.16 56312.41 00:27:22.724 0 00:27:22.724 17:09:33 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:22.724 17:09:33 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:22.724 17:09:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:22.724 17:09:33 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:22.724 | .driver_specific 00:27:22.724 | .nvme_error 00:27:22.724 | .status_code 00:27:22.724 | .command_transient_transport_error' 00:27:22.981 17:09:34 -- host/digest.sh@71 -- # (( 129 > 0 )) 00:27:22.981 17:09:34 -- host/digest.sh@73 -- # killprocess 319829 00:27:22.981 17:09:34 -- common/autotest_common.sh@936 -- # '[' -z 319829 ']' 00:27:22.981 17:09:34 -- common/autotest_common.sh@940 -- # kill -0 319829 00:27:22.981 17:09:34 -- common/autotest_common.sh@941 -- # uname 00:27:22.981 17:09:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:22.981 17:09:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 319829 00:27:22.982 17:09:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:22.982 17:09:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:22.982 17:09:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 319829' 00:27:22.982 killing process with pid 319829 00:27:22.982 17:09:34 -- common/autotest_common.sh@955 -- # kill 319829 00:27:22.982 Received shutdown signal, test time was about 2.000000 seconds 00:27:22.982 00:27:22.982 Latency(us) 00:27:22.982 [2024-11-29T16:09:34.413Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:22.982 [2024-11-29T16:09:34.413Z] =================================================================================================================== 00:27:22.982 [2024-11-29T16:09:34.413Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:22.982 17:09:34 -- common/autotest_common.sh@960 -- # wait 319829 00:27:23.239 17:09:34 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:23.239 17:09:34 -- host/digest.sh@54 -- # local rw bs qd 00:27:23.239 17:09:34 -- host/digest.sh@56 -- # rw=randread 00:27:23.239 17:09:34 -- host/digest.sh@56 -- # bs=131072 00:27:23.239 17:09:34 -- host/digest.sh@56 -- # qd=16 00:27:23.239 17:09:34 -- host/digest.sh@58 -- # bperfpid=320385 00:27:23.239 17:09:34 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:23.239 17:09:34 -- host/digest.sh@60 -- # waitforlisten 320385 /var/tmp/bperf.sock 00:27:23.239 17:09:34 -- common/autotest_common.sh@829 -- # '[' -z 320385 ']' 00:27:23.239 17:09:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:23.239 17:09:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:23.240 17:09:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:23.240 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:23.240 17:09:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:23.240 17:09:34 -- common/autotest_common.sh@10 -- # set +x 00:27:23.240 [2024-11-29 17:09:34.532578] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:23.240 [2024-11-29 17:09:34.532666] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid320385 ] 00:27:23.240 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:23.240 Zero copy mechanism will not be used. 00:27:23.240 EAL: No free 2048 kB hugepages reported on node 1 00:27:23.240 [2024-11-29 17:09:34.594070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:23.498 [2024-11-29 17:09:34.705270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:24.430 17:09:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:24.430 17:09:35 -- common/autotest_common.sh@862 -- # return 0 00:27:24.430 17:09:35 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:24.430 17:09:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:24.430 17:09:35 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:24.430 17:09:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.430 17:09:35 -- common/autotest_common.sh@10 -- # set +x 00:27:24.430 17:09:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.430 17:09:35 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:24.430 17:09:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:24.995 nvme0n1 00:27:24.995 17:09:36 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:24.995 17:09:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.995 17:09:36 -- common/autotest_common.sh@10 -- # set +x 00:27:24.995 17:09:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.995 17:09:36 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:24.995 17:09:36 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:24.995 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:24.995 Zero copy mechanism will not be used. 00:27:24.995 Running I/O for 2 seconds... 00:27:24.995 [2024-11-29 17:09:36.378393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:24.995 [2024-11-29 17:09:36.378453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.995 [2024-11-29 17:09:36.378478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.995 [2024-11-29 17:09:36.383922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:24.995 [2024-11-29 17:09:36.383970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.995 [2024-11-29 17:09:36.384017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.995 [2024-11-29 17:09:36.388048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:24.995 [2024-11-29 17:09:36.388080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.995 [2024-11-29 17:09:36.388098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.995 [2024-11-29 17:09:36.393377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:24.995 [2024-11-29 17:09:36.393413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.995 [2024-11-29 17:09:36.393433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.995 [2024-11-29 17:09:36.398625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:24.995 [2024-11-29 17:09:36.398661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.995 [2024-11-29 17:09:36.398681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.995 [2024-11-29 17:09:36.404301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:24.995 [2024-11-29 17:09:36.404337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.995 [2024-11-29 17:09:36.404358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.995 [2024-11-29 17:09:36.411752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:24.995 [2024-11-29 17:09:36.411800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.995 [2024-11-29 17:09:36.411820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.995 [2024-11-29 17:09:36.417935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:24.995 [2024-11-29 17:09:36.417980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.995 [2024-11-29 17:09:36.418001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.995 [2024-11-29 17:09:36.423590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:24.995 [2024-11-29 17:09:36.423624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.995 [2024-11-29 17:09:36.423644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.428632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.428667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.428687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.433000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.433029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.433046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.437279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.437326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.437345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.441761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.441794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.441814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.446505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.446538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.446558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.451247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.451296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.451315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.456317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.456350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.456369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.461530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.461564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.461582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.466370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.466403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.466422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.471658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.471693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.471712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.476361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.476396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.476416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.481258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.481292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.481311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.485904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.485938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.485966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.490359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.490392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.490410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.494882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.494915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.494940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.499422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.499455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.499474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.255 [2024-11-29 17:09:36.504162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.255 [2024-11-29 17:09:36.504192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.255 [2024-11-29 17:09:36.504209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.508583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.508617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.508636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.513191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.513222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.513239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.517721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.517754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.517773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.522394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.522426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.522444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.527123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.527151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.527168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.531894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.531926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.531945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.536506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.536545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.536565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.542118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.542148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.542165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.550329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.550365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.550385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.555736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.555771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.555791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.561348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.561384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.561404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.566604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.566639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.566658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.571205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.571257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.571275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.575867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.575900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.575918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.580453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.580485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.580503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.585115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.585143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.585159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.589669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.589703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.589722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.595990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.596037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.596054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.600315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.600349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.600368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.605387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.605421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.605441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.610868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.610903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.610923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.616530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.616565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.616584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.622085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.622115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.622131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.627062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.627108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.627128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.631974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.632022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.632040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.637020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.256 [2024-11-29 17:09:36.637054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.256 [2024-11-29 17:09:36.637072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.256 [2024-11-29 17:09:36.642408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.257 [2024-11-29 17:09:36.642445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.257 [2024-11-29 17:09:36.642466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.257 [2024-11-29 17:09:36.647766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.257 [2024-11-29 17:09:36.647801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.257 [2024-11-29 17:09:36.647821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.257 [2024-11-29 17:09:36.653489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.257 [2024-11-29 17:09:36.653524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.257 [2024-11-29 17:09:36.653544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.257 [2024-11-29 17:09:36.658756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.257 [2024-11-29 17:09:36.658791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.257 [2024-11-29 17:09:36.658810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.257 [2024-11-29 17:09:36.663566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.257 [2024-11-29 17:09:36.663602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.257 [2024-11-29 17:09:36.663621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.257 [2024-11-29 17:09:36.668336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.257 [2024-11-29 17:09:36.668371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.257 [2024-11-29 17:09:36.668391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.257 [2024-11-29 17:09:36.672889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.257 [2024-11-29 17:09:36.672924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.257 [2024-11-29 17:09:36.672943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.257 [2024-11-29 17:09:36.677587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.257 [2024-11-29 17:09:36.677619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.257 [2024-11-29 17:09:36.677636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.257 [2024-11-29 17:09:36.681913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.257 [2024-11-29 17:09:36.681946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.257 [2024-11-29 17:09:36.681972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.516 [2024-11-29 17:09:36.686395] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.516 [2024-11-29 17:09:36.686441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.516 [2024-11-29 17:09:36.686459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.516 [2024-11-29 17:09:36.693870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.516 [2024-11-29 17:09:36.693906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.516 [2024-11-29 17:09:36.693926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.516 [2024-11-29 17:09:36.700198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.516 [2024-11-29 17:09:36.700230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.516 [2024-11-29 17:09:36.700247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.516 [2024-11-29 17:09:36.705544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.516 [2024-11-29 17:09:36.705580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.516 [2024-11-29 17:09:36.705600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.516 [2024-11-29 17:09:36.710852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.516 [2024-11-29 17:09:36.710886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.516 [2024-11-29 17:09:36.710905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.516 [2024-11-29 17:09:36.715947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.516 [2024-11-29 17:09:36.715985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.516 [2024-11-29 17:09:36.716008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.721163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.721194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.721212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.726282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.726318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.726338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.731546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.731581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.731600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.736061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.736092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.736109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.740237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.740268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.740285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.744564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.744598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.744616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.748513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.748546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.748564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.751378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.751410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.751428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.755647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.755686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.755705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.759923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.759965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.760001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.764174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.764204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.764221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.768466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.768499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.768518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.772818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.772850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.772869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.777137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.777165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.777180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.781799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.781831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.781849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.786628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.786663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.786682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.791943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.792000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.792020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.796555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.796589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.796608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.801546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.801579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.801598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.806951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.806993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.807012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.812502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.812535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.812554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.817767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.817802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.817821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.823068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.823098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.823115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.828524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.828558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.828578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.833513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.517 [2024-11-29 17:09:36.833547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.517 [2024-11-29 17:09:36.833566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.517 [2024-11-29 17:09:36.838415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.838450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.838476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.843649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.843684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.843703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.849859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.849894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.849914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.855852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.855887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.855907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.862546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.862581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.862600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.868605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.868639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.868658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.874739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.874773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.874792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.881238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.881287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.881307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.887553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.887588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.887607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.894806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.894842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.894862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.901920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.901955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.901985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.909387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.909422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.909442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.917054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.917085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.917103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.923906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.923941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.923969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.929953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.930008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.930025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.935739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.935773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.935793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.518 [2024-11-29 17:09:36.941531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.518 [2024-11-29 17:09:36.941565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.518 [2024-11-29 17:09:36.941586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.946501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.946534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.946558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.951726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.951760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.951779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.957303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.957338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.957358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.963292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.963328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.963347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.968629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.968665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.968685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.972903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.972937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.972965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.977445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.977481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.977500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.982784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.982819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.982838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.987691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.987725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.987743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.993086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.993121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.993138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:36.998469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:36.998505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:36.998525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.004256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.004287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.004320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.010296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.010327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.010344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.015913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.015948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.015976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.021213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.021244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.021278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.025937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.025981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.026016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.030547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.030582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.030601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.034858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.034888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.034905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.039174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.039219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.039235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.043337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.043383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.043400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.048301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.048347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.048364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.052768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.052813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.052830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.057665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.057712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.778 [2024-11-29 17:09:37.057729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.778 [2024-11-29 17:09:37.062679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.778 [2024-11-29 17:09:37.062711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.062729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.068059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.068091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.068109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.073467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.073497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.073529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.078701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.078736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.078761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.084041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.084073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.084091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.089531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.089565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.089583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.095309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.095345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.095364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.100800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.100835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.100854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.106386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.106423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.106443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.111645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.111679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.111699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.117267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.117299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.117337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.123156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.123189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.123206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.128904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.128946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.128978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.134564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.134600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.134619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.140366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.140401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.140420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.146457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.146494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.146514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.152497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.152533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.152553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.158449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.158487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.158507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.163929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.163972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.164008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.169111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.169142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.169159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.173841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.173874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.173899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.179122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.179154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.179172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.184393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.184428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.184447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.189692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.189726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.189746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.195358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.195393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.195412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.779 [2024-11-29 17:09:37.201814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:25.779 [2024-11-29 17:09:37.201849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.779 [2024-11-29 17:09:37.201868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.209633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.039 [2024-11-29 17:09:37.209668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.039 [2024-11-29 17:09:37.209687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.216718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.039 [2024-11-29 17:09:37.216752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.039 [2024-11-29 17:09:37.216772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.224508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.039 [2024-11-29 17:09:37.224544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.039 [2024-11-29 17:09:37.224564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.232256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.039 [2024-11-29 17:09:37.232292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.039 [2024-11-29 17:09:37.232330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.238602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.039 [2024-11-29 17:09:37.238637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.039 [2024-11-29 17:09:37.238657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.245079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.039 [2024-11-29 17:09:37.245110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.039 [2024-11-29 17:09:37.245128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.252325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.039 [2024-11-29 17:09:37.252359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.039 [2024-11-29 17:09:37.252379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.259666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.039 [2024-11-29 17:09:37.259701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.039 [2024-11-29 17:09:37.259721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.267120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.039 [2024-11-29 17:09:37.267152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.039 [2024-11-29 17:09:37.267170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.039 [2024-11-29 17:09:37.274131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.274163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.274181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.281387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.281423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.281442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.289028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.289059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.289077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.296553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.296589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.296608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.304025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.304057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.304075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.310789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.310824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.310843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.316846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.316882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.316901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.322966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.323000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.323034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.328385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.328420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.328440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.333795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.333831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.333853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.339326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.339361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.339381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.346315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.346351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.346376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.353910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.353945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.353975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.360651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.360686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.360705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.368025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.368071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.368090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.375733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.375767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.375786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.383507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.383542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.383562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.389080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.389122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.389140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.393718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.393752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.393771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.398095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.398127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.398144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.402454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.402495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.402515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.406873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.406906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.406925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.411576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.411609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.411628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.416099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.416130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.416147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.420666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.420699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.420717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.425364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.425399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.040 [2024-11-29 17:09:37.425418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.040 [2024-11-29 17:09:37.430134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.040 [2024-11-29 17:09:37.430163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.041 [2024-11-29 17:09:37.430180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.041 [2024-11-29 17:09:37.434750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.041 [2024-11-29 17:09:37.434782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.041 [2024-11-29 17:09:37.434801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.041 [2024-11-29 17:09:37.439563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.041 [2024-11-29 17:09:37.439596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.041 [2024-11-29 17:09:37.439615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.041 [2024-11-29 17:09:37.444916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.041 [2024-11-29 17:09:37.444950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.041 [2024-11-29 17:09:37.444978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.041 [2024-11-29 17:09:37.450715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.041 [2024-11-29 17:09:37.450750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.041 [2024-11-29 17:09:37.450769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.041 [2024-11-29 17:09:37.456529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.041 [2024-11-29 17:09:37.456563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.041 [2024-11-29 17:09:37.456582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.041 [2024-11-29 17:09:37.463250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.041 [2024-11-29 17:09:37.463298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.041 [2024-11-29 17:09:37.463319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.041 [2024-11-29 17:09:37.468476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.041 [2024-11-29 17:09:37.468510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.041 [2024-11-29 17:09:37.468529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.300 [2024-11-29 17:09:37.473562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.300 [2024-11-29 17:09:37.473596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.300 [2024-11-29 17:09:37.473615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.300 [2024-11-29 17:09:37.478854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.300 [2024-11-29 17:09:37.478889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.300 [2024-11-29 17:09:37.478909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.300 [2024-11-29 17:09:37.483934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.300 [2024-11-29 17:09:37.483977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.484013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.489404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.489439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.489464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.495310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.495346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.495365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.501111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.501143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.501161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.507223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.507273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.507292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.513680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.513714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.513733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.519725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.519760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.519779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.525549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.525583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.525602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.531095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.531127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.531144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.535403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.535437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.535455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.542488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.542522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.542541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.549226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.549270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.549287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.556119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.556148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.556164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.563407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.563442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.563462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.571010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.571059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.571076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.577907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.577942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.577971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.586981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.587028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.587046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.592668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.592702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.592721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.597501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.597536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.597562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.601136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.601166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.601183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.605352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.605385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.605404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.609879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.609911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.609930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.614403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.614436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.614455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.619024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.619054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.619070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.623738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.623771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.623790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.629077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.629109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.629127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.301 [2024-11-29 17:09:37.634044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.301 [2024-11-29 17:09:37.634076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.301 [2024-11-29 17:09:37.634093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.639734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.639775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.639795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.645155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.645200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.645217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.650902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.650938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.650967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.656447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.656483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.656502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.661948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.662004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.662021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.666754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.666789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.666808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.671862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.671897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.671916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.677025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.677072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.677090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.681982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.682026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.682043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.687247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.687297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.687316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.692741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.692775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.692794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.698124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.698155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.698172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.702776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.702811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.702831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.708655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.708689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.708709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.716149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.716180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.716196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.302 [2024-11-29 17:09:37.722886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.302 [2024-11-29 17:09:37.722922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.302 [2024-11-29 17:09:37.722942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.562 [2024-11-29 17:09:37.730763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.562 [2024-11-29 17:09:37.730799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.730819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.737924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.737969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.737999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.743623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.743658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.743678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.748521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.748556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.748576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.753531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.753565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.753585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.758563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.758599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.758618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.764361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.764396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.764415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.770167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.770199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.770216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.776055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.776101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.776119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.782748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.782783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.782803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.788126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.788163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.788196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.793206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.793235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.793252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.797769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.797802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.797821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.802941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.802984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.803018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.807926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.807969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.808005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.813149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.813182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.813201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.818022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.818054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.818072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.822820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.822855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.822874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.827573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.827607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.827632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.832228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.832276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.832297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.837033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.837064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.837082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.842241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.842273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.842305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.848124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.848155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.848173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.855441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.855477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.855496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.861296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.861331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.563 [2024-11-29 17:09:37.861350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.563 [2024-11-29 17:09:37.866025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.563 [2024-11-29 17:09:37.866056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.866074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.870118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.870149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.870166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.874655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.874695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.874715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.879269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.879304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.879323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.884714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.884748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.884768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.889141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.889187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.889204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.894044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.894075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.894092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.898734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.898768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.898786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.903941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.903984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.904024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.910535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.910570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.910589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.917898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.917933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.917952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.923989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.924037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.924056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.931480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.931516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.931535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.938414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.938450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.938469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.946018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.946050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.946068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.953875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.953910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.953930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.961327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.961362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.961382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.968691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.968726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.968745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.976088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.976120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.976137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.983547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.983582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.983608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.564 [2024-11-29 17:09:37.991052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.564 [2024-11-29 17:09:37.991084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.564 [2024-11-29 17:09:37.991102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.824 [2024-11-29 17:09:37.998595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.824 [2024-11-29 17:09:37.998630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.824 [2024-11-29 17:09:37.998649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.824 [2024-11-29 17:09:38.006047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.824 [2024-11-29 17:09:38.006080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.824 [2024-11-29 17:09:38.006096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.824 [2024-11-29 17:09:38.013609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.824 [2024-11-29 17:09:38.013645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.013664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.021141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.021191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.021208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.028646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.028682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.028701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.035939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.035985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.036019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.043516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.043552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.043572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.050819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.050860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.050880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.058244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.058276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.058309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.063994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.064026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.064043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.068656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.068689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.068708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.073173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.073203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.073220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.077688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.077721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.077739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.082064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.082094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.082110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.086698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.086731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.086750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.091196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.091227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.091244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.096089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.096121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.096139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.100117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.100149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.100166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.105140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.105171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.105189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.110173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.110205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.110222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.115449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.115484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.115504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.120454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.120488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.120507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.125003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.125035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.125052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.129535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.129568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.129587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.134176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.134206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.134229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.138827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.825 [2024-11-29 17:09:38.138860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.825 [2024-11-29 17:09:38.138879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.825 [2024-11-29 17:09:38.143452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.143486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.143505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.147830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.147863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.147881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.152461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.152495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.152513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.157369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.157401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.157419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.161934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.161979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.162001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.166501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.166535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.166554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.171792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.171828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.171847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.176548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.176584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.176604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.181901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.181936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.181955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.187724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.187759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.187778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.194640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.194676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.194695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.202247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.202293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.202314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.210173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.210205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.210222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.217953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.218019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.218037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.225416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.225452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.225471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.232925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.232969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.233019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.240265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.240297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.240332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.826 [2024-11-29 17:09:38.247735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:26.826 [2024-11-29 17:09:38.247771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.826 [2024-11-29 17:09:38.247790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.255193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.255235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.255254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.262712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.262747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.262766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.270273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.270322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.270343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.277871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.277907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.277926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.285475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.285511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.285531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.293093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.293125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.293143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.300716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.300757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.300777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.308166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.308197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.308215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.314573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.314608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.314627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.319454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.319488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.319506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.324396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.324430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.324451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.329084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.329122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.329139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.334498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.334533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.334553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.340677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.340712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.340731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.348334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.348371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.348391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.355749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.355785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.355804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.361876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.361912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.361932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.086 [2024-11-29 17:09:38.367861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15a1bb0) 00:27:27.086 [2024-11-29 17:09:38.367895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.086 [2024-11-29 17:09:38.367915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.086 00:27:27.086 Latency(us) 00:27:27.086 [2024-11-29T16:09:38.517Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:27.086 [2024-11-29T16:09:38.517Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:27.086 nvme0n1 : 2.00 5498.53 687.32 0.00 0.00 2905.62 752.45 10437.21 00:27:27.086 [2024-11-29T16:09:38.517Z] =================================================================================================================== 00:27:27.086 [2024-11-29T16:09:38.517Z] Total : 5498.53 687.32 0.00 0.00 2905.62 752.45 10437.21 00:27:27.086 0 00:27:27.086 17:09:38 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:27.087 17:09:38 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:27.087 17:09:38 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:27.087 | .driver_specific 00:27:27.087 | .nvme_error 00:27:27.087 | .status_code 00:27:27.087 | .command_transient_transport_error' 00:27:27.087 17:09:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:27.345 17:09:38 -- host/digest.sh@71 -- # (( 354 > 0 )) 00:27:27.345 17:09:38 -- host/digest.sh@73 -- # killprocess 320385 00:27:27.345 17:09:38 -- common/autotest_common.sh@936 -- # '[' -z 320385 ']' 00:27:27.345 17:09:38 -- common/autotest_common.sh@940 -- # kill -0 320385 00:27:27.345 17:09:38 -- common/autotest_common.sh@941 -- # uname 00:27:27.345 17:09:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:27.345 17:09:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 320385 00:27:27.345 17:09:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:27.345 17:09:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:27.345 17:09:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 320385' 00:27:27.345 killing process with pid 320385 00:27:27.345 17:09:38 -- common/autotest_common.sh@955 -- # kill 320385 00:27:27.345 Received shutdown signal, test time was about 2.000000 seconds 00:27:27.345 00:27:27.345 Latency(us) 00:27:27.345 [2024-11-29T16:09:38.776Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:27.345 [2024-11-29T16:09:38.776Z] =================================================================================================================== 00:27:27.345 [2024-11-29T16:09:38.776Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:27.345 17:09:38 -- common/autotest_common.sh@960 -- # wait 320385 00:27:27.604 17:09:38 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:27.604 17:09:38 -- host/digest.sh@54 -- # local rw bs qd 00:27:27.604 17:09:38 -- host/digest.sh@56 -- # rw=randwrite 00:27:27.604 17:09:38 -- host/digest.sh@56 -- # bs=4096 00:27:27.604 17:09:38 -- host/digest.sh@56 -- # qd=128 00:27:27.604 17:09:38 -- host/digest.sh@58 -- # bperfpid=320936 00:27:27.604 17:09:38 -- host/digest.sh@60 -- # waitforlisten 320936 /var/tmp/bperf.sock 00:27:27.604 17:09:38 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:27.604 17:09:38 -- common/autotest_common.sh@829 -- # '[' -z 320936 ']' 00:27:27.604 17:09:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:27.604 17:09:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:27.604 17:09:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:27.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:27.604 17:09:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:27.604 17:09:38 -- common/autotest_common.sh@10 -- # set +x 00:27:27.604 [2024-11-29 17:09:38.959719] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:27.604 [2024-11-29 17:09:38.959793] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid320936 ] 00:27:27.604 EAL: No free 2048 kB hugepages reported on node 1 00:27:27.604 [2024-11-29 17:09:39.018558] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:27.863 [2024-11-29 17:09:39.125343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:28.798 17:09:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:28.798 17:09:39 -- common/autotest_common.sh@862 -- # return 0 00:27:28.798 17:09:39 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:28.798 17:09:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:29.057 17:09:40 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:29.057 17:09:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.057 17:09:40 -- common/autotest_common.sh@10 -- # set +x 00:27:29.057 17:09:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.057 17:09:40 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:29.057 17:09:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:29.315 nvme0n1 00:27:29.574 17:09:40 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:29.574 17:09:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.574 17:09:40 -- common/autotest_common.sh@10 -- # set +x 00:27:29.574 17:09:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.574 17:09:40 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:29.574 17:09:40 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:29.574 Running I/O for 2 seconds... 00:27:29.574 [2024-11-29 17:09:40.890953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190f6890 00:27:29.574 [2024-11-29 17:09:40.891442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24051 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.574 [2024-11-29 17:09:40.891480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:27:29.574 [2024-11-29 17:09:40.903378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190fcdd0 00:27:29.574 [2024-11-29 17:09:40.904165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:3851 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.574 [2024-11-29 17:09:40.904198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:29.574 [2024-11-29 17:09:40.913475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190e1f80 00:27:29.574 [2024-11-29 17:09:40.913754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:9903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.574 [2024-11-29 17:09:40.913786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:27:29.574 [2024-11-29 17:09:40.927508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.574 [2024-11-29 17:09:40.927846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:2108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.574 [2024-11-29 17:09:40.927887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.574 [2024-11-29 17:09:40.940628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.574 [2024-11-29 17:09:40.940922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:12361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.574 [2024-11-29 17:09:40.940969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.574 [2024-11-29 17:09:40.953516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.574 [2024-11-29 17:09:40.953805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:8880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.574 [2024-11-29 17:09:40.953837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.574 [2024-11-29 17:09:40.966537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.574 [2024-11-29 17:09:40.966807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:4672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.574 [2024-11-29 17:09:40.966848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.574 [2024-11-29 17:09:40.979317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.574 [2024-11-29 17:09:40.979577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:10877 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.574 [2024-11-29 17:09:40.979608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.574 [2024-11-29 17:09:40.992125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.574 [2024-11-29 17:09:40.992373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:19158 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.574 [2024-11-29 17:09:40.992403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.004895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.005132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:20887 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.005164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.017661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.017889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:19471 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.017927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.030509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.030766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:18503 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.030809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.043245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.043528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:21400 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.043568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.056061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.056303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.056343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.068701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.069061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:23991 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.069093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.081463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.081721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:20686 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.081752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.094303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.094595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:10047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.094635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.107090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.107343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:17605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.107373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.119835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.120214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:6781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.120245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.132643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.132894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:12917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.132931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.145375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.145696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:9003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.145737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.158186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.158439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:20821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.158471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.170883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.171222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:12634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.171252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.183696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.184065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:18640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.184096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.196529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.196816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:24426 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.196848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.209785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.210096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:3508 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.210127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.222899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.223158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:23284 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.223189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.235932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.236196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:16034 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.236227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.248767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.249105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:2238 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.249146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:29.833 [2024-11-29 17:09:41.261912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:29.833 [2024-11-29 17:09:41.262161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25470 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:29.833 [2024-11-29 17:09:41.262198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.091 [2024-11-29 17:09:41.274825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.091 [2024-11-29 17:09:41.275169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:5028 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.091 [2024-11-29 17:09:41.275210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.091 [2024-11-29 17:09:41.287697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.091 [2024-11-29 17:09:41.288018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:7134 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.091 [2024-11-29 17:09:41.288061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.091 [2024-11-29 17:09:41.300736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.091 [2024-11-29 17:09:41.301079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:12948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.091 [2024-11-29 17:09:41.301113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.091 [2024-11-29 17:09:41.313671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.314019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:2174 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.314051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.326447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.326784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:8561 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.326823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.339237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.339582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:20393 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.339612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.352003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.352240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22796 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.352274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.364899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.365211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:2224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.365241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.377905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.378178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:21009 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.378208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.390799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.391124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:19029 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.391154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.403808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.404105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:2807 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.404136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.417137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.417403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:23616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.417433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.430020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.430257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:21742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.430287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.443029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.443251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:8039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.443279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.456280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.456569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:17363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.456605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.469497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.469743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:392 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.469796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.482673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.482984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:8478 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.483040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.495890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.496219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:3985 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.496248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.092 [2024-11-29 17:09:41.509077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.092 [2024-11-29 17:09:41.509305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:15825 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.092 [2024-11-29 17:09:41.509335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.350 [2024-11-29 17:09:41.522439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.350 [2024-11-29 17:09:41.522710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:19221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.350 [2024-11-29 17:09:41.522766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.350 [2024-11-29 17:09:41.535740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.350 [2024-11-29 17:09:41.535966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:13161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.350 [2024-11-29 17:09:41.536013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.350 [2024-11-29 17:09:41.549156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.549416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10936 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.549448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.562364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.562579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:18383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.562613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.575636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.575913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:15778 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.575953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.589052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.589259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:12358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.589289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.602350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.602599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:14830 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.602637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.615607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.615896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:14173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.615935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.628834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.629091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:24091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.629121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.641881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.642160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:20956 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.642199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.655124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.655405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:2423 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.655436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.668671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.668919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:9914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.668949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.681854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.682133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:13209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.682163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.695039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.695314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:14853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.695348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.708469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.708755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:8904 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.708793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.721820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.722099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:22230 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.722136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.735080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.735339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:9579 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.735385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.748268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.748545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:20550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.748575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.761473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.761753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.761792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.351 [2024-11-29 17:09:41.774731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.351 [2024-11-29 17:09:41.774990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:14673 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.351 [2024-11-29 17:09:41.775020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.609 [2024-11-29 17:09:41.788203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.609 [2024-11-29 17:09:41.788457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:14603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.609 [2024-11-29 17:09:41.788496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.609 [2024-11-29 17:09:41.801455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.609 [2024-11-29 17:09:41.801737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:5079 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.609 [2024-11-29 17:09:41.801776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.609 [2024-11-29 17:09:41.814769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.609 [2024-11-29 17:09:41.815028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:4729 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.609 [2024-11-29 17:09:41.815071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.609 [2024-11-29 17:09:41.827916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.609 [2024-11-29 17:09:41.828212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:17019 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.609 [2024-11-29 17:09:41.828245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.609 [2024-11-29 17:09:41.840929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.841214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:21540 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.841244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.853881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.854155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:5536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.854194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.866896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.867190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:18354 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.867230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.879782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.880094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:14162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.880124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.892718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.893008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:22161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.893044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.905734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.906051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:15928 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.906082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.919008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.919234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:22624 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.919264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.932102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.932328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:7045 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.932380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.945078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.945312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:16480 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.945341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.958364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.958682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:4071 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.958711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.971650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.971909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:17893 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.971938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.984761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.985025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:12149 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.985054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:41.997884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:41.998142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:13258 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:41.998193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:42.011079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:42.011324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:9381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:42.011354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:42.024203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:42.024493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:4824 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:42.024532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.610 [2024-11-29 17:09:42.037515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.610 [2024-11-29 17:09:42.037780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:25138 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.610 [2024-11-29 17:09:42.037815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.050886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.051141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:6972 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.051171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.064062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.064317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:24 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.064352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.077407] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.077658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:24824 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.077688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.090600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.090849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:24442 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.090888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.103864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.104085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:10065 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.104113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.116937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.117244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:15768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.117279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.130163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.130394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:3899 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.130424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.143377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.143662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:17853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.143702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.156654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.156874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:8403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.156907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.169938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.170244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:557 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.170299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.183165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.183391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:15301 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.183420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.196201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.196525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:4123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.196556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.209405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.209683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:10945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.209741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.222619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.222955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:4751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.223013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.235883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.236189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:6633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.868 [2024-11-29 17:09:42.236218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.868 [2024-11-29 17:09:42.249047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.868 [2024-11-29 17:09:42.249326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:23650 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.869 [2024-11-29 17:09:42.249360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.869 [2024-11-29 17:09:42.262215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.869 [2024-11-29 17:09:42.262504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:3138 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.869 [2024-11-29 17:09:42.262550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.869 [2024-11-29 17:09:42.275450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.869 [2024-11-29 17:09:42.275747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:12581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.869 [2024-11-29 17:09:42.275777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:30.869 [2024-11-29 17:09:42.288697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:30.869 [2024-11-29 17:09:42.288941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:17449 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.869 [2024-11-29 17:09:42.288978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.127 [2024-11-29 17:09:42.302230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.127 [2024-11-29 17:09:42.302545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:7443 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.127 [2024-11-29 17:09:42.302574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.127 [2024-11-29 17:09:42.315323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.127 [2024-11-29 17:09:42.315611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:694 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.127 [2024-11-29 17:09:42.315650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.127 [2024-11-29 17:09:42.328446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.127 [2024-11-29 17:09:42.328735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:20486 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.127 [2024-11-29 17:09:42.328764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.127 [2024-11-29 17:09:42.341363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.127 [2024-11-29 17:09:42.341656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:17977 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.127 [2024-11-29 17:09:42.341695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.127 [2024-11-29 17:09:42.354469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.127 [2024-11-29 17:09:42.354761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.127 [2024-11-29 17:09:42.354790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.127 [2024-11-29 17:09:42.367451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.367726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:18342 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.367765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.380500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.380754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:4857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.380794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.393634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.393883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:21247 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.393914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.406661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.406968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:5408 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.407000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.419664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.419986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:21197 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.420037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.432644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.432940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:6519 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.432988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.445647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.445937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:13964 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.445986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.458586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.458904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:13035 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.458967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.471485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.471813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:17432 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.471855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.484466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.484802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:5285 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.484841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.497414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.497763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:8228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.497793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.510357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.510640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:16893 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.510683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.523294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.523642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:4514 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.523673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.536204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.536489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:13663 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.536520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.128 [2024-11-29 17:09:42.548950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.128 [2024-11-29 17:09:42.549295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:10298 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.128 [2024-11-29 17:09:42.549325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.387 [2024-11-29 17:09:42.561681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.387 [2024-11-29 17:09:42.561939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:5702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.387 [2024-11-29 17:09:42.561977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.387 [2024-11-29 17:09:42.574564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.387 [2024-11-29 17:09:42.574862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:3510 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.387 [2024-11-29 17:09:42.574893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.387 [2024-11-29 17:09:42.587440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.387 [2024-11-29 17:09:42.587783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:553 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.387 [2024-11-29 17:09:42.587813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.387 [2024-11-29 17:09:42.600310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.387 [2024-11-29 17:09:42.600637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:14963 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.387 [2024-11-29 17:09:42.600678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.387 [2024-11-29 17:09:42.613112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.387 [2024-11-29 17:09:42.613383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:2150 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.387 [2024-11-29 17:09:42.613426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.387 [2024-11-29 17:09:42.626073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.387 [2024-11-29 17:09:42.626347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:3281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.387 [2024-11-29 17:09:42.626388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.387 [2024-11-29 17:09:42.639014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.639223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:3386 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.639252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.651796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.652113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.652145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.664709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.664984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:22444 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.665013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.677480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.677796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:21404 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.677837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.690297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.690609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:25212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.690639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.703216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.703543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22474 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.703576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.716363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.716621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:9239 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.716662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.729310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.729658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:18677 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.729699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.742297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.742549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:9605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.742580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.755118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.755442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24606 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.755483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.768060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.768293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:10328 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.768323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.780973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.781238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:5095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.781272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.793915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.794211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:10141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.794252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.388 [2024-11-29 17:09:42.806905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.388 [2024-11-29 17:09:42.807243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:21763 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.388 [2024-11-29 17:09:42.807274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.647 [2024-11-29 17:09:42.819769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.647 [2024-11-29 17:09:42.820043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10189 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.647 [2024-11-29 17:09:42.820073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.647 [2024-11-29 17:09:42.832776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.647 [2024-11-29 17:09:42.833077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:17836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.647 [2024-11-29 17:09:42.833108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.647 [2024-11-29 17:09:42.845675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.647 [2024-11-29 17:09:42.845936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:1467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.647 [2024-11-29 17:09:42.845973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.647 [2024-11-29 17:09:42.858615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.647 [2024-11-29 17:09:42.858878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:3082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.647 [2024-11-29 17:09:42.858916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.647 [2024-11-29 17:09:42.871577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.647 [2024-11-29 17:09:42.871838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:12422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.647 [2024-11-29 17:09:42.871868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.647 [2024-11-29 17:09:42.884502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91ad0) with pdu=0x2000190df988 00:27:31.647 [2024-11-29 17:09:42.884702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:18351 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:31.647 [2024-11-29 17:09:42.884731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:31.647 00:27:31.647 Latency(us) 00:27:31.647 [2024-11-29T16:09:43.078Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:31.647 [2024-11-29T16:09:43.078Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:31.647 nvme0n1 : 2.01 19598.56 76.56 0.00 0.00 6516.06 2718.53 13398.47 00:27:31.647 [2024-11-29T16:09:43.078Z] =================================================================================================================== 00:27:31.647 [2024-11-29T16:09:43.078Z] Total : 19598.56 76.56 0.00 0.00 6516.06 2718.53 13398.47 00:27:31.647 0 00:27:31.647 17:09:42 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:31.647 17:09:42 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:31.647 17:09:42 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:31.647 | .driver_specific 00:27:31.647 | .nvme_error 00:27:31.647 | .status_code 00:27:31.647 | .command_transient_transport_error' 00:27:31.647 17:09:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:31.905 17:09:43 -- host/digest.sh@71 -- # (( 154 > 0 )) 00:27:31.905 17:09:43 -- host/digest.sh@73 -- # killprocess 320936 00:27:31.905 17:09:43 -- common/autotest_common.sh@936 -- # '[' -z 320936 ']' 00:27:31.905 17:09:43 -- common/autotest_common.sh@940 -- # kill -0 320936 00:27:31.905 17:09:43 -- common/autotest_common.sh@941 -- # uname 00:27:31.905 17:09:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:31.905 17:09:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 320936 00:27:31.905 17:09:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:31.905 17:09:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:31.905 17:09:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 320936' 00:27:31.905 killing process with pid 320936 00:27:31.905 17:09:43 -- common/autotest_common.sh@955 -- # kill 320936 00:27:31.905 Received shutdown signal, test time was about 2.000000 seconds 00:27:31.905 00:27:31.905 Latency(us) 00:27:31.905 [2024-11-29T16:09:43.336Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:31.905 [2024-11-29T16:09:43.336Z] =================================================================================================================== 00:27:31.905 [2024-11-29T16:09:43.336Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:31.905 17:09:43 -- common/autotest_common.sh@960 -- # wait 320936 00:27:32.163 17:09:43 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:32.163 17:09:43 -- host/digest.sh@54 -- # local rw bs qd 00:27:32.163 17:09:43 -- host/digest.sh@56 -- # rw=randwrite 00:27:32.163 17:09:43 -- host/digest.sh@56 -- # bs=131072 00:27:32.163 17:09:43 -- host/digest.sh@56 -- # qd=16 00:27:32.163 17:09:43 -- host/digest.sh@58 -- # bperfpid=321491 00:27:32.163 17:09:43 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:32.163 17:09:43 -- host/digest.sh@60 -- # waitforlisten 321491 /var/tmp/bperf.sock 00:27:32.163 17:09:43 -- common/autotest_common.sh@829 -- # '[' -z 321491 ']' 00:27:32.163 17:09:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:32.163 17:09:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:32.163 17:09:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:32.163 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:32.163 17:09:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:32.163 17:09:43 -- common/autotest_common.sh@10 -- # set +x 00:27:32.163 [2024-11-29 17:09:43.506929] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:32.163 [2024-11-29 17:09:43.507052] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid321491 ] 00:27:32.163 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:32.163 Zero copy mechanism will not be used. 00:27:32.163 EAL: No free 2048 kB hugepages reported on node 1 00:27:32.163 [2024-11-29 17:09:43.569098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:32.420 [2024-11-29 17:09:43.682527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:33.353 17:09:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:33.353 17:09:44 -- common/autotest_common.sh@862 -- # return 0 00:27:33.353 17:09:44 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:33.353 17:09:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:33.353 17:09:44 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:33.353 17:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:33.353 17:09:44 -- common/autotest_common.sh@10 -- # set +x 00:27:33.353 17:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:33.353 17:09:44 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:33.353 17:09:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:33.916 nvme0n1 00:27:33.916 17:09:45 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:33.916 17:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:33.917 17:09:45 -- common/autotest_common.sh@10 -- # set +x 00:27:33.917 17:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:33.917 17:09:45 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:33.917 17:09:45 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:33.917 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:33.917 Zero copy mechanism will not be used. 00:27:33.917 Running I/O for 2 seconds... 00:27:33.917 [2024-11-29 17:09:45.321211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:33.917 [2024-11-29 17:09:45.321512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.917 [2024-11-29 17:09:45.321565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:33.917 [2024-11-29 17:09:45.326268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:33.917 [2024-11-29 17:09:45.326439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.917 [2024-11-29 17:09:45.326471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:33.917 [2024-11-29 17:09:45.330814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:33.917 [2024-11-29 17:09:45.330946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.917 [2024-11-29 17:09:45.330984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:33.917 [2024-11-29 17:09:45.335377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:33.917 [2024-11-29 17:09:45.335514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.917 [2024-11-29 17:09:45.335558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:33.917 [2024-11-29 17:09:45.340099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:33.917 [2024-11-29 17:09:45.340207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.917 [2024-11-29 17:09:45.340251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:33.917 [2024-11-29 17:09:45.344702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:33.917 [2024-11-29 17:09:45.344829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.917 [2024-11-29 17:09:45.344858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.175 [2024-11-29 17:09:45.349465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.175 [2024-11-29 17:09:45.349636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.175 [2024-11-29 17:09:45.349668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.175 [2024-11-29 17:09:45.354115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.175 [2024-11-29 17:09:45.354365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.175 [2024-11-29 17:09:45.354397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.175 [2024-11-29 17:09:45.358750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.358989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.359018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.363563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.363756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.363789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.368080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.368189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.368217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.372453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.372579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.372607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.376800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.376930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.376965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.381232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.381354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.381398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.385653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.385792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.385825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.390205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.390421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.390449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.394550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.394820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.394853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.398921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.399115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.399148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.403178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.403291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.403338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.407550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.407676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.407720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.412037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.412139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.412186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.416399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.416581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.416614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.420907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.421034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.421063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.425506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.425768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.425800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.429908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.430122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.430151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.434171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.434303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.434332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.438333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.438440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.438490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.442583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.442727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.442770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.446915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.447017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.447046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.451259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.451380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.451409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.455493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.455622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.455650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.459771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.460018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.460046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.464027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.464196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.464224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.468587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.468808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.468839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.473852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.176 [2024-11-29 17:09:45.474023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.176 [2024-11-29 17:09:45.474055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.176 [2024-11-29 17:09:45.479253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.479446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.479474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.485525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.485686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.485715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.490741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.490891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.490919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.495988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.496240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.496268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.501377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.501687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.501716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.506552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.506858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.506887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.511883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.512137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.512166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.517027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.517241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.517269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.522192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.522380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.522408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.527465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.527609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.527638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.532641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.532787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.532815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.537975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.538122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.538150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.543044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.543272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.543299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.548337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.548618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.548646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.553412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.553721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.553749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.558312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.558487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.558516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.562996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.563194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.563223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.568243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.568507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.568541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.574276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.574479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.574507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.579072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.579226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.579256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.583440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.583583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.583614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.587618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.587731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.587759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.593257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.593334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.593363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.597655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.597773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.597801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.177 [2024-11-29 17:09:45.601842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.177 [2024-11-29 17:09:45.601935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.177 [2024-11-29 17:09:45.601970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.435 [2024-11-29 17:09:45.606091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.435 [2024-11-29 17:09:45.606273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.435 [2024-11-29 17:09:45.606302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.435 [2024-11-29 17:09:45.610229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.435 [2024-11-29 17:09:45.610403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.435 [2024-11-29 17:09:45.610431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.435 [2024-11-29 17:09:45.614505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.435 [2024-11-29 17:09:45.614723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.435 [2024-11-29 17:09:45.614752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.435 [2024-11-29 17:09:45.618714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.435 [2024-11-29 17:09:45.618870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.435 [2024-11-29 17:09:45.618898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.435 [2024-11-29 17:09:45.623062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.435 [2024-11-29 17:09:45.623162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.435 [2024-11-29 17:09:45.623190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.435 [2024-11-29 17:09:45.627464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.435 [2024-11-29 17:09:45.627636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.435 [2024-11-29 17:09:45.627665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.435 [2024-11-29 17:09:45.631652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.435 [2024-11-29 17:09:45.631792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.435 [2024-11-29 17:09:45.631820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.435 [2024-11-29 17:09:45.635787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.435 [2024-11-29 17:09:45.635894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.435 [2024-11-29 17:09:45.635922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.435 [2024-11-29 17:09:45.640147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.435 [2024-11-29 17:09:45.640334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.435 [2024-11-29 17:09:45.640362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.644244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.644414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.644447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.648632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.648838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.648866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.652918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.653097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.653126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.657255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.657362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.657390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.661533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.661739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.661767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.665632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.665754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.665782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.669867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.669990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.670019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.673986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.674148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.674175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.678226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.678419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.678448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.682478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.682688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.682716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.686775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.686937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.686992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.691023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.691132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.691160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.695289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.695497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.695525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.699726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.699872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.699902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.704704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.704817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.704860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.710583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.710791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.710819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.716343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.716611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.716655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.721024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.721202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.721236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.725417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.725566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.725594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.730500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.436 [2024-11-29 17:09:45.730648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.436 [2024-11-29 17:09:45.730676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.436 [2024-11-29 17:09:45.735454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.735556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.735584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.739768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.739954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.739989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.744139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.744331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.744360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.748703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.749018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.749048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.753952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.754133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.754162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.759589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.759802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.759834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.765286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.765426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.765460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.769640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.769756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.769803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.774125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.774252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.774280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.778622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.778744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.778772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.783243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.783415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.783445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.788029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.788198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.788227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.792606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.792733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.792761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.796994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.797124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.797152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.801657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.801777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.801805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.806097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.806200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.806229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.810652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.810742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.810771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.815414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.815576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.815604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.819845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.820021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.820049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.824273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.824440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.824470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.828693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.828851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.828881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.833245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.833342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.833370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.437 [2024-11-29 17:09:45.837778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.437 [2024-11-29 17:09:45.837968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.437 [2024-11-29 17:09:45.837997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.438 [2024-11-29 17:09:45.842116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.438 [2024-11-29 17:09:45.842237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.438 [2024-11-29 17:09:45.842265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.438 [2024-11-29 17:09:45.846598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.438 [2024-11-29 17:09:45.846758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.438 [2024-11-29 17:09:45.846788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.438 [2024-11-29 17:09:45.851869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.438 [2024-11-29 17:09:45.852016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.438 [2024-11-29 17:09:45.852044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.438 [2024-11-29 17:09:45.857174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.438 [2024-11-29 17:09:45.857398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.438 [2024-11-29 17:09:45.857426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.438 [2024-11-29 17:09:45.863212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.438 [2024-11-29 17:09:45.863344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.438 [2024-11-29 17:09:45.863372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.867859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.868035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.868064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.872265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.872451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.872478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.876709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.876822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.876849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.881082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.881211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.881239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.885538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.885691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.885724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.890070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.890258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.890286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.894313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.894492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.894520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.898871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.899152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.899180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.903838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.904026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.904054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.908827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.909004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.909033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.914239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.914440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.914482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.920334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.920539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.920567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.924995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.696 [2024-11-29 17:09:45.925107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.696 [2024-11-29 17:09:45.925135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.696 [2024-11-29 17:09:45.929124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.929234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.929263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.933651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.933868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.933899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.939550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.939660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.939688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.943956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.944181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.944209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.948096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.948298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.948326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.952311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.952481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.952509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.956416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.956523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.956550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.960439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.960594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.960622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.964901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.965044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.965072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.969581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.969730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.969758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.974210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.974348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.974376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.978526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.978739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.978767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.982827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.983035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.983063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.987111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.987281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.987310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.991474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.991635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.991663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:45.995807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:45.995934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:45.995968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.000006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.000149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.000177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.004272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.004484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.004518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.008457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.008614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.008642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.013382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.013649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.013677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.019277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.019486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.019514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.023965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.024104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.024132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.028294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.028464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.028493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.032259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.032395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.032423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.037046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.037230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.037258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.042285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.042528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.042556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.047912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.048094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.697 [2024-11-29 17:09:46.048122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.697 [2024-11-29 17:09:46.053073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.697 [2024-11-29 17:09:46.053173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.053201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.057411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.057548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.057576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.061729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.061858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.061886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.066243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.066336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.066364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.070644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.070768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.070799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.075769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.075947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.076003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.080975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.081250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.081280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.086487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.086678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.086706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.091740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.091862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.091890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.097013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.097166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.097194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.102223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.102382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.102409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.107937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.108098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.108126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.113918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.114135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.114163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.698 [2024-11-29 17:09:46.120128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.698 [2024-11-29 17:09:46.120377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.698 [2024-11-29 17:09:46.120405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.956 [2024-11-29 17:09:46.126014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.956 [2024-11-29 17:09:46.126213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.956 [2024-11-29 17:09:46.126242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.956 [2024-11-29 17:09:46.130620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.956 [2024-11-29 17:09:46.130805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.956 [2024-11-29 17:09:46.130833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.956 [2024-11-29 17:09:46.134837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.956 [2024-11-29 17:09:46.134945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.956 [2024-11-29 17:09:46.134986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.956 [2024-11-29 17:09:46.138956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.956 [2024-11-29 17:09:46.139104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.956 [2024-11-29 17:09:46.139147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.956 [2024-11-29 17:09:46.143704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.956 [2024-11-29 17:09:46.143848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.956 [2024-11-29 17:09:46.143876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.956 [2024-11-29 17:09:46.148751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.956 [2024-11-29 17:09:46.148916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.956 [2024-11-29 17:09:46.148967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.956 [2024-11-29 17:09:46.154164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.956 [2024-11-29 17:09:46.154342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.956 [2024-11-29 17:09:46.154371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.956 [2024-11-29 17:09:46.160386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.956 [2024-11-29 17:09:46.160534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.956 [2024-11-29 17:09:46.160562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.956 [2024-11-29 17:09:46.165544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.165709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.165737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.170748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.170895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.170923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.175975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.176159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.176187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.181231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.181484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.181512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.186380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.186526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.186554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.191576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.191815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.191844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.196559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.196724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.196752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.201855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.202054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.202083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.207113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.207240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.207269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.212376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.212552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.212580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.217487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.217643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.217671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.222971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.223203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.223231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.228157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.228395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.228424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.233182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.233297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.233325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.238032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.238220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.238249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.243161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.243297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.243324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.248324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.248507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.248535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.253587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.253762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.253790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.258813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.258986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.259022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.263865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.264072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.264102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.269432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.269683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.269718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.274634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.274816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.274848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.280054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.280194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.280231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.285359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.285525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.285553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.290540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.290722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.290750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.295796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.295973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.296002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.957 [2024-11-29 17:09:46.300868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.957 [2024-11-29 17:09:46.301021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.957 [2024-11-29 17:09:46.301051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.306116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.306260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.306288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.311138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.311309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.311337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.316366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.316519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.316546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.321535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.321771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.321799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.326548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.326678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.326706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.331599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.331739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.331770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.336794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.336944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.336983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.341972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.342153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.342181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.347073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.347244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.347272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.352286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.352500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.352528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.357253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.357416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.357451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.362231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.362363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.362390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.367378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.367573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.367600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.372566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.372826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.372854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.377609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.377759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.377787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:34.958 [2024-11-29 17:09:46.382751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:34.958 [2024-11-29 17:09:46.382923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:34.958 [2024-11-29 17:09:46.382950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.216 [2024-11-29 17:09:46.387977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.216 [2024-11-29 17:09:46.388128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.216 [2024-11-29 17:09:46.388156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.216 [2024-11-29 17:09:46.393400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.216 [2024-11-29 17:09:46.393602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.216 [2024-11-29 17:09:46.393629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.216 [2024-11-29 17:09:46.398663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.216 [2024-11-29 17:09:46.398928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.216 [2024-11-29 17:09:46.398964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.216 [2024-11-29 17:09:46.403752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.216 [2024-11-29 17:09:46.403995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.216 [2024-11-29 17:09:46.404024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.216 [2024-11-29 17:09:46.408840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.216 [2024-11-29 17:09:46.409020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.216 [2024-11-29 17:09:46.409049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.216 [2024-11-29 17:09:46.413905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.216 [2024-11-29 17:09:46.414098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.216 [2024-11-29 17:09:46.414127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.216 [2024-11-29 17:09:46.419020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.419148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.419176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.424162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.424355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.424383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.429538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.429716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.429743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.435262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.435412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.435440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.440861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.441109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.441138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.446041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.446236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.446264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.450287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.450456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.450484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.455063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.455244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.455273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.460266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.460448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.460475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.466038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.466238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.466266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.471064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.471235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.471263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.476083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.476221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.476248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.481301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.481495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.481523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.486829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.486930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.486964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.492334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.492515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.492550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.497578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.497746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.497774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.502690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.502846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.502874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.507743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.507895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.507923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.513000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.513196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.513225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.518029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.518253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.518281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.523118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.523266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.523293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.528273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.528511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.217 [2024-11-29 17:09:46.528539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.217 [2024-11-29 17:09:46.533374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.217 [2024-11-29 17:09:46.533551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.533579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.538465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.538638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.538665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.543678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.543844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.543871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.548777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.548935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.548971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.553969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.554114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.554142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.559243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.559388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.559416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.564716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.564992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.565022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.570221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.570384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.570412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.575523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.575708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.575736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.580894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.581055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.581083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.586229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.586398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.586428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.591678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.591809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.591840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.597198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.597291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.597319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.602536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.602781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.602810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.607796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.608061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.608090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.613155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.613336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.613364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.618245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.618381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.618409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.623273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.623456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.623484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.628378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.628538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.628572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.633526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.633807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.633835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.638711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.638863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.638891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.218 [2024-11-29 17:09:46.644141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.218 [2024-11-29 17:09:46.644435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.218 [2024-11-29 17:09:46.644463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.649470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.649657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.649685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.654704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.654851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.654878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.659737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.659906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.659934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.664934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.665096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.665124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.670172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.670323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.670351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.675195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.675383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.675412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.680505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.680653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.680681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.685526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.685669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.685696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.690594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.690814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.690842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.695720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.477 [2024-11-29 17:09:46.695885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.477 [2024-11-29 17:09:46.695913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.477 [2024-11-29 17:09:46.700870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.701037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.701065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.706014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.706191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.706219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.711178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.711345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.711373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.716320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.716505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.716532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.721262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.721393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.721421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.726255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.726443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.726471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.731392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.731541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.731569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.736596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.736781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.736809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.741655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.741826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.741853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.746677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.746792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.746819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.751755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.751943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.751981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.756901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.757124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.757153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.762105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.762345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.762381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.767085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.767268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.767295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.772166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.772310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.772337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.777341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.777599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.777628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.782457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.782632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.782659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.787494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.787677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.787704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.792571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.792751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.792779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.797723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.797869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.797896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.802842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.803044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.803072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.807929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.808105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.808132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.813126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.813379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.813407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.818152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.818289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.818317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.823321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.823495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.823522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.828460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.828615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.828643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.833504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.478 [2024-11-29 17:09:46.833658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.478 [2024-11-29 17:09:46.833685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.478 [2024-11-29 17:09:46.838556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.838714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.838742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.843700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.843853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.843883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.848778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.848930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.848966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.853891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.854143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.854171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.858928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.859075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.859103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.863944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.864117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.864144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.869075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.869221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.869249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.874171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.874319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.874347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.879231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.879360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.879387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.884309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.884457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.884484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.889588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.889863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.889892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.894711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.894858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.894892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.899799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.900009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.900037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.479 [2024-11-29 17:09:46.905034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.479 [2024-11-29 17:09:46.905197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.479 [2024-11-29 17:09:46.905225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.910103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.910244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.910272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.915226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.915329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.915357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.920651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.920880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.920909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.925976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.926276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.926304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.930560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.930665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.930692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.934676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.934788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.934816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.938737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.938858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.938886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.942871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.942993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.943029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.946996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.947150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.947178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.951918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.952066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.952095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.956465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.956697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.956725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.960527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.960723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.960751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.964602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.964737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.964765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.968597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.968725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.968753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.972579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.972674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.972702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.976585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.976694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.976721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.980930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.981088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.981117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.985585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.985713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.985742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.989702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.740 [2024-11-29 17:09:46.989919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.740 [2024-11-29 17:09:46.989948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.740 [2024-11-29 17:09:46.993703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:46.993919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:46.993948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:46.997772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:46.997917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:46.997945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.001762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.001877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.001905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.005783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.005970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.005998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.010281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.010485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.010524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.015404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.015543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.015571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.021896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.022033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.022061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.026775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.026874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.026902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.031089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.031264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.031293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.035401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.035617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.035646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.039505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.039658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.039686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.043808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.043948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.043983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.048824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.048902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.048929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.053376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.053456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.053486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.058097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.058168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.058197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.062924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.063024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.063053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.067838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.068058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.068086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.073115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.073313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.073341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.077578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.077706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.077734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.081980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.082133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.082162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.087369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.087460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.087487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.091904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.091980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.092007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.096384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.096487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.096517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.100511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.100643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.100672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.105180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.105372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.105400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.109610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.109825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.109852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.114123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.741 [2024-11-29 17:09:47.114261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.741 [2024-11-29 17:09:47.114290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.741 [2024-11-29 17:09:47.118567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.118659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.118687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.123129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.123231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.123260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.127537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.127658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.127685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.131953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.132116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.132151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.136330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.136462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.136491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.140831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.141028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.141057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.145213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.145356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.145384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.149572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.149686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.149714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.153861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.153978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.154006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.158309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.158404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.158432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.163023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.163099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.163127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:35.742 [2024-11-29 17:09:47.168019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:35.742 [2024-11-29 17:09:47.168175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.742 [2024-11-29 17:09:47.168203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.172564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.172697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.172725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.177377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.177593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.177621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.181776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.181998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.182027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.186384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.186533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.186562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.190817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.190927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.190955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.195221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.195324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.195351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.199693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.199762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.199790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.204194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.204326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.204353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.208602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.208737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.208766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.213139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.213354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.213382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.217589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.217768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.217796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.222070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.222213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.222241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.226699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.226800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.226827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.231233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.231317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.231344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.235848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.235949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.236002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.240867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.241052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.241098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.245737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.245883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.245915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:36.002 [2024-11-29 17:09:47.250806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.002 [2024-11-29 17:09:47.251042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.002 [2024-11-29 17:09:47.251105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.255534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.255692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.255720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.260473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.260611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.260638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.265316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.265437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.265465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.270081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.270194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.270222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.274829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.274955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.275009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.279783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.279937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.279974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.284663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.284818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.284850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.289839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.290119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.290147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.295232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.295463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.295495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.299745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.299938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.299979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.304181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.304299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.304327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.308564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.308682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.308713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.312909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.313052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.313080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:36.003 [2024-11-29 17:09:47.317337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe91fb0) with pdu=0x2000190fef90 00:27:36.003 [2024-11-29 17:09:47.317488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.003 [2024-11-29 17:09:47.317516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:36.003 00:27:36.003 Latency(us) 00:27:36.003 [2024-11-29T16:09:47.434Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:36.003 [2024-11-29T16:09:47.434Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:36.003 nvme0n1 : 2.00 6401.62 800.20 0.00 0.00 2492.76 1784.04 6553.60 00:27:36.003 [2024-11-29T16:09:47.434Z] =================================================================================================================== 00:27:36.003 [2024-11-29T16:09:47.434Z] Total : 6401.62 800.20 0.00 0.00 2492.76 1784.04 6553.60 00:27:36.003 0 00:27:36.003 17:09:47 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:36.003 17:09:47 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:36.003 17:09:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:36.003 17:09:47 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:36.003 | .driver_specific 00:27:36.003 | .nvme_error 00:27:36.003 | .status_code 00:27:36.003 | .command_transient_transport_error' 00:27:36.261 17:09:47 -- host/digest.sh@71 -- # (( 413 > 0 )) 00:27:36.261 17:09:47 -- host/digest.sh@73 -- # killprocess 321491 00:27:36.261 17:09:47 -- common/autotest_common.sh@936 -- # '[' -z 321491 ']' 00:27:36.261 17:09:47 -- common/autotest_common.sh@940 -- # kill -0 321491 00:27:36.261 17:09:47 -- common/autotest_common.sh@941 -- # uname 00:27:36.261 17:09:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:36.261 17:09:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 321491 00:27:36.261 17:09:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:36.261 17:09:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:36.261 17:09:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 321491' 00:27:36.261 killing process with pid 321491 00:27:36.261 17:09:47 -- common/autotest_common.sh@955 -- # kill 321491 00:27:36.261 Received shutdown signal, test time was about 2.000000 seconds 00:27:36.261 00:27:36.261 Latency(us) 00:27:36.261 [2024-11-29T16:09:47.692Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:36.261 [2024-11-29T16:09:47.692Z] =================================================================================================================== 00:27:36.261 [2024-11-29T16:09:47.692Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:36.261 17:09:47 -- common/autotest_common.sh@960 -- # wait 321491 00:27:36.828 17:09:47 -- host/digest.sh@115 -- # killprocess 319803 00:27:36.828 17:09:47 -- common/autotest_common.sh@936 -- # '[' -z 319803 ']' 00:27:36.828 17:09:47 -- common/autotest_common.sh@940 -- # kill -0 319803 00:27:36.828 17:09:47 -- common/autotest_common.sh@941 -- # uname 00:27:36.828 17:09:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:36.828 17:09:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 319803 00:27:36.828 17:09:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:36.828 17:09:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:36.828 17:09:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 319803' 00:27:36.828 killing process with pid 319803 00:27:36.828 17:09:47 -- common/autotest_common.sh@955 -- # kill 319803 00:27:36.828 17:09:47 -- common/autotest_common.sh@960 -- # wait 319803 00:27:37.086 00:27:37.086 real 0m18.663s 00:27:37.086 user 0m37.491s 00:27:37.086 sys 0m4.784s 00:27:37.086 17:09:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:37.086 17:09:48 -- common/autotest_common.sh@10 -- # set +x 00:27:37.086 ************************************ 00:27:37.086 END TEST nvmf_digest_error 00:27:37.086 ************************************ 00:27:37.086 17:09:48 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:37.086 17:09:48 -- host/digest.sh@139 -- # nvmftestfini 00:27:37.086 17:09:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:37.086 17:09:48 -- nvmf/common.sh@116 -- # sync 00:27:37.086 17:09:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:37.086 17:09:48 -- nvmf/common.sh@119 -- # set +e 00:27:37.086 17:09:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:37.086 17:09:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:37.086 rmmod nvme_tcp 00:27:37.086 rmmod nvme_fabrics 00:27:37.086 rmmod nvme_keyring 00:27:37.086 17:09:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:37.086 17:09:48 -- nvmf/common.sh@123 -- # set -e 00:27:37.086 17:09:48 -- nvmf/common.sh@124 -- # return 0 00:27:37.086 17:09:48 -- nvmf/common.sh@477 -- # '[' -n 319803 ']' 00:27:37.086 17:09:48 -- nvmf/common.sh@478 -- # killprocess 319803 00:27:37.086 17:09:48 -- common/autotest_common.sh@936 -- # '[' -z 319803 ']' 00:27:37.086 17:09:48 -- common/autotest_common.sh@940 -- # kill -0 319803 00:27:37.087 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (319803) - No such process 00:27:37.087 17:09:48 -- common/autotest_common.sh@963 -- # echo 'Process with pid 319803 is not found' 00:27:37.087 Process with pid 319803 is not found 00:27:37.087 17:09:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:37.087 17:09:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:37.087 17:09:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:37.087 17:09:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:37.087 17:09:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:37.087 17:09:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:37.087 17:09:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:37.087 17:09:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:38.988 17:09:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:38.988 00:27:38.988 real 0m38.898s 00:27:38.988 user 1m8.772s 00:27:38.988 sys 0m10.814s 00:27:38.988 17:09:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:38.988 17:09:50 -- common/autotest_common.sh@10 -- # set +x 00:27:38.988 ************************************ 00:27:38.988 END TEST nvmf_digest 00:27:38.988 ************************************ 00:27:38.988 17:09:50 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:38.988 17:09:50 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:38.988 17:09:50 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:38.988 17:09:50 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:38.988 17:09:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:38.988 17:09:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:38.988 17:09:50 -- common/autotest_common.sh@10 -- # set +x 00:27:38.988 ************************************ 00:27:38.988 START TEST nvmf_bdevperf 00:27:38.988 ************************************ 00:27:38.988 17:09:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:39.246 * Looking for test storage... 00:27:39.246 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:39.246 17:09:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:39.246 17:09:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:39.246 17:09:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:39.246 17:09:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:39.246 17:09:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:39.246 17:09:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:39.246 17:09:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:39.246 17:09:50 -- scripts/common.sh@335 -- # IFS=.-: 00:27:39.246 17:09:50 -- scripts/common.sh@335 -- # read -ra ver1 00:27:39.246 17:09:50 -- scripts/common.sh@336 -- # IFS=.-: 00:27:39.246 17:09:50 -- scripts/common.sh@336 -- # read -ra ver2 00:27:39.246 17:09:50 -- scripts/common.sh@337 -- # local 'op=<' 00:27:39.246 17:09:50 -- scripts/common.sh@339 -- # ver1_l=2 00:27:39.246 17:09:50 -- scripts/common.sh@340 -- # ver2_l=1 00:27:39.246 17:09:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:39.246 17:09:50 -- scripts/common.sh@343 -- # case "$op" in 00:27:39.246 17:09:50 -- scripts/common.sh@344 -- # : 1 00:27:39.246 17:09:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:39.246 17:09:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:39.246 17:09:50 -- scripts/common.sh@364 -- # decimal 1 00:27:39.246 17:09:50 -- scripts/common.sh@352 -- # local d=1 00:27:39.246 17:09:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:39.246 17:09:50 -- scripts/common.sh@354 -- # echo 1 00:27:39.246 17:09:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:39.246 17:09:50 -- scripts/common.sh@365 -- # decimal 2 00:27:39.246 17:09:50 -- scripts/common.sh@352 -- # local d=2 00:27:39.247 17:09:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:39.247 17:09:50 -- scripts/common.sh@354 -- # echo 2 00:27:39.247 17:09:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:39.247 17:09:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:39.247 17:09:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:39.247 17:09:50 -- scripts/common.sh@367 -- # return 0 00:27:39.247 17:09:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:39.247 17:09:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:39.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.247 --rc genhtml_branch_coverage=1 00:27:39.247 --rc genhtml_function_coverage=1 00:27:39.247 --rc genhtml_legend=1 00:27:39.247 --rc geninfo_all_blocks=1 00:27:39.247 --rc geninfo_unexecuted_blocks=1 00:27:39.247 00:27:39.247 ' 00:27:39.247 17:09:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:39.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.247 --rc genhtml_branch_coverage=1 00:27:39.247 --rc genhtml_function_coverage=1 00:27:39.247 --rc genhtml_legend=1 00:27:39.247 --rc geninfo_all_blocks=1 00:27:39.247 --rc geninfo_unexecuted_blocks=1 00:27:39.247 00:27:39.247 ' 00:27:39.247 17:09:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:39.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.247 --rc genhtml_branch_coverage=1 00:27:39.247 --rc genhtml_function_coverage=1 00:27:39.247 --rc genhtml_legend=1 00:27:39.247 --rc geninfo_all_blocks=1 00:27:39.247 --rc geninfo_unexecuted_blocks=1 00:27:39.247 00:27:39.247 ' 00:27:39.247 17:09:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:39.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.247 --rc genhtml_branch_coverage=1 00:27:39.247 --rc genhtml_function_coverage=1 00:27:39.247 --rc genhtml_legend=1 00:27:39.247 --rc geninfo_all_blocks=1 00:27:39.247 --rc geninfo_unexecuted_blocks=1 00:27:39.247 00:27:39.247 ' 00:27:39.247 17:09:50 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:39.247 17:09:50 -- nvmf/common.sh@7 -- # uname -s 00:27:39.247 17:09:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:39.247 17:09:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:39.247 17:09:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:39.247 17:09:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:39.247 17:09:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:39.247 17:09:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:39.247 17:09:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:39.247 17:09:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:39.247 17:09:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:39.247 17:09:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:39.247 17:09:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:39.247 17:09:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:39.247 17:09:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:39.247 17:09:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:39.247 17:09:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:39.247 17:09:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:39.247 17:09:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:39.247 17:09:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:39.247 17:09:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:39.247 17:09:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.247 17:09:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.247 17:09:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.247 17:09:50 -- paths/export.sh@5 -- # export PATH 00:27:39.247 17:09:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.247 17:09:50 -- nvmf/common.sh@46 -- # : 0 00:27:39.247 17:09:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:39.247 17:09:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:39.247 17:09:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:39.247 17:09:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:39.247 17:09:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:39.247 17:09:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:39.247 17:09:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:39.247 17:09:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:39.247 17:09:50 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:39.247 17:09:50 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:39.247 17:09:50 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:39.247 17:09:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:39.247 17:09:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:39.247 17:09:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:39.247 17:09:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:39.247 17:09:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:39.247 17:09:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:39.247 17:09:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:39.247 17:09:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:39.247 17:09:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:39.247 17:09:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:39.247 17:09:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:39.247 17:09:50 -- common/autotest_common.sh@10 -- # set +x 00:27:41.150 17:09:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:41.151 17:09:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:41.151 17:09:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:41.151 17:09:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:41.151 17:09:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:41.151 17:09:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:41.151 17:09:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:41.151 17:09:52 -- nvmf/common.sh@294 -- # net_devs=() 00:27:41.151 17:09:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:41.151 17:09:52 -- nvmf/common.sh@295 -- # e810=() 00:27:41.151 17:09:52 -- nvmf/common.sh@295 -- # local -ga e810 00:27:41.151 17:09:52 -- nvmf/common.sh@296 -- # x722=() 00:27:41.151 17:09:52 -- nvmf/common.sh@296 -- # local -ga x722 00:27:41.151 17:09:52 -- nvmf/common.sh@297 -- # mlx=() 00:27:41.151 17:09:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:41.151 17:09:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:41.151 17:09:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:41.151 17:09:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:41.151 17:09:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:41.151 17:09:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:41.151 17:09:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:41.151 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:41.151 17:09:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:41.151 17:09:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:41.151 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:41.151 17:09:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:41.151 17:09:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:41.151 17:09:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:41.151 17:09:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:41.151 17:09:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:41.151 17:09:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:41.151 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:41.151 17:09:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:41.151 17:09:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:41.151 17:09:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:41.151 17:09:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:41.151 17:09:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:41.151 17:09:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:41.151 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:41.151 17:09:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:41.151 17:09:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:41.151 17:09:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:41.151 17:09:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:41.151 17:09:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:41.151 17:09:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:41.151 17:09:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:41.151 17:09:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:41.151 17:09:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:41.151 17:09:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:41.151 17:09:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:41.151 17:09:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:41.151 17:09:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:41.151 17:09:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:41.151 17:09:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:41.151 17:09:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:41.151 17:09:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:41.151 17:09:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:41.151 17:09:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:41.151 17:09:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:41.151 17:09:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:41.151 17:09:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:41.409 17:09:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:41.409 17:09:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:41.409 17:09:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:41.409 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:41.409 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:27:41.409 00:27:41.409 --- 10.0.0.2 ping statistics --- 00:27:41.409 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:41.409 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:27:41.409 17:09:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:41.409 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:41.409 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:27:41.409 00:27:41.409 --- 10.0.0.1 ping statistics --- 00:27:41.409 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:41.409 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:27:41.409 17:09:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:41.409 17:09:52 -- nvmf/common.sh@410 -- # return 0 00:27:41.409 17:09:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:41.409 17:09:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:41.409 17:09:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:41.409 17:09:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:41.409 17:09:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:41.409 17:09:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:41.409 17:09:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:41.409 17:09:52 -- host/bdevperf.sh@25 -- # tgt_init 00:27:41.409 17:09:52 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:41.409 17:09:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:41.409 17:09:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:41.409 17:09:52 -- common/autotest_common.sh@10 -- # set +x 00:27:41.409 17:09:52 -- nvmf/common.sh@469 -- # nvmfpid=324008 00:27:41.409 17:09:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:41.409 17:09:52 -- nvmf/common.sh@470 -- # waitforlisten 324008 00:27:41.409 17:09:52 -- common/autotest_common.sh@829 -- # '[' -z 324008 ']' 00:27:41.409 17:09:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:41.409 17:09:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:41.409 17:09:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:41.409 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:41.409 17:09:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:41.409 17:09:52 -- common/autotest_common.sh@10 -- # set +x 00:27:41.409 [2024-11-29 17:09:52.673597] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:41.409 [2024-11-29 17:09:52.673663] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:41.409 EAL: No free 2048 kB hugepages reported on node 1 00:27:41.409 [2024-11-29 17:09:52.738090] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:41.667 [2024-11-29 17:09:52.854700] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:41.667 [2024-11-29 17:09:52.854850] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:41.667 [2024-11-29 17:09:52.854869] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:41.667 [2024-11-29 17:09:52.854884] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:41.667 [2024-11-29 17:09:52.854991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:41.667 [2024-11-29 17:09:52.855079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:41.667 [2024-11-29 17:09:52.855084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:42.600 17:09:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:42.600 17:09:53 -- common/autotest_common.sh@862 -- # return 0 00:27:42.600 17:09:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:42.600 17:09:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:42.600 17:09:53 -- common/autotest_common.sh@10 -- # set +x 00:27:42.601 17:09:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:42.601 17:09:53 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:42.601 17:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.601 17:09:53 -- common/autotest_common.sh@10 -- # set +x 00:27:42.601 [2024-11-29 17:09:53.706185] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:42.601 17:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.601 17:09:53 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:42.601 17:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.601 17:09:53 -- common/autotest_common.sh@10 -- # set +x 00:27:42.601 Malloc0 00:27:42.601 17:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.601 17:09:53 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:42.601 17:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.601 17:09:53 -- common/autotest_common.sh@10 -- # set +x 00:27:42.601 17:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.601 17:09:53 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:42.601 17:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.601 17:09:53 -- common/autotest_common.sh@10 -- # set +x 00:27:42.601 17:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.601 17:09:53 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:42.601 17:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.601 17:09:53 -- common/autotest_common.sh@10 -- # set +x 00:27:42.601 [2024-11-29 17:09:53.774018] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:42.601 17:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.601 17:09:53 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:42.601 17:09:53 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:42.601 17:09:53 -- nvmf/common.sh@520 -- # config=() 00:27:42.601 17:09:53 -- nvmf/common.sh@520 -- # local subsystem config 00:27:42.601 17:09:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:42.601 17:09:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:42.601 { 00:27:42.601 "params": { 00:27:42.601 "name": "Nvme$subsystem", 00:27:42.601 "trtype": "$TEST_TRANSPORT", 00:27:42.601 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:42.601 "adrfam": "ipv4", 00:27:42.601 "trsvcid": "$NVMF_PORT", 00:27:42.601 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:42.601 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:42.601 "hdgst": ${hdgst:-false}, 00:27:42.601 "ddgst": ${ddgst:-false} 00:27:42.601 }, 00:27:42.601 "method": "bdev_nvme_attach_controller" 00:27:42.601 } 00:27:42.601 EOF 00:27:42.601 )") 00:27:42.601 17:09:53 -- nvmf/common.sh@542 -- # cat 00:27:42.601 17:09:53 -- nvmf/common.sh@544 -- # jq . 00:27:42.601 17:09:53 -- nvmf/common.sh@545 -- # IFS=, 00:27:42.601 17:09:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:42.601 "params": { 00:27:42.601 "name": "Nvme1", 00:27:42.601 "trtype": "tcp", 00:27:42.601 "traddr": "10.0.0.2", 00:27:42.601 "adrfam": "ipv4", 00:27:42.601 "trsvcid": "4420", 00:27:42.601 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:42.601 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:42.601 "hdgst": false, 00:27:42.601 "ddgst": false 00:27:42.601 }, 00:27:42.601 "method": "bdev_nvme_attach_controller" 00:27:42.601 }' 00:27:42.601 [2024-11-29 17:09:53.816767] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:42.601 [2024-11-29 17:09:53.816846] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid324168 ] 00:27:42.601 EAL: No free 2048 kB hugepages reported on node 1 00:27:42.601 [2024-11-29 17:09:53.877119] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:42.601 [2024-11-29 17:09:53.984427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:42.859 Running I/O for 1 seconds... 00:27:44.232 00:27:44.232 Latency(us) 00:27:44.232 [2024-11-29T16:09:55.663Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:44.232 [2024-11-29T16:09:55.663Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:44.232 Verification LBA range: start 0x0 length 0x4000 00:27:44.232 Nvme1n1 : 1.01 12892.09 50.36 0.00 0.00 9882.79 1298.58 16408.27 00:27:44.232 [2024-11-29T16:09:55.663Z] =================================================================================================================== 00:27:44.232 [2024-11-29T16:09:55.663Z] Total : 12892.09 50.36 0.00 0.00 9882.79 1298.58 16408.27 00:27:44.232 17:09:55 -- host/bdevperf.sh@30 -- # bdevperfpid=324436 00:27:44.232 17:09:55 -- host/bdevperf.sh@32 -- # sleep 3 00:27:44.232 17:09:55 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:44.232 17:09:55 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:44.232 17:09:55 -- nvmf/common.sh@520 -- # config=() 00:27:44.232 17:09:55 -- nvmf/common.sh@520 -- # local subsystem config 00:27:44.232 17:09:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:44.232 17:09:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:44.232 { 00:27:44.232 "params": { 00:27:44.232 "name": "Nvme$subsystem", 00:27:44.232 "trtype": "$TEST_TRANSPORT", 00:27:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:44.232 "adrfam": "ipv4", 00:27:44.232 "trsvcid": "$NVMF_PORT", 00:27:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:44.232 "hdgst": ${hdgst:-false}, 00:27:44.232 "ddgst": ${ddgst:-false} 00:27:44.232 }, 00:27:44.232 "method": "bdev_nvme_attach_controller" 00:27:44.232 } 00:27:44.232 EOF 00:27:44.232 )") 00:27:44.232 17:09:55 -- nvmf/common.sh@542 -- # cat 00:27:44.232 17:09:55 -- nvmf/common.sh@544 -- # jq . 00:27:44.232 17:09:55 -- nvmf/common.sh@545 -- # IFS=, 00:27:44.232 17:09:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:44.232 "params": { 00:27:44.232 "name": "Nvme1", 00:27:44.232 "trtype": "tcp", 00:27:44.232 "traddr": "10.0.0.2", 00:27:44.232 "adrfam": "ipv4", 00:27:44.232 "trsvcid": "4420", 00:27:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:44.232 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:44.232 "hdgst": false, 00:27:44.232 "ddgst": false 00:27:44.232 }, 00:27:44.232 "method": "bdev_nvme_attach_controller" 00:27:44.232 }' 00:27:44.232 [2024-11-29 17:09:55.590235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:44.232 [2024-11-29 17:09:55.590344] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid324436 ] 00:27:44.232 EAL: No free 2048 kB hugepages reported on node 1 00:27:44.232 [2024-11-29 17:09:55.649714] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:44.490 [2024-11-29 17:09:55.762528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:44.749 Running I/O for 15 seconds... 00:27:47.282 17:09:58 -- host/bdevperf.sh@33 -- # kill -9 324008 00:27:47.282 17:09:58 -- host/bdevperf.sh@35 -- # sleep 3 00:27:47.282 [2024-11-29 17:09:58.564431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:1608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:1616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:1656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:1664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.282 [2024-11-29 17:09:58.564899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.282 [2024-11-29 17:09:58.564917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:1000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.564932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.564949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:1056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.564972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:1072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:1080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:1088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:1104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:1120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:1152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:1168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:1176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:1688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:1696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:1704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:1712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:1744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.283 [2024-11-29 17:09:58.565412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:1752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.283 [2024-11-29 17:09:58.565443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:1760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.283 [2024-11-29 17:09:58.565475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:1768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:1184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:1192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:1208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:1216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:1232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:1256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:1776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.283 [2024-11-29 17:09:58.565802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:1784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:1792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.283 [2024-11-29 17:09:58.565866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:1800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.565929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:1816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.283 [2024-11-29 17:09:58.565968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.565987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:1824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.566020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.566036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.566050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.566065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:1840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.566086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.566101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:1848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.566115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.566133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.566147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.566163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:1864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.566177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.566192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:1872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.283 [2024-11-29 17:09:58.566205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.283 [2024-11-29 17:09:58.566220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:1880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.283 [2024-11-29 17:09:58.566234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:1888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.566281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:1896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:1904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.566344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:1920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:1928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:1944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:1328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:1360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:1400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:1424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:1456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:1464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:1472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:1952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:1960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.566829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:1968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.566860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:1976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:1984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.566922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.566943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:1992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.566964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:2000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.567020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:2008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.567049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:2016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.567084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:2024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:2032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:2040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.567171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:2048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:2056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.567229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:2064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:2072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.567338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:2088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.284 [2024-11-29 17:09:58.567369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:1480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:1488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:1520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:1536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:1552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.284 [2024-11-29 17:09:58.567540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.284 [2024-11-29 17:09:58.567557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:1560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.567572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:1568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.567603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:1584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.567634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:2096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.567666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:2104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.567697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:2112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.567729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:2120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.567760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:2128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.567796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.567828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:2144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.567858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:2152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.567889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:2160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.567920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:2168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.567951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.567973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:2176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.567989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:2184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.568037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:2192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:2200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:2208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:2216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:2224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.568182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:2232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.568214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:2240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:2248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:2256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.568330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:2264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:2272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.568392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:2280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.568424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:2288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:47.285 [2024-11-29 17:09:58.568455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:2296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:1600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:1624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:1640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:1672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:1680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:1720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:47.285 [2024-11-29 17:09:58.568710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19b5740 is same with the state(5) to be set 00:27:47.285 [2024-11-29 17:09:58.568746] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:47.285 [2024-11-29 17:09:58.568758] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:47.285 [2024-11-29 17:09:58.568770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1736 len:8 PRP1 0x0 PRP2 0x0 00:27:47.285 [2024-11-29 17:09:58.568784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568860] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x19b5740 was disconnected and freed. reset controller. 00:27:47.285 [2024-11-29 17:09:58.568940] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:47.285 [2024-11-29 17:09:58.568972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.285 [2024-11-29 17:09:58.568991] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:47.285 [2024-11-29 17:09:58.569024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.286 [2024-11-29 17:09:58.569038] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:47.286 [2024-11-29 17:09:58.569050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.286 [2024-11-29 17:09:58.569064] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:47.286 [2024-11-29 17:09:58.569076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.286 [2024-11-29 17:09:58.569088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.571533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.286 [2024-11-29 17:09:58.571585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.572131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.572250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.572278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.286 [2024-11-29 17:09:58.572297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.572524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.572696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.286 [2024-11-29 17:09:58.572719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.286 [2024-11-29 17:09:58.572740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.286 [2024-11-29 17:09:58.575392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.286 [2024-11-29 17:09:58.584530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.286 [2024-11-29 17:09:58.584894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.585071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.585098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.286 [2024-11-29 17:09:58.585114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.585338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.585490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.286 [2024-11-29 17:09:58.585514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.286 [2024-11-29 17:09:58.585529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.286 [2024-11-29 17:09:58.587901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.286 [2024-11-29 17:09:58.597198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.286 [2024-11-29 17:09:58.597603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.597761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.597806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.286 [2024-11-29 17:09:58.597824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.597955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.598190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.286 [2024-11-29 17:09:58.598214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.286 [2024-11-29 17:09:58.598230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.286 [2024-11-29 17:09:58.600536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.286 [2024-11-29 17:09:58.609742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.286 [2024-11-29 17:09:58.610022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.610167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.610195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.286 [2024-11-29 17:09:58.610213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.610361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.610556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.286 [2024-11-29 17:09:58.610580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.286 [2024-11-29 17:09:58.610595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.286 [2024-11-29 17:09:58.613058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.286 [2024-11-29 17:09:58.622357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.286 [2024-11-29 17:09:58.622653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.622757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.622786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.286 [2024-11-29 17:09:58.622804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.623037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.623208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.286 [2024-11-29 17:09:58.623231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.286 [2024-11-29 17:09:58.623247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.286 [2024-11-29 17:09:58.625573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.286 [2024-11-29 17:09:58.634877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.286 [2024-11-29 17:09:58.635243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.635356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.635386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.286 [2024-11-29 17:09:58.635404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.635587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.635775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.286 [2024-11-29 17:09:58.635799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.286 [2024-11-29 17:09:58.635814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.286 [2024-11-29 17:09:58.637924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.286 [2024-11-29 17:09:58.647496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.286 [2024-11-29 17:09:58.647852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.647989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.648019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.286 [2024-11-29 17:09:58.648036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.648202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.648355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.286 [2024-11-29 17:09:58.648383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.286 [2024-11-29 17:09:58.648400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.286 [2024-11-29 17:09:58.650618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.286 [2024-11-29 17:09:58.660108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.286 [2024-11-29 17:09:58.660442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.660547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.660575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.286 [2024-11-29 17:09:58.660592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.660811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.661010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.286 [2024-11-29 17:09:58.661035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.286 [2024-11-29 17:09:58.661050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.286 [2024-11-29 17:09:58.663486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.286 [2024-11-29 17:09:58.672673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.286 [2024-11-29 17:09:58.673004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.673160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-29 17:09:58.673189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.286 [2024-11-29 17:09:58.673206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.286 [2024-11-29 17:09:58.673354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.286 [2024-11-29 17:09:58.673560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.287 [2024-11-29 17:09:58.673583] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.287 [2024-11-29 17:09:58.673598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.287 [2024-11-29 17:09:58.675972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.287 [2024-11-29 17:09:58.685224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.287 [2024-11-29 17:09:58.685537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-29 17:09:58.685668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-29 17:09:58.685697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.287 [2024-11-29 17:09:58.685714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.287 [2024-11-29 17:09:58.685880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.287 [2024-11-29 17:09:58.686026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.287 [2024-11-29 17:09:58.686051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.287 [2024-11-29 17:09:58.686072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.287 [2024-11-29 17:09:58.688308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.287 [2024-11-29 17:09:58.697735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.287 [2024-11-29 17:09:58.698041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-29 17:09:58.698162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-29 17:09:58.698188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.287 [2024-11-29 17:09:58.698204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.287 [2024-11-29 17:09:58.698393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.287 [2024-11-29 17:09:58.698564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.287 [2024-11-29 17:09:58.698588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.287 [2024-11-29 17:09:58.698603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.287 [2024-11-29 17:09:58.700742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.287 [2024-11-29 17:09:58.710237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.546 [2024-11-29 17:09:58.710602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 17:09:58.710721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 17:09:58.710747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.546 [2024-11-29 17:09:58.710764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.546 [2024-11-29 17:09:58.710913] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.546 [2024-11-29 17:09:58.711107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.546 [2024-11-29 17:09:58.711129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.546 [2024-11-29 17:09:58.711143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.546 [2024-11-29 17:09:58.713221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.546 [2024-11-29 17:09:58.722854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.546 [2024-11-29 17:09:58.723174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 17:09:58.723265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 17:09:58.723294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.546 [2024-11-29 17:09:58.723311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.546 [2024-11-29 17:09:58.723477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.546 [2024-11-29 17:09:58.723682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.546 [2024-11-29 17:09:58.723707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.546 [2024-11-29 17:09:58.723723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.546 [2024-11-29 17:09:58.726251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.546 [2024-11-29 17:09:58.735324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.735590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.735724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.735753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.547 [2024-11-29 17:09:58.735770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.547 [2024-11-29 17:09:58.735954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.547 [2024-11-29 17:09:58.736149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.547 [2024-11-29 17:09:58.736173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.547 [2024-11-29 17:09:58.736189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.547 [2024-11-29 17:09:58.738532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.547 [2024-11-29 17:09:58.748116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.748411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.748536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.748565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.547 [2024-11-29 17:09:58.748582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.547 [2024-11-29 17:09:58.748802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.547 [2024-11-29 17:09:58.749021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.547 [2024-11-29 17:09:58.749046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.547 [2024-11-29 17:09:58.749061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.547 [2024-11-29 17:09:58.751529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.547 [2024-11-29 17:09:58.760889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.761174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.761338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.761364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.547 [2024-11-29 17:09:58.761380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.547 [2024-11-29 17:09:58.761560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.547 [2024-11-29 17:09:58.761730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.547 [2024-11-29 17:09:58.761749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.547 [2024-11-29 17:09:58.761761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.547 [2024-11-29 17:09:58.763902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.547 [2024-11-29 17:09:58.773756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.774123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.774241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.774267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.547 [2024-11-29 17:09:58.774283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.547 [2024-11-29 17:09:58.774448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.547 [2024-11-29 17:09:58.774593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.547 [2024-11-29 17:09:58.774612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.547 [2024-11-29 17:09:58.774624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.547 [2024-11-29 17:09:58.776809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.547 [2024-11-29 17:09:58.786356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.786706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.786845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.786888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.547 [2024-11-29 17:09:58.786905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.547 [2024-11-29 17:09:58.787063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.547 [2024-11-29 17:09:58.787187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.547 [2024-11-29 17:09:58.787208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.547 [2024-11-29 17:09:58.787221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.547 [2024-11-29 17:09:58.789688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.547 [2024-11-29 17:09:58.799051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.799287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.799406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.799432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.547 [2024-11-29 17:09:58.799448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.547 [2024-11-29 17:09:58.799628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.547 [2024-11-29 17:09:58.799809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.547 [2024-11-29 17:09:58.799829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.547 [2024-11-29 17:09:58.799844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.547 [2024-11-29 17:09:58.802076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.547 [2024-11-29 17:09:58.811824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.812308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.812473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.812501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.547 [2024-11-29 17:09:58.812518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.547 [2024-11-29 17:09:58.812683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.547 [2024-11-29 17:09:58.812799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.547 [2024-11-29 17:09:58.812822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.547 [2024-11-29 17:09:58.812837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.547 [2024-11-29 17:09:58.815215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.547 [2024-11-29 17:09:58.824291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.824597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.824756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.824782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.547 [2024-11-29 17:09:58.824798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.547 [2024-11-29 17:09:58.824898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.547 [2024-11-29 17:09:58.825070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.547 [2024-11-29 17:09:58.825091] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.547 [2024-11-29 17:09:58.825105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.547 [2024-11-29 17:09:58.827369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.547 [2024-11-29 17:09:58.836902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.837211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.837338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.837362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.547 [2024-11-29 17:09:58.837393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.547 [2024-11-29 17:09:58.837581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.547 [2024-11-29 17:09:58.837734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.547 [2024-11-29 17:09:58.837753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.547 [2024-11-29 17:09:58.837765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.547 [2024-11-29 17:09:58.839882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.547 [2024-11-29 17:09:58.849355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.547 [2024-11-29 17:09:58.849623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.849722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 17:09:58.849757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.849775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.849989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.850179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.850201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.548 [2024-11-29 17:09:58.850217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.548 [2024-11-29 17:09:58.852686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.548 [2024-11-29 17:09:58.861985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.548 [2024-11-29 17:09:58.862284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.862431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.862481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.862516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.862665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.862852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.862875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.548 [2024-11-29 17:09:58.862891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.548 [2024-11-29 17:09:58.865172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.548 [2024-11-29 17:09:58.874602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.548 [2024-11-29 17:09:58.874882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.875017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.875048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.875066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.875214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.875348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.875372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.548 [2024-11-29 17:09:58.875387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.548 [2024-11-29 17:09:58.877728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.548 [2024-11-29 17:09:58.887135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.548 [2024-11-29 17:09:58.887450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.887553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.887583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.887607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.887755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.887925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.887948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.548 [2024-11-29 17:09:58.887975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.548 [2024-11-29 17:09:58.890357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.548 [2024-11-29 17:09:58.899726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.548 [2024-11-29 17:09:58.900021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.900186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.900215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.900233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.900399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.900551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.900574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.548 [2024-11-29 17:09:58.900590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.548 [2024-11-29 17:09:58.902915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.548 [2024-11-29 17:09:58.912406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.548 [2024-11-29 17:09:58.912719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.912894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.912920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.912936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.913062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.913226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.913246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.548 [2024-11-29 17:09:58.913273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.548 [2024-11-29 17:09:58.915401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.548 [2024-11-29 17:09:58.925045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.548 [2024-11-29 17:09:58.925327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.925452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.925480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.925497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.925707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.925860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.925883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.548 [2024-11-29 17:09:58.925898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.548 [2024-11-29 17:09:58.928324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.548 [2024-11-29 17:09:58.937385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.548 [2024-11-29 17:09:58.937681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.937836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.937864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.937882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.938059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.938212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.938236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.548 [2024-11-29 17:09:58.938251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.548 [2024-11-29 17:09:58.940737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.548 [2024-11-29 17:09:58.949940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.548 [2024-11-29 17:09:58.950235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.950386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.950411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.950427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.950575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.950731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.950750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.548 [2024-11-29 17:09:58.950763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.548 [2024-11-29 17:09:58.952989] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.548 [2024-11-29 17:09:58.962700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.548 [2024-11-29 17:09:58.963012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.963156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 17:09:58.963182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.548 [2024-11-29 17:09:58.963197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.548 [2024-11-29 17:09:58.963374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.548 [2024-11-29 17:09:58.963505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.548 [2024-11-29 17:09:58.963523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.549 [2024-11-29 17:09:58.963536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.549 [2024-11-29 17:09:58.965824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.549 [2024-11-29 17:09:58.975304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.549 [2024-11-29 17:09:58.975530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 17:09:58.975651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 17:09:58.975679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.549 [2024-11-29 17:09:58.975697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.549 [2024-11-29 17:09:58.975881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.808 [2024-11-29 17:09:58.976082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.808 [2024-11-29 17:09:58.976107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.808 [2024-11-29 17:09:58.976123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.808 [2024-11-29 17:09:58.978556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.808 [2024-11-29 17:09:58.987808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.808 [2024-11-29 17:09:58.988069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:58.988198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:58.988238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.808 [2024-11-29 17:09:58.988254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.808 [2024-11-29 17:09:58.988414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.808 [2024-11-29 17:09:58.988554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.808 [2024-11-29 17:09:58.988573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.808 [2024-11-29 17:09:58.988586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.808 [2024-11-29 17:09:58.990798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.808 [2024-11-29 17:09:59.000547] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.808 [2024-11-29 17:09:59.000880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:59.001115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:59.001142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.808 [2024-11-29 17:09:59.001157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.808 [2024-11-29 17:09:59.001290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.808 [2024-11-29 17:09:59.001463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.808 [2024-11-29 17:09:59.001486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.808 [2024-11-29 17:09:59.001499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.808 [2024-11-29 17:09:59.003719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.808 [2024-11-29 17:09:59.013059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.808 [2024-11-29 17:09:59.013278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:59.013421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:59.013447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.808 [2024-11-29 17:09:59.013463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.808 [2024-11-29 17:09:59.013624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.808 [2024-11-29 17:09:59.013808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.808 [2024-11-29 17:09:59.013828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.808 [2024-11-29 17:09:59.013840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.808 [2024-11-29 17:09:59.016083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.808 [2024-11-29 17:09:59.025477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.808 [2024-11-29 17:09:59.025796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:59.025947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:59.025986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.808 [2024-11-29 17:09:59.026004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.808 [2024-11-29 17:09:59.026170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.808 [2024-11-29 17:09:59.026339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.808 [2024-11-29 17:09:59.026363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.808 [2024-11-29 17:09:59.026379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.808 [2024-11-29 17:09:59.028686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.808 [2024-11-29 17:09:59.038251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.808 [2024-11-29 17:09:59.038581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:59.038725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.808 [2024-11-29 17:09:59.038751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.808 [2024-11-29 17:09:59.038767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.808 [2024-11-29 17:09:59.038929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.808 [2024-11-29 17:09:59.039117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.808 [2024-11-29 17:09:59.039140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.808 [2024-11-29 17:09:59.039158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.808 [2024-11-29 17:09:59.041290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.050989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.809 [2024-11-29 17:09:59.051336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.051465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.051491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.809 [2024-11-29 17:09:59.051507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.809 [2024-11-29 17:09:59.051700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.809 [2024-11-29 17:09:59.051854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.809 [2024-11-29 17:09:59.051872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.809 [2024-11-29 17:09:59.051885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.809 [2024-11-29 17:09:59.054234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.063484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.809 [2024-11-29 17:09:59.063770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.063896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.063921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.809 [2024-11-29 17:09:59.063937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.809 [2024-11-29 17:09:59.064065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.809 [2024-11-29 17:09:59.064214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.809 [2024-11-29 17:09:59.064234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.809 [2024-11-29 17:09:59.064247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.809 [2024-11-29 17:09:59.066478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.076055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.809 [2024-11-29 17:09:59.076379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.076510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.076551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.809 [2024-11-29 17:09:59.076566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.809 [2024-11-29 17:09:59.076727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.809 [2024-11-29 17:09:59.076885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.809 [2024-11-29 17:09:59.076904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.809 [2024-11-29 17:09:59.076916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.809 [2024-11-29 17:09:59.079204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.088607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.809 [2024-11-29 17:09:59.088921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.089052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.089078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.809 [2024-11-29 17:09:59.089094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.809 [2024-11-29 17:09:59.089226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.809 [2024-11-29 17:09:59.089400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.809 [2024-11-29 17:09:59.089418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.809 [2024-11-29 17:09:59.089430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.809 [2024-11-29 17:09:59.091614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.101224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.809 [2024-11-29 17:09:59.101520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.101651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.101679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.809 [2024-11-29 17:09:59.101697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.809 [2024-11-29 17:09:59.101880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.809 [2024-11-29 17:09:59.102008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.809 [2024-11-29 17:09:59.102032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.809 [2024-11-29 17:09:59.102047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.809 [2024-11-29 17:09:59.104389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.113769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.809 [2024-11-29 17:09:59.114126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.114278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.114306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.809 [2024-11-29 17:09:59.114323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.809 [2024-11-29 17:09:59.114543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.809 [2024-11-29 17:09:59.114713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.809 [2024-11-29 17:09:59.114736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.809 [2024-11-29 17:09:59.114752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.809 [2024-11-29 17:09:59.117070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.126398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.809 [2024-11-29 17:09:59.126679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.126806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.126836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.809 [2024-11-29 17:09:59.126853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.809 [2024-11-29 17:09:59.127033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.809 [2024-11-29 17:09:59.127223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.809 [2024-11-29 17:09:59.127246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.809 [2024-11-29 17:09:59.127261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.809 [2024-11-29 17:09:59.129587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.138825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.809 [2024-11-29 17:09:59.139190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.139319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.139344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.809 [2024-11-29 17:09:59.139360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.809 [2024-11-29 17:09:59.139520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.809 [2024-11-29 17:09:59.139691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.809 [2024-11-29 17:09:59.139710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.809 [2024-11-29 17:09:59.139722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.809 [2024-11-29 17:09:59.142141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.151305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.809 [2024-11-29 17:09:59.151651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.151803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.809 [2024-11-29 17:09:59.151829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.809 [2024-11-29 17:09:59.151845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.809 [2024-11-29 17:09:59.152067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.809 [2024-11-29 17:09:59.152209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.809 [2024-11-29 17:09:59.152228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.809 [2024-11-29 17:09:59.152241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.809 [2024-11-29 17:09:59.154578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.809 [2024-11-29 17:09:59.163696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.810 [2024-11-29 17:09:59.164021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.164152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.164181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.810 [2024-11-29 17:09:59.164198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.810 [2024-11-29 17:09:59.164401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.810 [2024-11-29 17:09:59.164571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.810 [2024-11-29 17:09:59.164595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.810 [2024-11-29 17:09:59.164610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.810 [2024-11-29 17:09:59.166795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.810 [2024-11-29 17:09:59.176295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.810 [2024-11-29 17:09:59.176616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.176741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.176766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.810 [2024-11-29 17:09:59.176782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.810 [2024-11-29 17:09:59.176966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.810 [2024-11-29 17:09:59.177137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.810 [2024-11-29 17:09:59.177156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.810 [2024-11-29 17:09:59.177169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.810 [2024-11-29 17:09:59.179472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.810 [2024-11-29 17:09:59.189122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.810 [2024-11-29 17:09:59.189448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.189597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.189623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.810 [2024-11-29 17:09:59.189639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.810 [2024-11-29 17:09:59.189755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.810 [2024-11-29 17:09:59.189943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.810 [2024-11-29 17:09:59.189985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.810 [2024-11-29 17:09:59.190000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.810 [2024-11-29 17:09:59.192264] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.810 [2024-11-29 17:09:59.201573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.810 [2024-11-29 17:09:59.201862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.201992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.202022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.810 [2024-11-29 17:09:59.202040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.810 [2024-11-29 17:09:59.202188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.810 [2024-11-29 17:09:59.202359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.810 [2024-11-29 17:09:59.202382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.810 [2024-11-29 17:09:59.202397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.810 [2024-11-29 17:09:59.204649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.810 [2024-11-29 17:09:59.213886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.810 [2024-11-29 17:09:59.214174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.214307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.214335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.810 [2024-11-29 17:09:59.214354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.810 [2024-11-29 17:09:59.214537] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.810 [2024-11-29 17:09:59.214708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.810 [2024-11-29 17:09:59.214731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.810 [2024-11-29 17:09:59.214747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.810 [2024-11-29 17:09:59.217160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.810 [2024-11-29 17:09:59.226617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:47.810 [2024-11-29 17:09:59.226886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.227016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.810 [2024-11-29 17:09:59.227046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:47.810 [2024-11-29 17:09:59.227064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:47.810 [2024-11-29 17:09:59.227248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:47.810 [2024-11-29 17:09:59.227364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:47.810 [2024-11-29 17:09:59.227387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:47.810 [2024-11-29 17:09:59.227402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:47.810 [2024-11-29 17:09:59.229969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.070 [2024-11-29 17:09:59.239213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.070 [2024-11-29 17:09:59.239563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.239686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.239711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.070 [2024-11-29 17:09:59.239732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.070 [2024-11-29 17:09:59.239913] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.070 [2024-11-29 17:09:59.240097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.070 [2024-11-29 17:09:59.240118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.070 [2024-11-29 17:09:59.240131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.070 [2024-11-29 17:09:59.242556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.070 [2024-11-29 17:09:59.251941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.070 [2024-11-29 17:09:59.252264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.252434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.252459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.070 [2024-11-29 17:09:59.252475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.070 [2024-11-29 17:09:59.252634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.070 [2024-11-29 17:09:59.252773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.070 [2024-11-29 17:09:59.252792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.070 [2024-11-29 17:09:59.252804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.070 [2024-11-29 17:09:59.255202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.070 [2024-11-29 17:09:59.264469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.070 [2024-11-29 17:09:59.264800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.264994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.265061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.070 [2024-11-29 17:09:59.265079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.070 [2024-11-29 17:09:59.265299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.070 [2024-11-29 17:09:59.265487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.070 [2024-11-29 17:09:59.265511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.070 [2024-11-29 17:09:59.265526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.070 [2024-11-29 17:09:59.267966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.070 [2024-11-29 17:09:59.277249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.070 [2024-11-29 17:09:59.277603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.277730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.277759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.070 [2024-11-29 17:09:59.277777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.070 [2024-11-29 17:09:59.277977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.070 [2024-11-29 17:09:59.278130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.070 [2024-11-29 17:09:59.278153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.070 [2024-11-29 17:09:59.278168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.070 [2024-11-29 17:09:59.280636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.070 [2024-11-29 17:09:59.289955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.070 [2024-11-29 17:09:59.290264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.290432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.290457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.070 [2024-11-29 17:09:59.290472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.070 [2024-11-29 17:09:59.290619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.070 [2024-11-29 17:09:59.290779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.070 [2024-11-29 17:09:59.290797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.070 [2024-11-29 17:09:59.290811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.070 [2024-11-29 17:09:59.293277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.070 [2024-11-29 17:09:59.302507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.070 [2024-11-29 17:09:59.302885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.302979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.303009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.070 [2024-11-29 17:09:59.303026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.070 [2024-11-29 17:09:59.303245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.070 [2024-11-29 17:09:59.303361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.070 [2024-11-29 17:09:59.303384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.070 [2024-11-29 17:09:59.303400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.070 [2024-11-29 17:09:59.305850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.070 [2024-11-29 17:09:59.315174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.070 [2024-11-29 17:09:59.315478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.315666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.315691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.070 [2024-11-29 17:09:59.315707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.070 [2024-11-29 17:09:59.315899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.070 [2024-11-29 17:09:59.316054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.070 [2024-11-29 17:09:59.316075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.070 [2024-11-29 17:09:59.316089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.070 [2024-11-29 17:09:59.318413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.070 [2024-11-29 17:09:59.327876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.070 [2024-11-29 17:09:59.328172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.328318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.328343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.070 [2024-11-29 17:09:59.328359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.070 [2024-11-29 17:09:59.328538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.070 [2024-11-29 17:09:59.328710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.070 [2024-11-29 17:09:59.328729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.070 [2024-11-29 17:09:59.328741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.070 [2024-11-29 17:09:59.331058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.070 [2024-11-29 17:09:59.340375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.070 [2024-11-29 17:09:59.340694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.340848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.070 [2024-11-29 17:09:59.340873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.070 [2024-11-29 17:09:59.340889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.070 [2024-11-29 17:09:59.341013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.341165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.341186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.341199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.343520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.071 [2024-11-29 17:09:59.352968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.071 [2024-11-29 17:09:59.353312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.353464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.353492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.071 [2024-11-29 17:09:59.353510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.071 [2024-11-29 17:09:59.353693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.353828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.353857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.353873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.356244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.071 [2024-11-29 17:09:59.365630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.071 [2024-11-29 17:09:59.365929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.366064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.366094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.071 [2024-11-29 17:09:59.366112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.071 [2024-11-29 17:09:59.366296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.366502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.366526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.366541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.368885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.071 [2024-11-29 17:09:59.378335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.071 [2024-11-29 17:09:59.378675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.378803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.378829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.071 [2024-11-29 17:09:59.378845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.071 [2024-11-29 17:09:59.379052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.379213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.379233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.379261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.381585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.071 [2024-11-29 17:09:59.390954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.071 [2024-11-29 17:09:59.391279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.391410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.391440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.071 [2024-11-29 17:09:59.391457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.071 [2024-11-29 17:09:59.391659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.391793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.391816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.391838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.394282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.071 [2024-11-29 17:09:59.403408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.071 [2024-11-29 17:09:59.403755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.403886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.403914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.071 [2024-11-29 17:09:59.403931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.071 [2024-11-29 17:09:59.404143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.404350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.404374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.404389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.406517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.071 [2024-11-29 17:09:59.415860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.071 [2024-11-29 17:09:59.416176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.416318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.416343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.071 [2024-11-29 17:09:59.416359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.071 [2024-11-29 17:09:59.416520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.416720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.416738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.416750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.419280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.071 [2024-11-29 17:09:59.428326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.071 [2024-11-29 17:09:59.428640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.428781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.428807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.071 [2024-11-29 17:09:59.428822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.071 [2024-11-29 17:09:59.429014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.429161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.429181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.429194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.431472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.071 [2024-11-29 17:09:59.440755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.071 [2024-11-29 17:09:59.441101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.441256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.441284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.071 [2024-11-29 17:09:59.441302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.071 [2024-11-29 17:09:59.441450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.441601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.441625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.441640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.443986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.071 [2024-11-29 17:09:59.453457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.071 [2024-11-29 17:09:59.453778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.453867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.071 [2024-11-29 17:09:59.453895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.071 [2024-11-29 17:09:59.453913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.071 [2024-11-29 17:09:59.454105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.071 [2024-11-29 17:09:59.454294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.071 [2024-11-29 17:09:59.454318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.071 [2024-11-29 17:09:59.454334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.071 [2024-11-29 17:09:59.456515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.072 [2024-11-29 17:09:59.466063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.072 [2024-11-29 17:09:59.466443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.072 [2024-11-29 17:09:59.466711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.072 [2024-11-29 17:09:59.466761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.072 [2024-11-29 17:09:59.466779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.072 [2024-11-29 17:09:59.466971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.072 [2024-11-29 17:09:59.467124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.072 [2024-11-29 17:09:59.467147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.072 [2024-11-29 17:09:59.467162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.072 [2024-11-29 17:09:59.469448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.072 [2024-11-29 17:09:59.478358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.072 [2024-11-29 17:09:59.478657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.072 [2024-11-29 17:09:59.478786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.072 [2024-11-29 17:09:59.478811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.072 [2024-11-29 17:09:59.478826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.072 [2024-11-29 17:09:59.479072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.072 [2024-11-29 17:09:59.479216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.072 [2024-11-29 17:09:59.479236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.072 [2024-11-29 17:09:59.479249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.072 [2024-11-29 17:09:59.481398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.072 [2024-11-29 17:09:59.491078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.072 [2024-11-29 17:09:59.491466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.072 [2024-11-29 17:09:59.491552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.072 [2024-11-29 17:09:59.491577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.072 [2024-11-29 17:09:59.491592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.072 [2024-11-29 17:09:59.491704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.072 [2024-11-29 17:09:59.491875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.072 [2024-11-29 17:09:59.491894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.072 [2024-11-29 17:09:59.491906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.072 [2024-11-29 17:09:59.494088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.332 [2024-11-29 17:09:59.503774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.332 [2024-11-29 17:09:59.504075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.504196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.504221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.332 [2024-11-29 17:09:59.504237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.332 [2024-11-29 17:09:59.504414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.332 [2024-11-29 17:09:59.504582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.332 [2024-11-29 17:09:59.504601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.332 [2024-11-29 17:09:59.504613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.332 [2024-11-29 17:09:59.507063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.332 [2024-11-29 17:09:59.516404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.332 [2024-11-29 17:09:59.516684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.516835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.516863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.332 [2024-11-29 17:09:59.516881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.332 [2024-11-29 17:09:59.517093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.332 [2024-11-29 17:09:59.517264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.332 [2024-11-29 17:09:59.517287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.332 [2024-11-29 17:09:59.517302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.332 [2024-11-29 17:09:59.519679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.332 [2024-11-29 17:09:59.528834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.332 [2024-11-29 17:09:59.529121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.529254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.529283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.332 [2024-11-29 17:09:59.529301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.332 [2024-11-29 17:09:59.529484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.332 [2024-11-29 17:09:59.529636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.332 [2024-11-29 17:09:59.529660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.332 [2024-11-29 17:09:59.529675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.332 [2024-11-29 17:09:59.531873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.332 [2024-11-29 17:09:59.541320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.332 [2024-11-29 17:09:59.541673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.541767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.541797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.332 [2024-11-29 17:09:59.541815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.332 [2024-11-29 17:09:59.541972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.332 [2024-11-29 17:09:59.542125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.332 [2024-11-29 17:09:59.542149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.332 [2024-11-29 17:09:59.542164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.332 [2024-11-29 17:09:59.544490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.332 [2024-11-29 17:09:59.553873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.332 [2024-11-29 17:09:59.554155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.554278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.554305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.332 [2024-11-29 17:09:59.554321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.332 [2024-11-29 17:09:59.554511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.332 [2024-11-29 17:09:59.554677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.332 [2024-11-29 17:09:59.554696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.332 [2024-11-29 17:09:59.554707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.332 [2024-11-29 17:09:59.557141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.332 [2024-11-29 17:09:59.566410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.332 [2024-11-29 17:09:59.566696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.566853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.566883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.332 [2024-11-29 17:09:59.566901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.332 [2024-11-29 17:09:59.567077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.332 [2024-11-29 17:09:59.567248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.332 [2024-11-29 17:09:59.567272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.332 [2024-11-29 17:09:59.567287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.332 [2024-11-29 17:09:59.569591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.332 [2024-11-29 17:09:59.579121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.332 [2024-11-29 17:09:59.579449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.579567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.579595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.332 [2024-11-29 17:09:59.579613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.332 [2024-11-29 17:09:59.579760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.332 [2024-11-29 17:09:59.579930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.332 [2024-11-29 17:09:59.579953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.332 [2024-11-29 17:09:59.579979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.332 [2024-11-29 17:09:59.582394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.332 [2024-11-29 17:09:59.591812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.332 [2024-11-29 17:09:59.592167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.592283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.592309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.332 [2024-11-29 17:09:59.592329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.332 [2024-11-29 17:09:59.592493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.332 [2024-11-29 17:09:59.592649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.332 [2024-11-29 17:09:59.592668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.332 [2024-11-29 17:09:59.592680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.332 [2024-11-29 17:09:59.594996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.332 [2024-11-29 17:09:59.604420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.332 [2024-11-29 17:09:59.604729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.604858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-29 17:09:59.604887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.332 [2024-11-29 17:09:59.604904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.605051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.605186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.605209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.605225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.333 [2024-11-29 17:09:59.607444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.333 [2024-11-29 17:09:59.617130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.333 [2024-11-29 17:09:59.617444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.617574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.617603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.333 [2024-11-29 17:09:59.617620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.617804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.617987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.618011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.618027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.333 [2024-11-29 17:09:59.620297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.333 [2024-11-29 17:09:59.629740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.333 [2024-11-29 17:09:59.630081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.630182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.630224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.333 [2024-11-29 17:09:59.630239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.630440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.630579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.630598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.630611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.333 [2024-11-29 17:09:59.632798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.333 [2024-11-29 17:09:59.642456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.333 [2024-11-29 17:09:59.642748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.642919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.642945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.333 [2024-11-29 17:09:59.642974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.643109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.643261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.643282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.643310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.333 [2024-11-29 17:09:59.645639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.333 [2024-11-29 17:09:59.655045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.333 [2024-11-29 17:09:59.655365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.655516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.655545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.333 [2024-11-29 17:09:59.655562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.655727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.655861] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.655884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.655899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.333 [2024-11-29 17:09:59.658418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.333 [2024-11-29 17:09:59.667577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.333 [2024-11-29 17:09:59.667843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.667977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.668007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.333 [2024-11-29 17:09:59.668024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.668171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.668383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.668407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.668422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.333 [2024-11-29 17:09:59.670638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.333 [2024-11-29 17:09:59.680186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.333 [2024-11-29 17:09:59.680475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.680624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.680653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.333 [2024-11-29 17:09:59.680671] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.680819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.681000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.681024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.681040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.333 [2024-11-29 17:09:59.683274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.333 [2024-11-29 17:09:59.692854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.333 [2024-11-29 17:09:59.693210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.693391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.693416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.333 [2024-11-29 17:09:59.693432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.693651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.693788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.693807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.693819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.333 [2024-11-29 17:09:59.696013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.333 [2024-11-29 17:09:59.705566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.333 [2024-11-29 17:09:59.705930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.706082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.706109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.333 [2024-11-29 17:09:59.706126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.706335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.706519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.706538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.706551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.333 [2024-11-29 17:09:59.708857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.333 [2024-11-29 17:09:59.718080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.333 [2024-11-29 17:09:59.718384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.718509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-29 17:09:59.718538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.333 [2024-11-29 17:09:59.718555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.333 [2024-11-29 17:09:59.718702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.333 [2024-11-29 17:09:59.718926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.333 [2024-11-29 17:09:59.718949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.333 [2024-11-29 17:09:59.718978] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.334 [2024-11-29 17:09:59.721321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.334 [2024-11-29 17:09:59.730638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.334 [2024-11-29 17:09:59.731022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-29 17:09:59.731141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-29 17:09:59.731167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.334 [2024-11-29 17:09:59.731183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.334 [2024-11-29 17:09:59.731348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.334 [2024-11-29 17:09:59.731503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.334 [2024-11-29 17:09:59.731522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.334 [2024-11-29 17:09:59.731534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.334 [2024-11-29 17:09:59.733679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.334 [2024-11-29 17:09:59.743191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.334 [2024-11-29 17:09:59.743502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-29 17:09:59.743651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-29 17:09:59.743677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.334 [2024-11-29 17:09:59.743693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.334 [2024-11-29 17:09:59.743855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.334 [2024-11-29 17:09:59.744039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.334 [2024-11-29 17:09:59.744059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.334 [2024-11-29 17:09:59.744077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.334 [2024-11-29 17:09:59.746566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.334 [2024-11-29 17:09:59.755670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.334 [2024-11-29 17:09:59.756020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-29 17:09:59.756136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-29 17:09:59.756164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.334 [2024-11-29 17:09:59.756182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.334 [2024-11-29 17:09:59.756329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.334 [2024-11-29 17:09:59.756518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.334 [2024-11-29 17:09:59.756541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.334 [2024-11-29 17:09:59.756556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.334 [2024-11-29 17:09:59.758935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.594 [2024-11-29 17:09:59.768581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.594 [2024-11-29 17:09:59.768945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.769073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.769099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.594 [2024-11-29 17:09:59.769114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.594 [2024-11-29 17:09:59.769294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.594 [2024-11-29 17:09:59.769436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.594 [2024-11-29 17:09:59.769454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.594 [2024-11-29 17:09:59.769467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.594 [2024-11-29 17:09:59.771683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.594 [2024-11-29 17:09:59.780941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.594 [2024-11-29 17:09:59.781239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.781366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.781396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.594 [2024-11-29 17:09:59.781414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.594 [2024-11-29 17:09:59.781598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.594 [2024-11-29 17:09:59.781714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.594 [2024-11-29 17:09:59.781736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.594 [2024-11-29 17:09:59.781757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.594 [2024-11-29 17:09:59.784110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.594 [2024-11-29 17:09:59.793395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.594 [2024-11-29 17:09:59.793778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.794051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.794080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.594 [2024-11-29 17:09:59.794098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.594 [2024-11-29 17:09:59.794263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.594 [2024-11-29 17:09:59.794415] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.594 [2024-11-29 17:09:59.794439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.594 [2024-11-29 17:09:59.794454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.594 [2024-11-29 17:09:59.796758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.594 [2024-11-29 17:09:59.806177] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.594 [2024-11-29 17:09:59.806526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.806681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.806709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.594 [2024-11-29 17:09:59.806727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.594 [2024-11-29 17:09:59.806819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.594 [2024-11-29 17:09:59.807001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.594 [2024-11-29 17:09:59.807025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.594 [2024-11-29 17:09:59.807041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.594 [2024-11-29 17:09:59.809130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.594 [2024-11-29 17:09:59.818833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.594 [2024-11-29 17:09:59.819048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.819168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.819194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.594 [2024-11-29 17:09:59.819209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.594 [2024-11-29 17:09:59.819325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.594 [2024-11-29 17:09:59.819518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.594 [2024-11-29 17:09:59.819537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.594 [2024-11-29 17:09:59.819550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.594 [2024-11-29 17:09:59.821783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.594 [2024-11-29 17:09:59.831615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.594 [2024-11-29 17:09:59.831923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.832086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.832115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.594 [2024-11-29 17:09:59.832133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.594 [2024-11-29 17:09:59.832279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.594 [2024-11-29 17:09:59.832449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.594 [2024-11-29 17:09:59.832473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.594 [2024-11-29 17:09:59.832489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.594 [2024-11-29 17:09:59.834756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.594 [2024-11-29 17:09:59.843969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.594 [2024-11-29 17:09:59.844322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.844424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.844452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.594 [2024-11-29 17:09:59.844470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.594 [2024-11-29 17:09:59.844617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.594 [2024-11-29 17:09:59.844805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.594 [2024-11-29 17:09:59.844829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.594 [2024-11-29 17:09:59.844844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.594 [2024-11-29 17:09:59.847234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.594 [2024-11-29 17:09:59.856534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.594 [2024-11-29 17:09:59.856891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.857017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-29 17:09:59.857062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.594 [2024-11-29 17:09:59.857078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.594 [2024-11-29 17:09:59.857299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.594 [2024-11-29 17:09:59.857449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.594 [2024-11-29 17:09:59.857468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.594 [2024-11-29 17:09:59.857480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.594 [2024-11-29 17:09:59.859854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.869286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.869642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.869801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.869830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.595 [2024-11-29 17:09:59.869848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.595 [2024-11-29 17:09:59.870078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.595 [2024-11-29 17:09:59.870249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.595 [2024-11-29 17:09:59.870273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.595 [2024-11-29 17:09:59.870288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.595 [2024-11-29 17:09:59.872646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.881749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.882078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.882195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.882220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.595 [2024-11-29 17:09:59.882236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.595 [2024-11-29 17:09:59.882429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.595 [2024-11-29 17:09:59.882582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.595 [2024-11-29 17:09:59.882601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.595 [2024-11-29 17:09:59.882614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.595 [2024-11-29 17:09:59.884946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.894540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.894843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.895012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.895042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.595 [2024-11-29 17:09:59.895059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.595 [2024-11-29 17:09:59.895188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.595 [2024-11-29 17:09:59.895359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.595 [2024-11-29 17:09:59.895383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.595 [2024-11-29 17:09:59.895399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.595 [2024-11-29 17:09:59.897686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.907430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.907774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.907882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.907911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.595 [2024-11-29 17:09:59.907929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.595 [2024-11-29 17:09:59.908123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.595 [2024-11-29 17:09:59.908294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.595 [2024-11-29 17:09:59.908318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.595 [2024-11-29 17:09:59.908333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.595 [2024-11-29 17:09:59.910827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.920022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.920302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.920402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.920445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.595 [2024-11-29 17:09:59.920460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.595 [2024-11-29 17:09:59.920623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.595 [2024-11-29 17:09:59.920768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.595 [2024-11-29 17:09:59.920801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.595 [2024-11-29 17:09:59.920814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.595 [2024-11-29 17:09:59.923228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.932507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.932817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.932991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.933018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.595 [2024-11-29 17:09:59.933033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.595 [2024-11-29 17:09:59.933164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.595 [2024-11-29 17:09:59.933306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.595 [2024-11-29 17:09:59.933325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.595 [2024-11-29 17:09:59.933336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.595 [2024-11-29 17:09:59.935643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.945181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.945525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.945643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.945668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.595 [2024-11-29 17:09:59.945689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.595 [2024-11-29 17:09:59.945867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.595 [2024-11-29 17:09:59.946044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.595 [2024-11-29 17:09:59.946065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.595 [2024-11-29 17:09:59.946077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.595 [2024-11-29 17:09:59.948394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.957845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.958227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.958362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.958388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.595 [2024-11-29 17:09:59.958403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.595 [2024-11-29 17:09:59.958567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.595 [2024-11-29 17:09:59.958738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.595 [2024-11-29 17:09:59.958758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.595 [2024-11-29 17:09:59.958776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.595 [2024-11-29 17:09:59.961032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.970258] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.970531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.970649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.970677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.595 [2024-11-29 17:09:59.970694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.595 [2024-11-29 17:09:59.970860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.595 [2024-11-29 17:09:59.971059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.595 [2024-11-29 17:09:59.971084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.595 [2024-11-29 17:09:59.971099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.595 [2024-11-29 17:09:59.973698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.595 [2024-11-29 17:09:59.982798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.595 [2024-11-29 17:09:59.983153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-29 17:09:59.983294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-29 17:09:59.983319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.596 [2024-11-29 17:09:59.983334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.596 [2024-11-29 17:09:59.983531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.596 [2024-11-29 17:09:59.983685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.596 [2024-11-29 17:09:59.983704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.596 [2024-11-29 17:09:59.983717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.596 [2024-11-29 17:09:59.986072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.596 [2024-11-29 17:09:59.995371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.596 [2024-11-29 17:09:59.995650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-29 17:09:59.995793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-29 17:09:59.995819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.596 [2024-11-29 17:09:59.995835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.596 [2024-11-29 17:09:59.996009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.596 [2024-11-29 17:09:59.996187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.596 [2024-11-29 17:09:59.996207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.596 [2024-11-29 17:09:59.996220] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.596 [2024-11-29 17:09:59.998383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.596 [2024-11-29 17:10:00.007835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.596 [2024-11-29 17:10:00.008173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-29 17:10:00.008307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-29 17:10:00.008334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.596 [2024-11-29 17:10:00.008351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.596 [2024-11-29 17:10:00.008516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.596 [2024-11-29 17:10:00.008671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.596 [2024-11-29 17:10:00.008692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.596 [2024-11-29 17:10:00.008707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.596 [2024-11-29 17:10:00.011079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.596 [2024-11-29 17:10:00.020346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.596 [2024-11-29 17:10:00.020637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-29 17:10:00.020740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-29 17:10:00.020766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.596 [2024-11-29 17:10:00.020783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.596 [2024-11-29 17:10:00.020940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.596 [2024-11-29 17:10:00.021132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.596 [2024-11-29 17:10:00.021154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.596 [2024-11-29 17:10:00.021169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.855 [2024-11-29 17:10:00.023500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.855 [2024-11-29 17:10:00.033049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.855 [2024-11-29 17:10:00.033424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.855 [2024-11-29 17:10:00.033552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.855 [2024-11-29 17:10:00.033579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.855 [2024-11-29 17:10:00.033596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.033746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.033921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.856 [2024-11-29 17:10:00.033941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.856 [2024-11-29 17:10:00.033954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.856 [2024-11-29 17:10:00.036180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.856 [2024-11-29 17:10:00.045578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.856 [2024-11-29 17:10:00.045922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.046100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.046126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.856 [2024-11-29 17:10:00.046142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.046346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.046489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.856 [2024-11-29 17:10:00.046508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.856 [2024-11-29 17:10:00.046521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.856 [2024-11-29 17:10:00.048928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.856 [2024-11-29 17:10:00.058016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.856 [2024-11-29 17:10:00.058455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.058614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.058639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.856 [2024-11-29 17:10:00.058655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.058822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.059046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.856 [2024-11-29 17:10:00.059067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.856 [2024-11-29 17:10:00.059080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.856 [2024-11-29 17:10:00.061226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.856 [2024-11-29 17:10:00.070533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.856 [2024-11-29 17:10:00.070829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.070940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.070994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.856 [2024-11-29 17:10:00.071011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.071143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.071297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.856 [2024-11-29 17:10:00.071331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.856 [2024-11-29 17:10:00.071344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.856 [2024-11-29 17:10:00.073216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.856 [2024-11-29 17:10:00.083336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.856 [2024-11-29 17:10:00.083617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.083783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.083808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.856 [2024-11-29 17:10:00.083824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.083940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.084160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.856 [2024-11-29 17:10:00.084180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.856 [2024-11-29 17:10:00.084193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.856 [2024-11-29 17:10:00.086427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.856 [2024-11-29 17:10:00.095998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.856 [2024-11-29 17:10:00.096368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.096520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.096546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.856 [2024-11-29 17:10:00.096562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.096726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.096880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.856 [2024-11-29 17:10:00.096906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.856 [2024-11-29 17:10:00.096919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.856 [2024-11-29 17:10:00.099021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.856 [2024-11-29 17:10:00.108708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.856 [2024-11-29 17:10:00.109039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.109190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.109216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.856 [2024-11-29 17:10:00.109233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.109380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.109522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.856 [2024-11-29 17:10:00.109541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.856 [2024-11-29 17:10:00.109553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.856 [2024-11-29 17:10:00.111823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.856 [2024-11-29 17:10:00.121233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.856 [2024-11-29 17:10:00.121592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.121713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.121739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.856 [2024-11-29 17:10:00.121755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.121887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.122073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.856 [2024-11-29 17:10:00.122093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.856 [2024-11-29 17:10:00.122105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.856 [2024-11-29 17:10:00.124346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.856 [2024-11-29 17:10:00.133716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.856 [2024-11-29 17:10:00.134052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.134193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.134219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.856 [2024-11-29 17:10:00.134235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.134415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.134586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.856 [2024-11-29 17:10:00.134605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.856 [2024-11-29 17:10:00.134622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.856 [2024-11-29 17:10:00.136791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.856 [2024-11-29 17:10:00.146351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.856 [2024-11-29 17:10:00.146687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.146857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.856 [2024-11-29 17:10:00.146882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.856 [2024-11-29 17:10:00.146898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.856 [2024-11-29 17:10:00.147006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.856 [2024-11-29 17:10:00.147200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.147221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.147233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.149610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.159078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.159413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.159564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.159589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.857 [2024-11-29 17:10:00.159605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.857 [2024-11-29 17:10:00.159826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.857 [2024-11-29 17:10:00.159987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.160006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.160018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.162251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.171822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.172253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.172404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.172429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.857 [2024-11-29 17:10:00.172445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.857 [2024-11-29 17:10:00.172640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.857 [2024-11-29 17:10:00.172807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.172826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.172839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.175145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.184225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.184576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.184727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.184752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.857 [2024-11-29 17:10:00.184768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.857 [2024-11-29 17:10:00.185009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.857 [2024-11-29 17:10:00.185175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.185193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.185206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.187563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.196615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.196876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.197010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.197037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.857 [2024-11-29 17:10:00.197053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.857 [2024-11-29 17:10:00.197249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.857 [2024-11-29 17:10:00.197422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.197441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.197454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.199794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.209159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.209495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.209584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.209610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.857 [2024-11-29 17:10:00.209626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.857 [2024-11-29 17:10:00.209805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.857 [2024-11-29 17:10:00.209989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.210009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.210022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.212043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.221797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.222199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.222326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.222355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.857 [2024-11-29 17:10:00.222371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.857 [2024-11-29 17:10:00.222534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.857 [2024-11-29 17:10:00.222701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.222720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.222733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.225162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.234398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.234704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.234833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.234858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.857 [2024-11-29 17:10:00.234874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.857 [2024-11-29 17:10:00.235058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.857 [2024-11-29 17:10:00.235260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.235279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.235292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.237594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.247019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.247386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.247494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.247520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.857 [2024-11-29 17:10:00.247536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.857 [2024-11-29 17:10:00.247712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.857 [2024-11-29 17:10:00.247871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.247890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.247902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.250130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.259534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.259952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.260123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.857 [2024-11-29 17:10:00.260148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.857 [2024-11-29 17:10:00.260164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.857 [2024-11-29 17:10:00.260311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.857 [2024-11-29 17:10:00.260488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.857 [2024-11-29 17:10:00.260507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.857 [2024-11-29 17:10:00.260519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.857 [2024-11-29 17:10:00.262769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.857 [2024-11-29 17:10:00.272029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.857 [2024-11-29 17:10:00.272346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.858 [2024-11-29 17:10:00.272506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.858 [2024-11-29 17:10:00.272532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.858 [2024-11-29 17:10:00.272547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.858 [2024-11-29 17:10:00.272695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:48.858 [2024-11-29 17:10:00.272866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:48.858 [2024-11-29 17:10:00.272885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:48.858 [2024-11-29 17:10:00.272898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.858 [2024-11-29 17:10:00.275380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:48.858 [2024-11-29 17:10:00.284374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.858 [2024-11-29 17:10:00.284724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.858 [2024-11-29 17:10:00.284882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.858 [2024-11-29 17:10:00.284910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:48.858 [2024-11-29 17:10:00.284927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:48.858 [2024-11-29 17:10:00.285052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.117 [2024-11-29 17:10:00.285156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.117 [2024-11-29 17:10:00.285178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.117 [2024-11-29 17:10:00.285191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.117 [2024-11-29 17:10:00.287351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.117 [2024-11-29 17:10:00.296873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.117 [2024-11-29 17:10:00.297226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.297332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.297362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.117 [2024-11-29 17:10:00.297379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.117 [2024-11-29 17:10:00.297588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.117 [2024-11-29 17:10:00.297755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.117 [2024-11-29 17:10:00.297774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.117 [2024-11-29 17:10:00.297786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.117 [2024-11-29 17:10:00.300022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.117 [2024-11-29 17:10:00.309414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.117 [2024-11-29 17:10:00.309761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.309887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.309913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.117 [2024-11-29 17:10:00.309929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.117 [2024-11-29 17:10:00.310120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.117 [2024-11-29 17:10:00.310338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.117 [2024-11-29 17:10:00.310358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.117 [2024-11-29 17:10:00.310370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.117 [2024-11-29 17:10:00.312658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.117 [2024-11-29 17:10:00.321852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.117 [2024-11-29 17:10:00.322204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.322302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.322327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.117 [2024-11-29 17:10:00.322343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.117 [2024-11-29 17:10:00.322488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.117 [2024-11-29 17:10:00.322659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.117 [2024-11-29 17:10:00.322678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.117 [2024-11-29 17:10:00.322690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.117 [2024-11-29 17:10:00.325015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.117 [2024-11-29 17:10:00.334388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.117 [2024-11-29 17:10:00.334789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.334939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.334973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.117 [2024-11-29 17:10:00.334995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.117 [2024-11-29 17:10:00.335161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.117 [2024-11-29 17:10:00.335325] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.117 [2024-11-29 17:10:00.335344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.117 [2024-11-29 17:10:00.335356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.117 [2024-11-29 17:10:00.337662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.117 [2024-11-29 17:10:00.347055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.117 [2024-11-29 17:10:00.347411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.347561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.117 [2024-11-29 17:10:00.347586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.117 [2024-11-29 17:10:00.347602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.117 [2024-11-29 17:10:00.347717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.117 [2024-11-29 17:10:00.347908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.117 [2024-11-29 17:10:00.347927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.347953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.118 [2024-11-29 17:10:00.350328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.118 [2024-11-29 17:10:00.359664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.118 [2024-11-29 17:10:00.360020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.360112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.360136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.118 [2024-11-29 17:10:00.360152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.118 [2024-11-29 17:10:00.360296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.118 [2024-11-29 17:10:00.360439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.118 [2024-11-29 17:10:00.360458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.360470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.118 [2024-11-29 17:10:00.362564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.118 [2024-11-29 17:10:00.372324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.118 [2024-11-29 17:10:00.372661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.372810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.372836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.118 [2024-11-29 17:10:00.372851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.118 [2024-11-29 17:10:00.373018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.118 [2024-11-29 17:10:00.373229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.118 [2024-11-29 17:10:00.373248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.373260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.118 [2024-11-29 17:10:00.375547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.118 [2024-11-29 17:10:00.385004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.118 [2024-11-29 17:10:00.385347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.385490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.385515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.118 [2024-11-29 17:10:00.385531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.118 [2024-11-29 17:10:00.385708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.118 [2024-11-29 17:10:00.385848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.118 [2024-11-29 17:10:00.385866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.385879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.118 [2024-11-29 17:10:00.388185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.118 [2024-11-29 17:10:00.397498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.118 [2024-11-29 17:10:00.397836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.397956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.397991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.118 [2024-11-29 17:10:00.398007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.118 [2024-11-29 17:10:00.398171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.118 [2024-11-29 17:10:00.398385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.118 [2024-11-29 17:10:00.398404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.398416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.118 [2024-11-29 17:10:00.400621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.118 [2024-11-29 17:10:00.410171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.118 [2024-11-29 17:10:00.410533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.410656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.410681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.118 [2024-11-29 17:10:00.410697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.118 [2024-11-29 17:10:00.410893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.118 [2024-11-29 17:10:00.411093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.118 [2024-11-29 17:10:00.411113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.411125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.118 [2024-11-29 17:10:00.413210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.118 [2024-11-29 17:10:00.422742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.118 [2024-11-29 17:10:00.423146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.423285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.423312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.118 [2024-11-29 17:10:00.423329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.118 [2024-11-29 17:10:00.423475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.118 [2024-11-29 17:10:00.423677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.118 [2024-11-29 17:10:00.423697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.423710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.118 [2024-11-29 17:10:00.426004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.118 [2024-11-29 17:10:00.435299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.118 [2024-11-29 17:10:00.435541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.435721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.435747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.118 [2024-11-29 17:10:00.435763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.118 [2024-11-29 17:10:00.435988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.118 [2024-11-29 17:10:00.436144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.118 [2024-11-29 17:10:00.436163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.436176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.118 [2024-11-29 17:10:00.438418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.118 [2024-11-29 17:10:00.447632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.118 [2024-11-29 17:10:00.447962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.448096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.448121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.118 [2024-11-29 17:10:00.448138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.118 [2024-11-29 17:10:00.448254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.118 [2024-11-29 17:10:00.448405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.118 [2024-11-29 17:10:00.448442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.448455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.118 [2024-11-29 17:10:00.450830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.118 [2024-11-29 17:10:00.460298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.118 [2024-11-29 17:10:00.460709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.460866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.118 [2024-11-29 17:10:00.460892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.118 [2024-11-29 17:10:00.460908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.118 [2024-11-29 17:10:00.461051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.118 [2024-11-29 17:10:00.461189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.118 [2024-11-29 17:10:00.461223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.118 [2024-11-29 17:10:00.461236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.119 [2024-11-29 17:10:00.463423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.119 [2024-11-29 17:10:00.473121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.119 [2024-11-29 17:10:00.473472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.473623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.473665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.119 [2024-11-29 17:10:00.473682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.119 [2024-11-29 17:10:00.473909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.119 [2024-11-29 17:10:00.474109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.119 [2024-11-29 17:10:00.474130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.119 [2024-11-29 17:10:00.474144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.119 [2024-11-29 17:10:00.476469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.119 [2024-11-29 17:10:00.485507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.119 [2024-11-29 17:10:00.485880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.486013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.486040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.119 [2024-11-29 17:10:00.486056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.119 [2024-11-29 17:10:00.486205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.119 [2024-11-29 17:10:00.486367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.119 [2024-11-29 17:10:00.486385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.119 [2024-11-29 17:10:00.486403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.119 [2024-11-29 17:10:00.488575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.119 [2024-11-29 17:10:00.498043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.119 [2024-11-29 17:10:00.498414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.498533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.498557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.119 [2024-11-29 17:10:00.498573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.119 [2024-11-29 17:10:00.498752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.119 [2024-11-29 17:10:00.498922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.119 [2024-11-29 17:10:00.498955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.119 [2024-11-29 17:10:00.498986] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.119 [2024-11-29 17:10:00.501291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.119 [2024-11-29 17:10:00.510697] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.119 [2024-11-29 17:10:00.511027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.511123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.511148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.119 [2024-11-29 17:10:00.511164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.119 [2024-11-29 17:10:00.511281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.119 [2024-11-29 17:10:00.511456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.119 [2024-11-29 17:10:00.511475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.119 [2024-11-29 17:10:00.511487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.119 [2024-11-29 17:10:00.513729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.119 [2024-11-29 17:10:00.523402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.119 [2024-11-29 17:10:00.523774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.523967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.523993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.119 [2024-11-29 17:10:00.524009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.119 [2024-11-29 17:10:00.524157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.119 [2024-11-29 17:10:00.524303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.119 [2024-11-29 17:10:00.524323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.119 [2024-11-29 17:10:00.524349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.119 [2024-11-29 17:10:00.526627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.119 [2024-11-29 17:10:00.536089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.119 [2024-11-29 17:10:00.536360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.536557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.119 [2024-11-29 17:10:00.536582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.119 [2024-11-29 17:10:00.536598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.119 [2024-11-29 17:10:00.536775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.119 [2024-11-29 17:10:00.536930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.119 [2024-11-29 17:10:00.536949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.119 [2024-11-29 17:10:00.536987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.119 [2024-11-29 17:10:00.539412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.379 [2024-11-29 17:10:00.548746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.379 [2024-11-29 17:10:00.549043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.379 [2024-11-29 17:10:00.549125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.379 [2024-11-29 17:10:00.549151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.379 [2024-11-29 17:10:00.549166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.379 [2024-11-29 17:10:00.549331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.379 [2024-11-29 17:10:00.549515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.379 [2024-11-29 17:10:00.549534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.379 [2024-11-29 17:10:00.549547] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.379 [2024-11-29 17:10:00.551750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.379 [2024-11-29 17:10:00.561318] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.379 [2024-11-29 17:10:00.561715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.379 [2024-11-29 17:10:00.561875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.379 [2024-11-29 17:10:00.561900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.379 [2024-11-29 17:10:00.561916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.379 [2024-11-29 17:10:00.562061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.379 [2024-11-29 17:10:00.562235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.379 [2024-11-29 17:10:00.562255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.379 [2024-11-29 17:10:00.562268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.379 [2024-11-29 17:10:00.564486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.379 [2024-11-29 17:10:00.574021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.379 [2024-11-29 17:10:00.574352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.379 [2024-11-29 17:10:00.574478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.379 [2024-11-29 17:10:00.574504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.574519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.574656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.574846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.380 [2024-11-29 17:10:00.574870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.380 [2024-11-29 17:10:00.574886] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.380 [2024-11-29 17:10:00.577102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.380 [2024-11-29 17:10:00.586562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.380 [2024-11-29 17:10:00.586901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.587030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.587057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.587073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.587221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.587394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.380 [2024-11-29 17:10:00.587413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.380 [2024-11-29 17:10:00.587426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.380 [2024-11-29 17:10:00.589607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.380 [2024-11-29 17:10:00.599076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.380 [2024-11-29 17:10:00.599367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.599536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.599561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.599577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.599729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.599937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.380 [2024-11-29 17:10:00.599970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.380 [2024-11-29 17:10:00.599988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.380 [2024-11-29 17:10:00.602208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.380 [2024-11-29 17:10:00.611554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.380 [2024-11-29 17:10:00.611908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.612017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.612045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.612061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.612210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.612402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.380 [2024-11-29 17:10:00.612421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.380 [2024-11-29 17:10:00.612433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.380 [2024-11-29 17:10:00.614658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.380 [2024-11-29 17:10:00.624143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.380 [2024-11-29 17:10:00.624470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.624610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.624636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.624652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.624769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.624903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.380 [2024-11-29 17:10:00.624936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.380 [2024-11-29 17:10:00.624949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.380 [2024-11-29 17:10:00.627378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.380 [2024-11-29 17:10:00.636632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.380 [2024-11-29 17:10:00.636917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.637062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.637090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.637106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.637285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.637411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.380 [2024-11-29 17:10:00.637429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.380 [2024-11-29 17:10:00.637441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.380 [2024-11-29 17:10:00.639613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.380 [2024-11-29 17:10:00.649267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.380 [2024-11-29 17:10:00.649665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.649801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.649832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.649848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.649977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.650142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.380 [2024-11-29 17:10:00.650162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.380 [2024-11-29 17:10:00.650175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.380 [2024-11-29 17:10:00.652634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.380 [2024-11-29 17:10:00.661953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.380 [2024-11-29 17:10:00.662297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.662425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.662451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.662467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.662614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.662790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.380 [2024-11-29 17:10:00.662809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.380 [2024-11-29 17:10:00.662821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.380 [2024-11-29 17:10:00.665318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.380 [2024-11-29 17:10:00.674577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.380 [2024-11-29 17:10:00.674886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.675018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.675044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.675060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.675225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.675410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.380 [2024-11-29 17:10:00.675429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.380 [2024-11-29 17:10:00.675441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.380 [2024-11-29 17:10:00.677642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.380 [2024-11-29 17:10:00.687211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.380 [2024-11-29 17:10:00.687614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.687732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.380 [2024-11-29 17:10:00.687756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.380 [2024-11-29 17:10:00.687780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.380 [2024-11-29 17:10:00.688049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.380 [2024-11-29 17:10:00.688175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.688194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.688207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.690424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.381 [2024-11-29 17:10:00.699943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.381 [2024-11-29 17:10:00.700331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.700489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.700514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.381 [2024-11-29 17:10:00.700530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.381 [2024-11-29 17:10:00.700646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.381 [2024-11-29 17:10:00.700823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.700841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.700854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.703111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.381 [2024-11-29 17:10:00.712548] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.381 [2024-11-29 17:10:00.712883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.713000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.713026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.381 [2024-11-29 17:10:00.713042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.381 [2024-11-29 17:10:00.713175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.381 [2024-11-29 17:10:00.713304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.713323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.713335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.715636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.381 [2024-11-29 17:10:00.725063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.381 [2024-11-29 17:10:00.725446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.725584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.725624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.381 [2024-11-29 17:10:00.725640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.381 [2024-11-29 17:10:00.725836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.381 [2024-11-29 17:10:00.726016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.726037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.726050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.728202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.381 [2024-11-29 17:10:00.737707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.381 [2024-11-29 17:10:00.738080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.738263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.738289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.381 [2024-11-29 17:10:00.738305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.381 [2024-11-29 17:10:00.738453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.381 [2024-11-29 17:10:00.738623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.738641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.738653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.740787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.381 [2024-11-29 17:10:00.750280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.381 [2024-11-29 17:10:00.750558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.750698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.750724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.381 [2024-11-29 17:10:00.750740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.381 [2024-11-29 17:10:00.750918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.381 [2024-11-29 17:10:00.751135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.751155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.751168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.753448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.381 [2024-11-29 17:10:00.762873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.381 [2024-11-29 17:10:00.763153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.763245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.763271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.381 [2024-11-29 17:10:00.763287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.381 [2024-11-29 17:10:00.763476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.381 [2024-11-29 17:10:00.763692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.763716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.763732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.765909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.381 [2024-11-29 17:10:00.775433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.381 [2024-11-29 17:10:00.775763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.775894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.775937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.381 [2024-11-29 17:10:00.775953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.381 [2024-11-29 17:10:00.776173] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.381 [2024-11-29 17:10:00.776331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.776350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.776363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.778446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.381 [2024-11-29 17:10:00.787866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.381 [2024-11-29 17:10:00.788149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.788248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.788274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.381 [2024-11-29 17:10:00.788290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.381 [2024-11-29 17:10:00.788454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.381 [2024-11-29 17:10:00.788598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.788618] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.788631] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.790628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.381 [2024-11-29 17:10:00.800499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.381 [2024-11-29 17:10:00.800825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.800975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.381 [2024-11-29 17:10:00.801002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.381 [2024-11-29 17:10:00.801018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.381 [2024-11-29 17:10:00.801166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.381 [2024-11-29 17:10:00.801343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.381 [2024-11-29 17:10:00.801367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.381 [2024-11-29 17:10:00.801380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.381 [2024-11-29 17:10:00.803645] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.642 [2024-11-29 17:10:00.812951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.642 [2024-11-29 17:10:00.813249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.813379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.813404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.642 [2024-11-29 17:10:00.813420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.642 [2024-11-29 17:10:00.813585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.642 [2024-11-29 17:10:00.813738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.642 [2024-11-29 17:10:00.813759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.642 [2024-11-29 17:10:00.813773] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.642 [2024-11-29 17:10:00.816129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.642 [2024-11-29 17:10:00.825228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.642 [2024-11-29 17:10:00.825597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.825775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.825804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.642 [2024-11-29 17:10:00.825822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.642 [2024-11-29 17:10:00.825999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.642 [2024-11-29 17:10:00.826134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.642 [2024-11-29 17:10:00.826155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.642 [2024-11-29 17:10:00.826168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.642 [2024-11-29 17:10:00.828651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.642 [2024-11-29 17:10:00.837822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.642 [2024-11-29 17:10:00.838197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.838392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.838418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.642 [2024-11-29 17:10:00.838433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.642 [2024-11-29 17:10:00.838662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.642 [2024-11-29 17:10:00.838835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.642 [2024-11-29 17:10:00.838858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.642 [2024-11-29 17:10:00.838882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.642 [2024-11-29 17:10:00.841162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.642 [2024-11-29 17:10:00.850451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.642 [2024-11-29 17:10:00.850831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.851004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.851031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.642 [2024-11-29 17:10:00.851047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.642 [2024-11-29 17:10:00.851180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.642 [2024-11-29 17:10:00.851342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.642 [2024-11-29 17:10:00.851361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.642 [2024-11-29 17:10:00.851373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.642 [2024-11-29 17:10:00.853703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.642 [2024-11-29 17:10:00.863366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.642 [2024-11-29 17:10:00.863756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.863935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.863973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.642 [2024-11-29 17:10:00.863991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.642 [2024-11-29 17:10:00.864141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.642 [2024-11-29 17:10:00.864326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.642 [2024-11-29 17:10:00.864345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.642 [2024-11-29 17:10:00.864357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.642 [2024-11-29 17:10:00.866661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.642 [2024-11-29 17:10:00.876006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.642 [2024-11-29 17:10:00.876335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.876454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.876480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.642 [2024-11-29 17:10:00.876495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.642 [2024-11-29 17:10:00.876673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.642 [2024-11-29 17:10:00.876829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.642 [2024-11-29 17:10:00.876848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.642 [2024-11-29 17:10:00.876860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.642 [2024-11-29 17:10:00.879169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.642 [2024-11-29 17:10:00.888755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.642 [2024-11-29 17:10:00.889054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.889177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.889203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.642 [2024-11-29 17:10:00.889218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.642 [2024-11-29 17:10:00.889424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.642 [2024-11-29 17:10:00.889562] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.642 [2024-11-29 17:10:00.889581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.642 [2024-11-29 17:10:00.889593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.642 [2024-11-29 17:10:00.891922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.642 [2024-11-29 17:10:00.901283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.642 [2024-11-29 17:10:00.901684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.901841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.901867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.642 [2024-11-29 17:10:00.901883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.642 [2024-11-29 17:10:00.902059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.642 [2024-11-29 17:10:00.902269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.642 [2024-11-29 17:10:00.902289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.642 [2024-11-29 17:10:00.902316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.642 [2024-11-29 17:10:00.904826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.642 [2024-11-29 17:10:00.913771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.642 [2024-11-29 17:10:00.914107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.914261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.642 [2024-11-29 17:10:00.914287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:00.914303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:00.914453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:00.914608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.643 [2024-11-29 17:10:00.914627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.643 [2024-11-29 17:10:00.914639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.643 [2024-11-29 17:10:00.916835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.643 [2024-11-29 17:10:00.926384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.643 [2024-11-29 17:10:00.926704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.926824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.926850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:00.926866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:00.927059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:00.927232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.643 [2024-11-29 17:10:00.927252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.643 [2024-11-29 17:10:00.927265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.643 [2024-11-29 17:10:00.929558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.643 [2024-11-29 17:10:00.939137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.643 [2024-11-29 17:10:00.939516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.939638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.939663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:00.939679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:00.939827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:00.940009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.643 [2024-11-29 17:10:00.940031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.643 [2024-11-29 17:10:00.940046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.643 [2024-11-29 17:10:00.942500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.643 [2024-11-29 17:10:00.951582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.643 [2024-11-29 17:10:00.951855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.952034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.952061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:00.952077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:00.952226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:00.952405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.643 [2024-11-29 17:10:00.952425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.643 [2024-11-29 17:10:00.952438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.643 [2024-11-29 17:10:00.954499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.643 [2024-11-29 17:10:00.964225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.643 [2024-11-29 17:10:00.964562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.964722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.964750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:00.964769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:00.964898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:00.965089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.643 [2024-11-29 17:10:00.965111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.643 [2024-11-29 17:10:00.965125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.643 [2024-11-29 17:10:00.967423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.643 [2024-11-29 17:10:00.976904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.643 [2024-11-29 17:10:00.977231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.977375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.977401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:00.977417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:00.977612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:00.977782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.643 [2024-11-29 17:10:00.977802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.643 [2024-11-29 17:10:00.977814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.643 [2024-11-29 17:10:00.980075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.643 [2024-11-29 17:10:00.989530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.643 [2024-11-29 17:10:00.989805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.989968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:00.990012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:00.990029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:00.990209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:00.990362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.643 [2024-11-29 17:10:00.990381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.643 [2024-11-29 17:10:00.990394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.643 [2024-11-29 17:10:00.992626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.643 [2024-11-29 17:10:01.001880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.643 [2024-11-29 17:10:01.002209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:01.002346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:01.002378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:01.002395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:01.002587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:01.002755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.643 [2024-11-29 17:10:01.002775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.643 [2024-11-29 17:10:01.002787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.643 [2024-11-29 17:10:01.004994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.643 [2024-11-29 17:10:01.014353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.643 [2024-11-29 17:10:01.014695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:01.014831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:01.014859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:01.014877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:01.015001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:01.015172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.643 [2024-11-29 17:10:01.015196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.643 [2024-11-29 17:10:01.015211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.643 [2024-11-29 17:10:01.017535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.643 [2024-11-29 17:10:01.026948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.643 [2024-11-29 17:10:01.027248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:01.027362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.643 [2024-11-29 17:10:01.027389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.643 [2024-11-29 17:10:01.027404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.643 [2024-11-29 17:10:01.027569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.643 [2024-11-29 17:10:01.027756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.644 [2024-11-29 17:10:01.027775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.644 [2024-11-29 17:10:01.027788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.644 [2024-11-29 17:10:01.030202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.644 [2024-11-29 17:10:01.039418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.644 [2024-11-29 17:10:01.039747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.644 [2024-11-29 17:10:01.039886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.644 [2024-11-29 17:10:01.039916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.644 [2024-11-29 17:10:01.039939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.644 [2024-11-29 17:10:01.040153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.644 [2024-11-29 17:10:01.040361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.644 [2024-11-29 17:10:01.040384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.644 [2024-11-29 17:10:01.040400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.644 [2024-11-29 17:10:01.042715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.644 [2024-11-29 17:10:01.052002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.644 [2024-11-29 17:10:01.052379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.644 [2024-11-29 17:10:01.052495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.644 [2024-11-29 17:10:01.052519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.644 [2024-11-29 17:10:01.052549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.644 [2024-11-29 17:10:01.052726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.644 [2024-11-29 17:10:01.052883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.644 [2024-11-29 17:10:01.052902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.644 [2024-11-29 17:10:01.052914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.644 [2024-11-29 17:10:01.055409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.644 [2024-11-29 17:10:01.064726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.644 [2024-11-29 17:10:01.065096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.644 [2024-11-29 17:10:01.065220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.644 [2024-11-29 17:10:01.065250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.644 [2024-11-29 17:10:01.065267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.644 [2024-11-29 17:10:01.065396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.644 [2024-11-29 17:10:01.065585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.644 [2024-11-29 17:10:01.065608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.644 [2024-11-29 17:10:01.065623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.644 [2024-11-29 17:10:01.068023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.903 [2024-11-29 17:10:01.077275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.903 [2024-11-29 17:10:01.077566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.077720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.077749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.903 [2024-11-29 17:10:01.077767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.903 [2024-11-29 17:10:01.077938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.903 [2024-11-29 17:10:01.078121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.903 [2024-11-29 17:10:01.078145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.903 [2024-11-29 17:10:01.078161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.903 [2024-11-29 17:10:01.080434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.903 [2024-11-29 17:10:01.089747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.903 [2024-11-29 17:10:01.090136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.090225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.090251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.903 [2024-11-29 17:10:01.090267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.903 [2024-11-29 17:10:01.090416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.903 [2024-11-29 17:10:01.090577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.903 [2024-11-29 17:10:01.090596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.903 [2024-11-29 17:10:01.090609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.903 [2024-11-29 17:10:01.092784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.903 [2024-11-29 17:10:01.102648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.903 [2024-11-29 17:10:01.103028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.103202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.103228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.903 [2024-11-29 17:10:01.103243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.903 [2024-11-29 17:10:01.103404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.903 [2024-11-29 17:10:01.103621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.903 [2024-11-29 17:10:01.103641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.903 [2024-11-29 17:10:01.103653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.903 [2024-11-29 17:10:01.105901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.903 [2024-11-29 17:10:01.115313] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.903 [2024-11-29 17:10:01.115633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.115746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.115776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.903 [2024-11-29 17:10:01.115793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.903 [2024-11-29 17:10:01.115992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.903 [2024-11-29 17:10:01.116175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.903 [2024-11-29 17:10:01.116196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.903 [2024-11-29 17:10:01.116209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.903 [2024-11-29 17:10:01.118444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.903 [2024-11-29 17:10:01.128073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.903 [2024-11-29 17:10:01.128418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.128548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.128577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.903 [2024-11-29 17:10:01.128595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.903 [2024-11-29 17:10:01.128742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.903 [2024-11-29 17:10:01.128912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.903 [2024-11-29 17:10:01.128936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.903 [2024-11-29 17:10:01.128951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.903 [2024-11-29 17:10:01.131422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.903 [2024-11-29 17:10:01.140785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.903 [2024-11-29 17:10:01.141115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.141222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.903 [2024-11-29 17:10:01.141251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.903 [2024-11-29 17:10:01.141268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.903 [2024-11-29 17:10:01.141452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.903 [2024-11-29 17:10:01.141622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.903 [2024-11-29 17:10:01.141646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.903 [2024-11-29 17:10:01.141661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.903 [2024-11-29 17:10:01.143955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.903 [2024-11-29 17:10:01.153469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.903 [2024-11-29 17:10:01.153727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.153873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.153899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.153915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.154107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.904 [2024-11-29 17:10:01.154311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.904 [2024-11-29 17:10:01.154335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.904 [2024-11-29 17:10:01.154348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.904 [2024-11-29 17:10:01.156477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.904 [2024-11-29 17:10:01.166074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.904 [2024-11-29 17:10:01.166382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.166513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.166542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.166560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.166707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.904 [2024-11-29 17:10:01.166877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.904 [2024-11-29 17:10:01.166901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.904 [2024-11-29 17:10:01.166917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.904 [2024-11-29 17:10:01.169447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.904 [2024-11-29 17:10:01.178758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.904 [2024-11-29 17:10:01.179084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.179216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.179245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.179263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.179465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.904 [2024-11-29 17:10:01.179691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.904 [2024-11-29 17:10:01.179715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.904 [2024-11-29 17:10:01.179730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.904 [2024-11-29 17:10:01.182249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.904 [2024-11-29 17:10:01.191495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.904 [2024-11-29 17:10:01.191841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.191943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.191985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.192018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.192239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.904 [2024-11-29 17:10:01.192391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.904 [2024-11-29 17:10:01.192409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.904 [2024-11-29 17:10:01.192427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.904 [2024-11-29 17:10:01.194523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.904 [2024-11-29 17:10:01.204152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.904 [2024-11-29 17:10:01.204394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.204559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.204585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.204601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.204781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.904 [2024-11-29 17:10:01.204951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.904 [2024-11-29 17:10:01.204983] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.904 [2024-11-29 17:10:01.204995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.904 [2024-11-29 17:10:01.207366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.904 [2024-11-29 17:10:01.216912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.904 [2024-11-29 17:10:01.217248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.217371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.217400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.217418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.217565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.904 [2024-11-29 17:10:01.217735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.904 [2024-11-29 17:10:01.217759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.904 [2024-11-29 17:10:01.217774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.904 [2024-11-29 17:10:01.219915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.904 [2024-11-29 17:10:01.229484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.904 [2024-11-29 17:10:01.229847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.230005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.230032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.230047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.230212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.904 [2024-11-29 17:10:01.230403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.904 [2024-11-29 17:10:01.230423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.904 [2024-11-29 17:10:01.230435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.904 [2024-11-29 17:10:01.232566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.904 [2024-11-29 17:10:01.242106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.904 [2024-11-29 17:10:01.242393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.242558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.242586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.242604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.242788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.904 [2024-11-29 17:10:01.242940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.904 [2024-11-29 17:10:01.242975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.904 [2024-11-29 17:10:01.242993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.904 [2024-11-29 17:10:01.245409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.904 [2024-11-29 17:10:01.254573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.904 [2024-11-29 17:10:01.254866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.254997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.255041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.255057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.255299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.904 [2024-11-29 17:10:01.255449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.904 [2024-11-29 17:10:01.255468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.904 [2024-11-29 17:10:01.255480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.904 [2024-11-29 17:10:01.257750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.904 [2024-11-29 17:10:01.267150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.904 [2024-11-29 17:10:01.267422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.267548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.904 [2024-11-29 17:10:01.267578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.904 [2024-11-29 17:10:01.267595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.904 [2024-11-29 17:10:01.267797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.905 [2024-11-29 17:10:01.268048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.905 [2024-11-29 17:10:01.268068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.905 [2024-11-29 17:10:01.268081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.905 [2024-11-29 17:10:01.270429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.905 [2024-11-29 17:10:01.279713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.905 [2024-11-29 17:10:01.280032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.280189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.280218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.905 [2024-11-29 17:10:01.280235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.905 [2024-11-29 17:10:01.280402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.905 [2024-11-29 17:10:01.280536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.905 [2024-11-29 17:10:01.280559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.905 [2024-11-29 17:10:01.280574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.905 [2024-11-29 17:10:01.282803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.905 [2024-11-29 17:10:01.292334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.905 [2024-11-29 17:10:01.292698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.292835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.292861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.905 [2024-11-29 17:10:01.292877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.905 [2024-11-29 17:10:01.293082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.905 [2024-11-29 17:10:01.293209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.905 [2024-11-29 17:10:01.293228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.905 [2024-11-29 17:10:01.293240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.905 [2024-11-29 17:10:01.295365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.905 [2024-11-29 17:10:01.304883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.905 [2024-11-29 17:10:01.305224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.305367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.305419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.905 [2024-11-29 17:10:01.305437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.905 [2024-11-29 17:10:01.305585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.905 [2024-11-29 17:10:01.305737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.905 [2024-11-29 17:10:01.305760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.905 [2024-11-29 17:10:01.305776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.905 [2024-11-29 17:10:01.308252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.905 [2024-11-29 17:10:01.317155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.905 [2024-11-29 17:10:01.317530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.317678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.317707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.905 [2024-11-29 17:10:01.317726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.905 [2024-11-29 17:10:01.317873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.905 [2024-11-29 17:10:01.318076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.905 [2024-11-29 17:10:01.318100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.905 [2024-11-29 17:10:01.318115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.905 [2024-11-29 17:10:01.320437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:49.905 [2024-11-29 17:10:01.329699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:49.905 [2024-11-29 17:10:01.329991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.330120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.905 [2024-11-29 17:10:01.330149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:49.905 [2024-11-29 17:10:01.330167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:49.905 [2024-11-29 17:10:01.330368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:49.905 [2024-11-29 17:10:01.330575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.905 [2024-11-29 17:10:01.330599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.905 [2024-11-29 17:10:01.330614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.164 [2024-11-29 17:10:01.333088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.164 [2024-11-29 17:10:01.342382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.164 [2024-11-29 17:10:01.342703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.164 [2024-11-29 17:10:01.342817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.164 [2024-11-29 17:10:01.342842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.164 [2024-11-29 17:10:01.342858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.164 [2024-11-29 17:10:01.343031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.164 [2024-11-29 17:10:01.343210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.164 [2024-11-29 17:10:01.343230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.164 [2024-11-29 17:10:01.343256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.164 [2024-11-29 17:10:01.345527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.164 [2024-11-29 17:10:01.355004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.164 [2024-11-29 17:10:01.355283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.164 [2024-11-29 17:10:01.355507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.164 [2024-11-29 17:10:01.355569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.164 [2024-11-29 17:10:01.355588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.164 [2024-11-29 17:10:01.355699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.164 [2024-11-29 17:10:01.355869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.164 [2024-11-29 17:10:01.355892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.164 [2024-11-29 17:10:01.355907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.164 [2024-11-29 17:10:01.358242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.164 [2024-11-29 17:10:01.367658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.164 [2024-11-29 17:10:01.367986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.164 [2024-11-29 17:10:01.368130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.164 [2024-11-29 17:10:01.368155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.164 [2024-11-29 17:10:01.368171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.164 [2024-11-29 17:10:01.368336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.164 [2024-11-29 17:10:01.368507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.164 [2024-11-29 17:10:01.368526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.164 [2024-11-29 17:10:01.368538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.164 [2024-11-29 17:10:01.370712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.380266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.380555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.380710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.380735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.165 [2024-11-29 17:10:01.380751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.165 [2024-11-29 17:10:01.380897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.165 [2024-11-29 17:10:01.381084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.165 [2024-11-29 17:10:01.381104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.165 [2024-11-29 17:10:01.381117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.165 [2024-11-29 17:10:01.383322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.392861] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.393127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.393258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.393285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.165 [2024-11-29 17:10:01.393308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.165 [2024-11-29 17:10:01.393492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.165 [2024-11-29 17:10:01.393698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.165 [2024-11-29 17:10:01.393721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.165 [2024-11-29 17:10:01.393737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.165 [2024-11-29 17:10:01.395970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.405539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.405897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.406059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.406085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.165 [2024-11-29 17:10:01.406101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.165 [2024-11-29 17:10:01.406281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.165 [2024-11-29 17:10:01.406463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.165 [2024-11-29 17:10:01.406482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.165 [2024-11-29 17:10:01.406495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.165 [2024-11-29 17:10:01.408694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.418105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.418499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.418618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.418643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.165 [2024-11-29 17:10:01.418659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.165 [2024-11-29 17:10:01.418791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.165 [2024-11-29 17:10:01.418950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.165 [2024-11-29 17:10:01.418993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.165 [2024-11-29 17:10:01.419007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.165 [2024-11-29 17:10:01.421467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.430745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.431035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.431130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.431155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.165 [2024-11-29 17:10:01.431171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.165 [2024-11-29 17:10:01.431338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.165 [2024-11-29 17:10:01.431483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.165 [2024-11-29 17:10:01.431503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.165 [2024-11-29 17:10:01.431530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.165 [2024-11-29 17:10:01.433822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.443497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.443810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.443965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.443991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.165 [2024-11-29 17:10:01.444006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.165 [2024-11-29 17:10:01.444197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.165 [2024-11-29 17:10:01.444379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.165 [2024-11-29 17:10:01.444398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.165 [2024-11-29 17:10:01.444410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.165 [2024-11-29 17:10:01.446555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.455853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.456115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.456243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.456272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.165 [2024-11-29 17:10:01.456290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.165 [2024-11-29 17:10:01.456455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.165 [2024-11-29 17:10:01.456644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.165 [2024-11-29 17:10:01.456668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.165 [2024-11-29 17:10:01.456683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.165 [2024-11-29 17:10:01.459032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.468315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.468644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.468801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.468830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.165 [2024-11-29 17:10:01.468848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.165 [2024-11-29 17:10:01.469055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.165 [2024-11-29 17:10:01.469214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.165 [2024-11-29 17:10:01.469236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.165 [2024-11-29 17:10:01.469250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.165 [2024-11-29 17:10:01.471510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.481079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.481381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.481471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.481497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.165 [2024-11-29 17:10:01.481512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.165 [2024-11-29 17:10:01.481641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.165 [2024-11-29 17:10:01.481812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.165 [2024-11-29 17:10:01.481831] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.165 [2024-11-29 17:10:01.481843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.165 [2024-11-29 17:10:01.484358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.165 [2024-11-29 17:10:01.493538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.165 [2024-11-29 17:10:01.493875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.165 [2024-11-29 17:10:01.494007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.494034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.166 [2024-11-29 17:10:01.494050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.166 [2024-11-29 17:10:01.494231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.166 [2024-11-29 17:10:01.494433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.166 [2024-11-29 17:10:01.494452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.166 [2024-11-29 17:10:01.494463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.166 [2024-11-29 17:10:01.496515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.166 [2024-11-29 17:10:01.506191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.166 [2024-11-29 17:10:01.506502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.506620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.506646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.166 [2024-11-29 17:10:01.506662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.166 [2024-11-29 17:10:01.506840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.166 [2024-11-29 17:10:01.507040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.166 [2024-11-29 17:10:01.507066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.166 [2024-11-29 17:10:01.507081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.166 [2024-11-29 17:10:01.509407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.166 [2024-11-29 17:10:01.518645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.166 [2024-11-29 17:10:01.518975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.519079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.519107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.166 [2024-11-29 17:10:01.519126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.166 [2024-11-29 17:10:01.519291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.166 [2024-11-29 17:10:01.519480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.166 [2024-11-29 17:10:01.519504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.166 [2024-11-29 17:10:01.519519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.166 [2024-11-29 17:10:01.521916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.166 [2024-11-29 17:10:01.531377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.166 [2024-11-29 17:10:01.531674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.531813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.531839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.166 [2024-11-29 17:10:01.531855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.166 [2024-11-29 17:10:01.532043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.166 [2024-11-29 17:10:01.532245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.166 [2024-11-29 17:10:01.532264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.166 [2024-11-29 17:10:01.532276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.166 [2024-11-29 17:10:01.534567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.166 [2024-11-29 17:10:01.543788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.166 [2024-11-29 17:10:01.544093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.544276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.544338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.166 [2024-11-29 17:10:01.544356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.166 [2024-11-29 17:10:01.544557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.166 [2024-11-29 17:10:01.544674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.166 [2024-11-29 17:10:01.544697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.166 [2024-11-29 17:10:01.544718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.166 [2024-11-29 17:10:01.546955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.166 [2024-11-29 17:10:01.556498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.166 [2024-11-29 17:10:01.556814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.556951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.556986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.166 [2024-11-29 17:10:01.557002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.166 [2024-11-29 17:10:01.557135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.166 [2024-11-29 17:10:01.557340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.166 [2024-11-29 17:10:01.557359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.166 [2024-11-29 17:10:01.557371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.166 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 324008 Killed "${NVMF_APP[@]}" "$@" 00:27:50.166 17:10:01 -- host/bdevperf.sh@36 -- # tgt_init 00:27:50.166 17:10:01 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:50.166 17:10:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:50.166 17:10:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:50.166 17:10:01 -- common/autotest_common.sh@10 -- # set +x 00:27:50.166 [2024-11-29 17:10:01.559776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.166 17:10:01 -- nvmf/common.sh@469 -- # nvmfpid=325125 00:27:50.166 17:10:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:50.166 17:10:01 -- nvmf/common.sh@470 -- # waitforlisten 325125 00:27:50.166 17:10:01 -- common/autotest_common.sh@829 -- # '[' -z 325125 ']' 00:27:50.166 17:10:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:50.166 17:10:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:50.166 17:10:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:50.166 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:50.166 17:10:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:50.166 17:10:01 -- common/autotest_common.sh@10 -- # set +x 00:27:50.166 [2024-11-29 17:10:01.569141] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.166 [2024-11-29 17:10:01.569468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.569621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.569649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.166 [2024-11-29 17:10:01.569667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.166 [2024-11-29 17:10:01.569851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.166 [2024-11-29 17:10:01.570109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.166 [2024-11-29 17:10:01.570132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.166 [2024-11-29 17:10:01.570145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.166 [2024-11-29 17:10:01.572363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.166 [2024-11-29 17:10:01.581624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.166 [2024-11-29 17:10:01.581969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.582073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.166 [2024-11-29 17:10:01.582098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.166 [2024-11-29 17:10:01.582114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.166 [2024-11-29 17:10:01.582296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.166 [2024-11-29 17:10:01.582446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.166 [2024-11-29 17:10:01.582482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.166 [2024-11-29 17:10:01.582497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.166 [2024-11-29 17:10:01.584761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.166 [2024-11-29 17:10:01.593868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.427 [2024-11-29 17:10:01.594155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.594253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.594278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.427 [2024-11-29 17:10:01.594294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.427 [2024-11-29 17:10:01.594444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.427 [2024-11-29 17:10:01.594595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.427 [2024-11-29 17:10:01.594616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.427 [2024-11-29 17:10:01.594631] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.427 [2024-11-29 17:10:01.596719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.427 [2024-11-29 17:10:01.603466] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:50.427 [2024-11-29 17:10:01.603534] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:50.427 [2024-11-29 17:10:01.606056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.427 [2024-11-29 17:10:01.606358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.606476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.606501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.427 [2024-11-29 17:10:01.606517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.427 [2024-11-29 17:10:01.606666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.427 [2024-11-29 17:10:01.606856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.427 [2024-11-29 17:10:01.606876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.427 [2024-11-29 17:10:01.606894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.427 [2024-11-29 17:10:01.608889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.427 [2024-11-29 17:10:01.618225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.427 [2024-11-29 17:10:01.618587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.618681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.618707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.427 [2024-11-29 17:10:01.618722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.427 [2024-11-29 17:10:01.618888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.427 [2024-11-29 17:10:01.619030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.427 [2024-11-29 17:10:01.619051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.427 [2024-11-29 17:10:01.619064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.427 [2024-11-29 17:10:01.621216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.427 [2024-11-29 17:10:01.630472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.427 [2024-11-29 17:10:01.630738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.630867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.630894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.427 [2024-11-29 17:10:01.630909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.427 [2024-11-29 17:10:01.631098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.427 [2024-11-29 17:10:01.631258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.427 [2024-11-29 17:10:01.631278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.427 [2024-11-29 17:10:01.631291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.427 [2024-11-29 17:10:01.633288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.427 EAL: No free 2048 kB hugepages reported on node 1 00:27:50.427 [2024-11-29 17:10:01.643501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.427 [2024-11-29 17:10:01.643781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.643928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.427 [2024-11-29 17:10:01.643980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.427 [2024-11-29 17:10:01.644000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.427 [2024-11-29 17:10:01.644217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.427 [2024-11-29 17:10:01.644374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.427 [2024-11-29 17:10:01.644393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.428 [2024-11-29 17:10:01.644406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.428 [2024-11-29 17:10:01.646829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.428 [2024-11-29 17:10:01.656001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.428 [2024-11-29 17:10:01.656382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.656525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.656569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.428 [2024-11-29 17:10:01.656586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.428 [2024-11-29 17:10:01.656752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.428 [2024-11-29 17:10:01.656897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.428 [2024-11-29 17:10:01.656920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.428 [2024-11-29 17:10:01.656936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.428 [2024-11-29 17:10:01.659129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.428 [2024-11-29 17:10:01.668473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.428 [2024-11-29 17:10:01.668819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.668925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.668952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.428 [2024-11-29 17:10:01.668981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.428 [2024-11-29 17:10:01.669146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.428 [2024-11-29 17:10:01.669321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.428 [2024-11-29 17:10:01.669340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.428 [2024-11-29 17:10:01.669353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.428 [2024-11-29 17:10:01.671471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:50.428 [2024-11-29 17:10:01.671495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.428 [2024-11-29 17:10:01.681062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.428 [2024-11-29 17:10:01.681540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.681704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.681746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.428 [2024-11-29 17:10:01.681766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.428 [2024-11-29 17:10:01.681907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.428 [2024-11-29 17:10:01.682105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.428 [2024-11-29 17:10:01.682127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.428 [2024-11-29 17:10:01.682145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.428 [2024-11-29 17:10:01.684393] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.428 [2024-11-29 17:10:01.693598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.428 [2024-11-29 17:10:01.694000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.694127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.694153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.428 [2024-11-29 17:10:01.694170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.428 [2024-11-29 17:10:01.694289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.428 [2024-11-29 17:10:01.694410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.428 [2024-11-29 17:10:01.694430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.428 [2024-11-29 17:10:01.694457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.428 [2024-11-29 17:10:01.696651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.428 [2024-11-29 17:10:01.706114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.428 [2024-11-29 17:10:01.706483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.706679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.706708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.428 [2024-11-29 17:10:01.706726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.428 [2024-11-29 17:10:01.706892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.428 [2024-11-29 17:10:01.707077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.428 [2024-11-29 17:10:01.707098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.428 [2024-11-29 17:10:01.707111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.428 [2024-11-29 17:10:01.709301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.428 [2024-11-29 17:10:01.718714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.428 [2024-11-29 17:10:01.719097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.719244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.428 [2024-11-29 17:10:01.719270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.428 [2024-11-29 17:10:01.719286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.428 [2024-11-29 17:10:01.719452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.428 [2024-11-29 17:10:01.719641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.428 [2024-11-29 17:10:01.719661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.428 [2024-11-29 17:10:01.719676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.428 [2024-11-29 17:10:01.721949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.428 [2024-11-29 17:10:01.731286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.428 [2024-11-29 17:10:01.731609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.731768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.731794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.429 [2024-11-29 17:10:01.731811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.429 [2024-11-29 17:10:01.731969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.429 [2024-11-29 17:10:01.732116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.429 [2024-11-29 17:10:01.732136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.429 [2024-11-29 17:10:01.732149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.429 [2024-11-29 17:10:01.734541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.429 [2024-11-29 17:10:01.743845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.429 [2024-11-29 17:10:01.744314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.744480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.744510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.429 [2024-11-29 17:10:01.744531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.429 [2024-11-29 17:10:01.744687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.429 [2024-11-29 17:10:01.744861] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.429 [2024-11-29 17:10:01.744887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.429 [2024-11-29 17:10:01.744907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.429 [2024-11-29 17:10:01.747086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.429 [2024-11-29 17:10:01.756541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.429 [2024-11-29 17:10:01.756823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.756949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.757003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.429 [2024-11-29 17:10:01.757020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.429 [2024-11-29 17:10:01.757200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.429 [2024-11-29 17:10:01.757355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.429 [2024-11-29 17:10:01.757375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.429 [2024-11-29 17:10:01.757388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.429 [2024-11-29 17:10:01.759274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.429 [2024-11-29 17:10:01.769116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.429 [2024-11-29 17:10:01.769445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.769600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.769629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.429 [2024-11-29 17:10:01.769646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.429 [2024-11-29 17:10:01.769830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.429 [2024-11-29 17:10:01.769947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.429 [2024-11-29 17:10:01.769981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.429 [2024-11-29 17:10:01.770012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.429 [2024-11-29 17:10:01.772375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.429 [2024-11-29 17:10:01.781663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.429 [2024-11-29 17:10:01.782008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.782113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.782139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.429 [2024-11-29 17:10:01.782155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.429 [2024-11-29 17:10:01.782348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.429 [2024-11-29 17:10:01.782520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.429 [2024-11-29 17:10:01.782540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.429 [2024-11-29 17:10:01.782554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.429 [2024-11-29 17:10:01.784873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.429 [2024-11-29 17:10:01.785462] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:50.429 [2024-11-29 17:10:01.785572] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:50.429 [2024-11-29 17:10:01.785589] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:50.429 [2024-11-29 17:10:01.785601] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:50.429 [2024-11-29 17:10:01.785651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:50.429 [2024-11-29 17:10:01.785707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:50.429 [2024-11-29 17:10:01.785710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:50.429 [2024-11-29 17:10:01.793976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.429 [2024-11-29 17:10:01.794330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.794470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.429 [2024-11-29 17:10:01.794499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.429 [2024-11-29 17:10:01.794518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.429 [2024-11-29 17:10:01.794692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.429 [2024-11-29 17:10:01.794858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.429 [2024-11-29 17:10:01.794888] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.429 [2024-11-29 17:10:01.794905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.429 [2024-11-29 17:10:01.796942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.430 [2024-11-29 17:10:01.806217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.430 [2024-11-29 17:10:01.806674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.430 [2024-11-29 17:10:01.806786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.430 [2024-11-29 17:10:01.806813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.430 [2024-11-29 17:10:01.806833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.430 [2024-11-29 17:10:01.806984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.430 [2024-11-29 17:10:01.807144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.430 [2024-11-29 17:10:01.807166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.430 [2024-11-29 17:10:01.807184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.430 [2024-11-29 17:10:01.809309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.430 [2024-11-29 17:10:01.818599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.430 [2024-11-29 17:10:01.819084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.430 [2024-11-29 17:10:01.819231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.430 [2024-11-29 17:10:01.819265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.430 [2024-11-29 17:10:01.819285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.430 [2024-11-29 17:10:01.819507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.430 [2024-11-29 17:10:01.819675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.430 [2024-11-29 17:10:01.819696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.430 [2024-11-29 17:10:01.819713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.430 [2024-11-29 17:10:01.821834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.430 [2024-11-29 17:10:01.830834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.430 [2024-11-29 17:10:01.831280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.430 [2024-11-29 17:10:01.831416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.430 [2024-11-29 17:10:01.831444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.430 [2024-11-29 17:10:01.831464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.430 [2024-11-29 17:10:01.831641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.430 [2024-11-29 17:10:01.831791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.430 [2024-11-29 17:10:01.831813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.430 [2024-11-29 17:10:01.831841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.430 [2024-11-29 17:10:01.834162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.430 [2024-11-29 17:10:01.843361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.430 [2024-11-29 17:10:01.843700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.430 [2024-11-29 17:10:01.843794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.430 [2024-11-29 17:10:01.843820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.430 [2024-11-29 17:10:01.843838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.430 [2024-11-29 17:10:01.844003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.430 [2024-11-29 17:10:01.844160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.430 [2024-11-29 17:10:01.844182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.430 [2024-11-29 17:10:01.844199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.430 [2024-11-29 17:10:01.846468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.430 [2024-11-29 17:10:01.855793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.430 [2024-11-29 17:10:01.856206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.856360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.856386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.690 [2024-11-29 17:10:01.856406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.690 [2024-11-29 17:10:01.856582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.690 [2024-11-29 17:10:01.856709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.690 [2024-11-29 17:10:01.856731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.690 [2024-11-29 17:10:01.856750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.690 [2024-11-29 17:10:01.858643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.690 [2024-11-29 17:10:01.868204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.690 [2024-11-29 17:10:01.868501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.868634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.868660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.690 [2024-11-29 17:10:01.868677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.690 [2024-11-29 17:10:01.868811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.690 [2024-11-29 17:10:01.869015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.690 [2024-11-29 17:10:01.869037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.690 [2024-11-29 17:10:01.869052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.690 [2024-11-29 17:10:01.871209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.690 [2024-11-29 17:10:01.880536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.690 [2024-11-29 17:10:01.880771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.880867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.880892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.690 [2024-11-29 17:10:01.880908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.690 [2024-11-29 17:10:01.881081] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.690 [2024-11-29 17:10:01.881219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.690 [2024-11-29 17:10:01.881240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.690 [2024-11-29 17:10:01.881269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.690 [2024-11-29 17:10:01.883157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.690 [2024-11-29 17:10:01.892757] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.690 [2024-11-29 17:10:01.893015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.893116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.893142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.690 [2024-11-29 17:10:01.893157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.690 [2024-11-29 17:10:01.893290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.690 [2024-11-29 17:10:01.893456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.690 [2024-11-29 17:10:01.893476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.690 [2024-11-29 17:10:01.893489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.690 [2024-11-29 17:10:01.895411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.690 [2024-11-29 17:10:01.905114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.690 [2024-11-29 17:10:01.905476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.905603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.905630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.690 [2024-11-29 17:10:01.905646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.690 [2024-11-29 17:10:01.905779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.690 [2024-11-29 17:10:01.906004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.690 [2024-11-29 17:10:01.906026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.690 [2024-11-29 17:10:01.906040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.690 [2024-11-29 17:10:01.908246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.690 [2024-11-29 17:10:01.917367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.690 [2024-11-29 17:10:01.917612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.917739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.917765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.690 [2024-11-29 17:10:01.917781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.690 [2024-11-29 17:10:01.917914] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.690 [2024-11-29 17:10:01.918061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.690 [2024-11-29 17:10:01.918082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.690 [2024-11-29 17:10:01.918096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.690 [2024-11-29 17:10:01.920313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.690 [2024-11-29 17:10:01.929737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.690 [2024-11-29 17:10:01.930063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.930186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.690 [2024-11-29 17:10:01.930212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.690 [2024-11-29 17:10:01.930228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.690 [2024-11-29 17:10:01.930360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.690 [2024-11-29 17:10:01.930555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.690 [2024-11-29 17:10:01.930576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:01.930589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:01.932436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:01.941988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:01.942250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.942372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.942397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.691 [2024-11-29 17:10:01.942413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.691 [2024-11-29 17:10:01.942546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.691 [2024-11-29 17:10:01.942692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.691 [2024-11-29 17:10:01.942712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:01.942725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:01.944914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:01.954129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:01.954452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.954566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.954592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.691 [2024-11-29 17:10:01.954607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.691 [2024-11-29 17:10:01.954787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.691 [2024-11-29 17:10:01.954903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.691 [2024-11-29 17:10:01.954923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:01.954936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:01.957152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:01.966210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:01.966532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.966649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.966674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.691 [2024-11-29 17:10:01.966690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.691 [2024-11-29 17:10:01.966839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.691 [2024-11-29 17:10:01.967044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.691 [2024-11-29 17:10:01.967066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:01.967080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:01.969223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:01.978546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:01.978832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.978967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.978994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.691 [2024-11-29 17:10:01.979009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.691 [2024-11-29 17:10:01.979142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.691 [2024-11-29 17:10:01.979277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.691 [2024-11-29 17:10:01.979296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:01.979310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:01.981336] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:01.990825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:01.991101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.991214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:01.991244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.691 [2024-11-29 17:10:01.991260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.691 [2024-11-29 17:10:01.991377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.691 [2024-11-29 17:10:01.991527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.691 [2024-11-29 17:10:01.991547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:01.991560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:01.993755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:02.003281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:02.003584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:02.003699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:02.003724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.691 [2024-11-29 17:10:02.003740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.691 [2024-11-29 17:10:02.003873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.691 [2024-11-29 17:10:02.004064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.691 [2024-11-29 17:10:02.004085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:02.004099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:02.006144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:02.015508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:02.015782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:02.015890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:02.015916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.691 [2024-11-29 17:10:02.015932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.691 [2024-11-29 17:10:02.016072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.691 [2024-11-29 17:10:02.016284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.691 [2024-11-29 17:10:02.016304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:02.016317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:02.018304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:02.027789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:02.028062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:02.028188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:02.028214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.691 [2024-11-29 17:10:02.028236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.691 [2024-11-29 17:10:02.028464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.691 [2024-11-29 17:10:02.028654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.691 [2024-11-29 17:10:02.028675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:02.028688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:02.030637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:02.040105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:02.040445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:02.040559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:02.040585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.691 [2024-11-29 17:10:02.040601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.691 [2024-11-29 17:10:02.040749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.691 [2024-11-29 17:10:02.040971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.691 [2024-11-29 17:10:02.040993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.691 [2024-11-29 17:10:02.041007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.691 [2024-11-29 17:10:02.043000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.691 [2024-11-29 17:10:02.052449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.691 [2024-11-29 17:10:02.052781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.691 [2024-11-29 17:10:02.052896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.052922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.692 [2024-11-29 17:10:02.052938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.692 [2024-11-29 17:10:02.053110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.692 [2024-11-29 17:10:02.053295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.692 [2024-11-29 17:10:02.053330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.692 [2024-11-29 17:10:02.053344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.692 [2024-11-29 17:10:02.055287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.692 [2024-11-29 17:10:02.064791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.692 [2024-11-29 17:10:02.065070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.065193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.065220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.692 [2024-11-29 17:10:02.065236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.692 [2024-11-29 17:10:02.065383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.692 [2024-11-29 17:10:02.065550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.692 [2024-11-29 17:10:02.065571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.692 [2024-11-29 17:10:02.065584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.692 [2024-11-29 17:10:02.067597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.692 [2024-11-29 17:10:02.077115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.692 [2024-11-29 17:10:02.077387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.077528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.077561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.692 [2024-11-29 17:10:02.077577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.692 [2024-11-29 17:10:02.077709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.692 [2024-11-29 17:10:02.077875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.692 [2024-11-29 17:10:02.077896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.692 [2024-11-29 17:10:02.077909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.692 [2024-11-29 17:10:02.079929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.692 [2024-11-29 17:10:02.089578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.692 [2024-11-29 17:10:02.089905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.090045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.090072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.692 [2024-11-29 17:10:02.090088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.692 [2024-11-29 17:10:02.090269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.692 [2024-11-29 17:10:02.090390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.692 [2024-11-29 17:10:02.090412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.692 [2024-11-29 17:10:02.090425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.692 [2024-11-29 17:10:02.092651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.692 [2024-11-29 17:10:02.101976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.692 [2024-11-29 17:10:02.102181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.102281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.102307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.692 [2024-11-29 17:10:02.102323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.692 [2024-11-29 17:10:02.102488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.692 [2024-11-29 17:10:02.102643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.692 [2024-11-29 17:10:02.102663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.692 [2024-11-29 17:10:02.102676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.692 [2024-11-29 17:10:02.104892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.692 [2024-11-29 17:10:02.114281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.692 [2024-11-29 17:10:02.114542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.114674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.692 [2024-11-29 17:10:02.114700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.692 [2024-11-29 17:10:02.114716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.692 [2024-11-29 17:10:02.114897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.692 [2024-11-29 17:10:02.115042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.692 [2024-11-29 17:10:02.115063] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.692 [2024-11-29 17:10:02.115077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.692 [2024-11-29 17:10:02.116985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.952 [2024-11-29 17:10:02.126540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.952 [2024-11-29 17:10:02.126763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.952 [2024-11-29 17:10:02.126924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.952 [2024-11-29 17:10:02.126949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.952 [2024-11-29 17:10:02.126975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.952 [2024-11-29 17:10:02.127157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.952 [2024-11-29 17:10:02.127353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.952 [2024-11-29 17:10:02.127374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.952 [2024-11-29 17:10:02.127386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.952 [2024-11-29 17:10:02.129447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.952 [2024-11-29 17:10:02.138775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.952 [2024-11-29 17:10:02.139105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.952 [2024-11-29 17:10:02.139224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.952 [2024-11-29 17:10:02.139250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.952 [2024-11-29 17:10:02.139265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.952 [2024-11-29 17:10:02.139447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.952 [2024-11-29 17:10:02.139608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.952 [2024-11-29 17:10:02.139633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.952 [2024-11-29 17:10:02.139647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.952 [2024-11-29 17:10:02.141769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.952 [2024-11-29 17:10:02.151097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.952 [2024-11-29 17:10:02.151369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.952 [2024-11-29 17:10:02.151461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.952 [2024-11-29 17:10:02.151488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.952 [2024-11-29 17:10:02.151504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.952 [2024-11-29 17:10:02.151654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.952 [2024-11-29 17:10:02.151802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.952 [2024-11-29 17:10:02.151822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.952 [2024-11-29 17:10:02.151835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.952 [2024-11-29 17:10:02.154047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.952 [2024-11-29 17:10:02.163467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.952 [2024-11-29 17:10:02.163783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.163866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.163891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.953 [2024-11-29 17:10:02.163907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.953 [2024-11-29 17:10:02.164066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.953 [2024-11-29 17:10:02.164233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.953 [2024-11-29 17:10:02.164254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.953 [2024-11-29 17:10:02.164282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.953 [2024-11-29 17:10:02.166303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.953 [2024-11-29 17:10:02.175790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.953 [2024-11-29 17:10:02.176150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.176248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.176275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.953 [2024-11-29 17:10:02.176291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.953 [2024-11-29 17:10:02.176440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.953 [2024-11-29 17:10:02.176649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.953 [2024-11-29 17:10:02.176669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.953 [2024-11-29 17:10:02.176687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.953 [2024-11-29 17:10:02.178785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.953 [2024-11-29 17:10:02.188167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.953 [2024-11-29 17:10:02.188484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.188607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.188633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.953 [2024-11-29 17:10:02.188648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.953 [2024-11-29 17:10:02.188797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.953 [2024-11-29 17:10:02.189001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.953 [2024-11-29 17:10:02.189030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.953 [2024-11-29 17:10:02.189043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.953 [2024-11-29 17:10:02.191081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.953 [2024-11-29 17:10:02.200401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.953 [2024-11-29 17:10:02.200691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.200810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.200836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.953 [2024-11-29 17:10:02.200852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.953 [2024-11-29 17:10:02.200977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.953 [2024-11-29 17:10:02.201151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.953 [2024-11-29 17:10:02.201172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.953 [2024-11-29 17:10:02.201184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.953 [2024-11-29 17:10:02.203204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.953 [2024-11-29 17:10:02.212595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.953 [2024-11-29 17:10:02.212927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.213103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.213130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.953 [2024-11-29 17:10:02.213146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.953 [2024-11-29 17:10:02.213295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.953 [2024-11-29 17:10:02.213492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.953 [2024-11-29 17:10:02.213512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.953 [2024-11-29 17:10:02.213525] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.953 [2024-11-29 17:10:02.215644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.953 [2024-11-29 17:10:02.224797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.953 [2024-11-29 17:10:02.225098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.225185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.225210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.953 [2024-11-29 17:10:02.225226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.953 [2024-11-29 17:10:02.225375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.953 [2024-11-29 17:10:02.225586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.953 [2024-11-29 17:10:02.225606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.953 [2024-11-29 17:10:02.225619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.953 [2024-11-29 17:10:02.227714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.953 [2024-11-29 17:10:02.237166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.953 [2024-11-29 17:10:02.237471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.237590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.237616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.953 [2024-11-29 17:10:02.237631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.953 [2024-11-29 17:10:02.237780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.953 [2024-11-29 17:10:02.237982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.953 [2024-11-29 17:10:02.238003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.953 [2024-11-29 17:10:02.238031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.953 [2024-11-29 17:10:02.240254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.953 [2024-11-29 17:10:02.249517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.953 [2024-11-29 17:10:02.249835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.249951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.953 [2024-11-29 17:10:02.249983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.953 [2024-11-29 17:10:02.249999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.953 [2024-11-29 17:10:02.250148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.953 [2024-11-29 17:10:02.250329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.953 [2024-11-29 17:10:02.250348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.953 [2024-11-29 17:10:02.250362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.953 [2024-11-29 17:10:02.252418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.953 [2024-11-29 17:10:02.261858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.953 [2024-11-29 17:10:02.262194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.262314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.262340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.954 [2024-11-29 17:10:02.262356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.954 [2024-11-29 17:10:02.262552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.954 [2024-11-29 17:10:02.262727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.954 [2024-11-29 17:10:02.262747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.954 [2024-11-29 17:10:02.262760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.954 [2024-11-29 17:10:02.264980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.954 [2024-11-29 17:10:02.274089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.954 [2024-11-29 17:10:02.274406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.274546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.274572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.954 [2024-11-29 17:10:02.274587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.954 [2024-11-29 17:10:02.274735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.954 [2024-11-29 17:10:02.274928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.954 [2024-11-29 17:10:02.274949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.954 [2024-11-29 17:10:02.274987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.954 [2024-11-29 17:10:02.277058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.954 [2024-11-29 17:10:02.286462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.954 [2024-11-29 17:10:02.286713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.286793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.286819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.954 [2024-11-29 17:10:02.286834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.954 [2024-11-29 17:10:02.286992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.954 [2024-11-29 17:10:02.287140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.954 [2024-11-29 17:10:02.287160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.954 [2024-11-29 17:10:02.287173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.954 [2024-11-29 17:10:02.289256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.954 [2024-11-29 17:10:02.298587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.954 [2024-11-29 17:10:02.298860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.298975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.299003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.954 [2024-11-29 17:10:02.299019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.954 [2024-11-29 17:10:02.299167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.954 [2024-11-29 17:10:02.299316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.954 [2024-11-29 17:10:02.299337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.954 [2024-11-29 17:10:02.299350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.954 [2024-11-29 17:10:02.301255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.954 [2024-11-29 17:10:02.311044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.954 [2024-11-29 17:10:02.311313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.311436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.311462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.954 [2024-11-29 17:10:02.311478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.954 [2024-11-29 17:10:02.311594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.954 [2024-11-29 17:10:02.311746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.954 [2024-11-29 17:10:02.311781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.954 [2024-11-29 17:10:02.311794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.954 [2024-11-29 17:10:02.313801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.954 [2024-11-29 17:10:02.323232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.954 [2024-11-29 17:10:02.323482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.323617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.323643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.954 [2024-11-29 17:10:02.323659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.954 [2024-11-29 17:10:02.323791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.954 [2024-11-29 17:10:02.324027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.954 [2024-11-29 17:10:02.324049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.954 [2024-11-29 17:10:02.324063] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.954 [2024-11-29 17:10:02.326273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.954 [2024-11-29 17:10:02.335538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.954 [2024-11-29 17:10:02.335752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.335886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.335912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.954 [2024-11-29 17:10:02.335927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.954 [2024-11-29 17:10:02.336102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.954 [2024-11-29 17:10:02.336266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.954 [2024-11-29 17:10:02.336286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.954 [2024-11-29 17:10:02.336298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.954 [2024-11-29 17:10:02.338280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.954 [2024-11-29 17:10:02.347733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.954 [2024-11-29 17:10:02.348028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.348142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.348168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.954 [2024-11-29 17:10:02.348184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.954 [2024-11-29 17:10:02.348317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.954 [2024-11-29 17:10:02.348471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.954 [2024-11-29 17:10:02.348492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.954 [2024-11-29 17:10:02.348506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.954 [2024-11-29 17:10:02.350548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.954 [2024-11-29 17:10:02.360164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.954 [2024-11-29 17:10:02.360547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.360659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.954 [2024-11-29 17:10:02.360684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.954 [2024-11-29 17:10:02.360700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.955 [2024-11-29 17:10:02.360832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.955 [2024-11-29 17:10:02.361040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.955 [2024-11-29 17:10:02.361063] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.955 [2024-11-29 17:10:02.361077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.955 [2024-11-29 17:10:02.363140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:50.955 [2024-11-29 17:10:02.372578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:50.955 [2024-11-29 17:10:02.372866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.955 [2024-11-29 17:10:02.372985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.955 [2024-11-29 17:10:02.373012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:50.955 [2024-11-29 17:10:02.373033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:50.955 [2024-11-29 17:10:02.373167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:50.955 [2024-11-29 17:10:02.373366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:50.955 [2024-11-29 17:10:02.373386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:50.955 [2024-11-29 17:10:02.373399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:50.955 [2024-11-29 17:10:02.375496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.216 [2024-11-29 17:10:02.384967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.216 [2024-11-29 17:10:02.385218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.216 [2024-11-29 17:10:02.385330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.216 [2024-11-29 17:10:02.385356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.216 [2024-11-29 17:10:02.385371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.216 [2024-11-29 17:10:02.385488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.216 [2024-11-29 17:10:02.385668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.216 [2024-11-29 17:10:02.385688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.216 [2024-11-29 17:10:02.385701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.216 [2024-11-29 17:10:02.387792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.216 [2024-11-29 17:10:02.397484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.216 [2024-11-29 17:10:02.397750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.216 [2024-11-29 17:10:02.397863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.216 [2024-11-29 17:10:02.397888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.216 [2024-11-29 17:10:02.397904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.216 [2024-11-29 17:10:02.398079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.216 [2024-11-29 17:10:02.398217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.216 [2024-11-29 17:10:02.398254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.216 [2024-11-29 17:10:02.398267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.216 [2024-11-29 17:10:02.400388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.216 [2024-11-29 17:10:02.409741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.216 [2024-11-29 17:10:02.410050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.216 [2024-11-29 17:10:02.410147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.216 [2024-11-29 17:10:02.410173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.216 [2024-11-29 17:10:02.410188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.216 [2024-11-29 17:10:02.410329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.216 [2024-11-29 17:10:02.410480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.216 [2024-11-29 17:10:02.410501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.216 [2024-11-29 17:10:02.410514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.216 [2024-11-29 17:10:02.412707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.216 [2024-11-29 17:10:02.422069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.216 [2024-11-29 17:10:02.422363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.216 [2024-11-29 17:10:02.422456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.216 [2024-11-29 17:10:02.422482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.216 [2024-11-29 17:10:02.422497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.216 [2024-11-29 17:10:02.422630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.216 [2024-11-29 17:10:02.422810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.216 [2024-11-29 17:10:02.422830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.216 [2024-11-29 17:10:02.422843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.216 [2024-11-29 17:10:02.424866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.216 [2024-11-29 17:10:02.434539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.216 [2024-11-29 17:10:02.434915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.216 [2024-11-29 17:10:02.435071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.435098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.217 [2024-11-29 17:10:02.435114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.217 [2024-11-29 17:10:02.435215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.217 [2024-11-29 17:10:02.435349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.217 [2024-11-29 17:10:02.435385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.217 [2024-11-29 17:10:02.435399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.217 [2024-11-29 17:10:02.437520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.217 [2024-11-29 17:10:02.446877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.217 [2024-11-29 17:10:02.447161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.447277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.447303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.217 [2024-11-29 17:10:02.447319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.217 [2024-11-29 17:10:02.447436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.217 [2024-11-29 17:10:02.447620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.217 [2024-11-29 17:10:02.447640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.217 [2024-11-29 17:10:02.447653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.217 [2024-11-29 17:10:02.449756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.217 [2024-11-29 17:10:02.459169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.217 [2024-11-29 17:10:02.459566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.459684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.459710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.217 [2024-11-29 17:10:02.459726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.217 [2024-11-29 17:10:02.459843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.217 [2024-11-29 17:10:02.460051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.217 [2024-11-29 17:10:02.460072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.217 [2024-11-29 17:10:02.460086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.217 [2024-11-29 17:10:02.462118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.217 [2024-11-29 17:10:02.471290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.217 [2024-11-29 17:10:02.471565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.471707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.471733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.217 [2024-11-29 17:10:02.471749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.217 [2024-11-29 17:10:02.471915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.217 [2024-11-29 17:10:02.472055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.217 [2024-11-29 17:10:02.472076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.217 [2024-11-29 17:10:02.472090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.217 [2024-11-29 17:10:02.474097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.217 [2024-11-29 17:10:02.483687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.217 [2024-11-29 17:10:02.484049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.484162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.484189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.217 [2024-11-29 17:10:02.484206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.217 [2024-11-29 17:10:02.484372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.217 [2024-11-29 17:10:02.484550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.217 [2024-11-29 17:10:02.484575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.217 [2024-11-29 17:10:02.484589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.217 [2024-11-29 17:10:02.486593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.217 [2024-11-29 17:10:02.495873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.217 [2024-11-29 17:10:02.496152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.496279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.496305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.217 [2024-11-29 17:10:02.496321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.217 [2024-11-29 17:10:02.496436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.217 [2024-11-29 17:10:02.496588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.217 [2024-11-29 17:10:02.496607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.217 [2024-11-29 17:10:02.496620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.217 [2024-11-29 17:10:02.498712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.217 [2024-11-29 17:10:02.508100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.217 [2024-11-29 17:10:02.508399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.508514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.217 [2024-11-29 17:10:02.508541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.218 [2024-11-29 17:10:02.508557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.218 [2024-11-29 17:10:02.508657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.218 [2024-11-29 17:10:02.508809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.218 [2024-11-29 17:10:02.508845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.218 [2024-11-29 17:10:02.508858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.218 [2024-11-29 17:10:02.511000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.218 [2024-11-29 17:10:02.520302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.218 [2024-11-29 17:10:02.520592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 [2024-11-29 17:10:02.520702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 [2024-11-29 17:10:02.520728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.218 [2024-11-29 17:10:02.520744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.218 [2024-11-29 17:10:02.520908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.218 [2024-11-29 17:10:02.521086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.218 [2024-11-29 17:10:02.521109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.218 [2024-11-29 17:10:02.521128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.218 [2024-11-29 17:10:02.523331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.218 [2024-11-29 17:10:02.532774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.218 [2024-11-29 17:10:02.533079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 [2024-11-29 17:10:02.533174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 [2024-11-29 17:10:02.533200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.218 [2024-11-29 17:10:02.533216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.218 [2024-11-29 17:10:02.533365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.218 [2024-11-29 17:10:02.533544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.218 [2024-11-29 17:10:02.533564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.218 [2024-11-29 17:10:02.533577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.218 [2024-11-29 17:10:02.535501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.218 [2024-11-29 17:10:02.544953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.218 [2024-11-29 17:10:02.545239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 [2024-11-29 17:10:02.545326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 [2024-11-29 17:10:02.545352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.218 [2024-11-29 17:10:02.545368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.218 [2024-11-29 17:10:02.545533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.218 [2024-11-29 17:10:02.545683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.218 [2024-11-29 17:10:02.545703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.218 [2024-11-29 17:10:02.545717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.218 [2024-11-29 17:10:02.547706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.218 17:10:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:51.218 17:10:02 -- common/autotest_common.sh@862 -- # return 0 00:27:51.218 [2024-11-29 17:10:02.557186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.218 17:10:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:51.218 17:10:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:51.218 [2024-11-29 17:10:02.557495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 17:10:02 -- common/autotest_common.sh@10 -- # set +x 00:27:51.218 [2024-11-29 17:10:02.557587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 [2024-11-29 17:10:02.557613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.218 [2024-11-29 17:10:02.557629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.218 [2024-11-29 17:10:02.557793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.218 [2024-11-29 17:10:02.558003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.218 [2024-11-29 17:10:02.558030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.218 [2024-11-29 17:10:02.558045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.218 [2024-11-29 17:10:02.560347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.218 [2024-11-29 17:10:02.569413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.218 [2024-11-29 17:10:02.569773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 [2024-11-29 17:10:02.569891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.218 [2024-11-29 17:10:02.569917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.218 [2024-11-29 17:10:02.569934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.218 [2024-11-29 17:10:02.570075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.218 [2024-11-29 17:10:02.570213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.218 [2024-11-29 17:10:02.570234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.218 [2024-11-29 17:10:02.570263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.218 [2024-11-29 17:10:02.572160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.218 17:10:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:51.219 [2024-11-29 17:10:02.581752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.219 17:10:02 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:51.219 [2024-11-29 17:10:02.582048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 17:10:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:51.219 [2024-11-29 17:10:02.582191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.582217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.219 [2024-11-29 17:10:02.582233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.219 17:10:02 -- common/autotest_common.sh@10 -- # set +x 00:27:51.219 [2024-11-29 17:10:02.582398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.219 [2024-11-29 17:10:02.582577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.219 [2024-11-29 17:10:02.582597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.219 [2024-11-29 17:10:02.582610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.219 [2024-11-29 17:10:02.584580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.219 [2024-11-29 17:10:02.588352] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:51.219 17:10:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:51.219 17:10:02 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:51.219 17:10:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:51.219 [2024-11-29 17:10:02.594377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.219 17:10:02 -- common/autotest_common.sh@10 -- # set +x 00:27:51.219 [2024-11-29 17:10:02.594647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.594741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.594771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.219 [2024-11-29 17:10:02.594788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.219 [2024-11-29 17:10:02.594904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.219 [2024-11-29 17:10:02.595099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.219 [2024-11-29 17:10:02.595121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.219 [2024-11-29 17:10:02.595135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.219 [2024-11-29 17:10:02.597376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.219 [2024-11-29 17:10:02.606780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.219 [2024-11-29 17:10:02.607080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.607167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.607193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.219 [2024-11-29 17:10:02.607209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.219 [2024-11-29 17:10:02.607361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.219 [2024-11-29 17:10:02.607547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.219 [2024-11-29 17:10:02.607568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.219 [2024-11-29 17:10:02.607582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.219 [2024-11-29 17:10:02.609626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.219 [2024-11-29 17:10:02.619189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.219 [2024-11-29 17:10:02.619681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.619830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.619857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.219 [2024-11-29 17:10:02.619878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.219 [2024-11-29 17:10:02.620036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.219 [2024-11-29 17:10:02.620260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.219 [2024-11-29 17:10:02.620283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.219 [2024-11-29 17:10:02.620316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.219 [2024-11-29 17:10:02.622386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.219 Malloc0 00:27:51.219 17:10:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:51.219 17:10:02 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:51.219 17:10:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:51.219 17:10:02 -- common/autotest_common.sh@10 -- # set +x 00:27:51.219 [2024-11-29 17:10:02.631730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.219 [2024-11-29 17:10:02.632027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.632160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.632187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.219 [2024-11-29 17:10:02.632204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.219 [2024-11-29 17:10:02.632324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.219 [2024-11-29 17:10:02.632504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.219 [2024-11-29 17:10:02.632525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.219 [2024-11-29 17:10:02.632538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.219 [2024-11-29 17:10:02.634753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.219 17:10:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:51.219 17:10:02 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:51.219 17:10:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:51.219 17:10:02 -- common/autotest_common.sh@10 -- # set +x 00:27:51.219 [2024-11-29 17:10:02.644030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.219 [2024-11-29 17:10:02.644283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.644388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.219 [2024-11-29 17:10:02.644414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1996160 with addr=10.0.0.2, port=4420 00:27:51.220 [2024-11-29 17:10:02.644430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1996160 is same with the state(5) to be set 00:27:51.220 17:10:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:51.220 [2024-11-29 17:10:02.644580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1996160 (9): Bad file descriptor 00:27:51.478 17:10:02 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:51.478 [2024-11-29 17:10:02.644734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:51.478 [2024-11-29 17:10:02.644755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:51.478 [2024-11-29 17:10:02.644769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:51.478 17:10:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:51.478 17:10:02 -- common/autotest_common.sh@10 -- # set +x 00:27:51.478 [2024-11-29 17:10:02.646867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:51.478 [2024-11-29 17:10:02.648549] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:51.478 17:10:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:51.478 17:10:02 -- host/bdevperf.sh@38 -- # wait 324436 00:27:51.478 [2024-11-29 17:10:02.656378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:51.478 [2024-11-29 17:10:02.684210] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:01.446 00:28:01.446 Latency(us) 00:28:01.446 [2024-11-29T16:10:12.877Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:01.446 [2024-11-29T16:10:12.877Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:01.446 Verification LBA range: start 0x0 length 0x4000 00:28:01.446 Nvme1n1 : 15.01 8826.49 34.48 15802.14 0.00 5182.28 813.13 20388.98 00:28:01.446 [2024-11-29T16:10:12.877Z] =================================================================================================================== 00:28:01.446 [2024-11-29T16:10:12.877Z] Total : 8826.49 34.48 15802.14 0.00 5182.28 813.13 20388.98 00:28:01.446 17:10:11 -- host/bdevperf.sh@39 -- # sync 00:28:01.446 17:10:11 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:01.446 17:10:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:01.446 17:10:11 -- common/autotest_common.sh@10 -- # set +x 00:28:01.446 17:10:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:01.446 17:10:11 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:28:01.446 17:10:11 -- host/bdevperf.sh@44 -- # nvmftestfini 00:28:01.446 17:10:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:01.446 17:10:11 -- nvmf/common.sh@116 -- # sync 00:28:01.446 17:10:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:01.446 17:10:11 -- nvmf/common.sh@119 -- # set +e 00:28:01.446 17:10:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:01.446 17:10:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:01.446 rmmod nvme_tcp 00:28:01.446 rmmod nvme_fabrics 00:28:01.446 rmmod nvme_keyring 00:28:01.446 17:10:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:01.446 17:10:11 -- nvmf/common.sh@123 -- # set -e 00:28:01.446 17:10:11 -- nvmf/common.sh@124 -- # return 0 00:28:01.446 17:10:11 -- nvmf/common.sh@477 -- # '[' -n 325125 ']' 00:28:01.446 17:10:11 -- nvmf/common.sh@478 -- # killprocess 325125 00:28:01.446 17:10:11 -- common/autotest_common.sh@936 -- # '[' -z 325125 ']' 00:28:01.446 17:10:11 -- common/autotest_common.sh@940 -- # kill -0 325125 00:28:01.446 17:10:11 -- common/autotest_common.sh@941 -- # uname 00:28:01.446 17:10:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:01.446 17:10:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 325125 00:28:01.446 17:10:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:01.446 17:10:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:01.446 17:10:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 325125' 00:28:01.446 killing process with pid 325125 00:28:01.446 17:10:11 -- common/autotest_common.sh@955 -- # kill 325125 00:28:01.446 17:10:11 -- common/autotest_common.sh@960 -- # wait 325125 00:28:01.446 17:10:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:01.446 17:10:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:01.446 17:10:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:01.446 17:10:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:01.446 17:10:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:01.446 17:10:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:01.446 17:10:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:01.446 17:10:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:02.381 17:10:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:02.381 00:28:02.381 real 0m23.294s 00:28:02.381 user 1m2.160s 00:28:02.381 sys 0m4.659s 00:28:02.381 17:10:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:02.381 17:10:13 -- common/autotest_common.sh@10 -- # set +x 00:28:02.381 ************************************ 00:28:02.381 END TEST nvmf_bdevperf 00:28:02.381 ************************************ 00:28:02.381 17:10:13 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:28:02.381 17:10:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:02.381 17:10:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:02.381 17:10:13 -- common/autotest_common.sh@10 -- # set +x 00:28:02.381 ************************************ 00:28:02.381 START TEST nvmf_target_disconnect 00:28:02.381 ************************************ 00:28:02.381 17:10:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:28:02.381 * Looking for test storage... 00:28:02.381 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:02.381 17:10:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:02.381 17:10:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:02.381 17:10:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:02.640 17:10:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:02.640 17:10:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:02.640 17:10:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:02.640 17:10:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:02.640 17:10:13 -- scripts/common.sh@335 -- # IFS=.-: 00:28:02.640 17:10:13 -- scripts/common.sh@335 -- # read -ra ver1 00:28:02.640 17:10:13 -- scripts/common.sh@336 -- # IFS=.-: 00:28:02.640 17:10:13 -- scripts/common.sh@336 -- # read -ra ver2 00:28:02.640 17:10:13 -- scripts/common.sh@337 -- # local 'op=<' 00:28:02.640 17:10:13 -- scripts/common.sh@339 -- # ver1_l=2 00:28:02.640 17:10:13 -- scripts/common.sh@340 -- # ver2_l=1 00:28:02.640 17:10:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:02.640 17:10:13 -- scripts/common.sh@343 -- # case "$op" in 00:28:02.640 17:10:13 -- scripts/common.sh@344 -- # : 1 00:28:02.640 17:10:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:02.640 17:10:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:02.640 17:10:13 -- scripts/common.sh@364 -- # decimal 1 00:28:02.640 17:10:13 -- scripts/common.sh@352 -- # local d=1 00:28:02.640 17:10:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:02.640 17:10:13 -- scripts/common.sh@354 -- # echo 1 00:28:02.640 17:10:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:02.640 17:10:13 -- scripts/common.sh@365 -- # decimal 2 00:28:02.640 17:10:13 -- scripts/common.sh@352 -- # local d=2 00:28:02.640 17:10:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:02.640 17:10:13 -- scripts/common.sh@354 -- # echo 2 00:28:02.640 17:10:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:02.640 17:10:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:02.640 17:10:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:02.640 17:10:13 -- scripts/common.sh@367 -- # return 0 00:28:02.640 17:10:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:02.640 17:10:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:02.640 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.640 --rc genhtml_branch_coverage=1 00:28:02.640 --rc genhtml_function_coverage=1 00:28:02.640 --rc genhtml_legend=1 00:28:02.640 --rc geninfo_all_blocks=1 00:28:02.640 --rc geninfo_unexecuted_blocks=1 00:28:02.640 00:28:02.640 ' 00:28:02.640 17:10:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:02.640 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.640 --rc genhtml_branch_coverage=1 00:28:02.640 --rc genhtml_function_coverage=1 00:28:02.640 --rc genhtml_legend=1 00:28:02.640 --rc geninfo_all_blocks=1 00:28:02.640 --rc geninfo_unexecuted_blocks=1 00:28:02.640 00:28:02.640 ' 00:28:02.640 17:10:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:02.640 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.640 --rc genhtml_branch_coverage=1 00:28:02.640 --rc genhtml_function_coverage=1 00:28:02.640 --rc genhtml_legend=1 00:28:02.640 --rc geninfo_all_blocks=1 00:28:02.640 --rc geninfo_unexecuted_blocks=1 00:28:02.640 00:28:02.640 ' 00:28:02.640 17:10:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:02.640 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.640 --rc genhtml_branch_coverage=1 00:28:02.640 --rc genhtml_function_coverage=1 00:28:02.640 --rc genhtml_legend=1 00:28:02.640 --rc geninfo_all_blocks=1 00:28:02.640 --rc geninfo_unexecuted_blocks=1 00:28:02.640 00:28:02.640 ' 00:28:02.640 17:10:13 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:02.640 17:10:13 -- nvmf/common.sh@7 -- # uname -s 00:28:02.640 17:10:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:02.640 17:10:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:02.640 17:10:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:02.640 17:10:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:02.640 17:10:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:02.640 17:10:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:02.640 17:10:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:02.640 17:10:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:02.640 17:10:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:02.640 17:10:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:02.640 17:10:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:02.640 17:10:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:02.640 17:10:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:02.640 17:10:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:02.640 17:10:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:02.640 17:10:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:02.640 17:10:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:02.640 17:10:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:02.640 17:10:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:02.640 17:10:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.640 17:10:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.640 17:10:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.640 17:10:13 -- paths/export.sh@5 -- # export PATH 00:28:02.640 17:10:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.640 17:10:13 -- nvmf/common.sh@46 -- # : 0 00:28:02.640 17:10:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:02.641 17:10:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:02.641 17:10:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:02.641 17:10:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:02.641 17:10:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:02.641 17:10:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:02.641 17:10:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:02.641 17:10:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:02.641 17:10:13 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:28:02.641 17:10:13 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:28:02.641 17:10:13 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:28:02.641 17:10:13 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:28:02.641 17:10:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:02.641 17:10:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:02.641 17:10:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:02.641 17:10:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:02.641 17:10:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:02.641 17:10:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:02.641 17:10:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:02.641 17:10:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:02.641 17:10:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:02.641 17:10:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:02.641 17:10:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:02.641 17:10:13 -- common/autotest_common.sh@10 -- # set +x 00:28:05.171 17:10:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:05.171 17:10:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:05.171 17:10:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:05.171 17:10:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:05.171 17:10:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:05.171 17:10:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:05.171 17:10:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:05.171 17:10:16 -- nvmf/common.sh@294 -- # net_devs=() 00:28:05.171 17:10:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:05.171 17:10:16 -- nvmf/common.sh@295 -- # e810=() 00:28:05.171 17:10:16 -- nvmf/common.sh@295 -- # local -ga e810 00:28:05.171 17:10:16 -- nvmf/common.sh@296 -- # x722=() 00:28:05.171 17:10:16 -- nvmf/common.sh@296 -- # local -ga x722 00:28:05.171 17:10:16 -- nvmf/common.sh@297 -- # mlx=() 00:28:05.171 17:10:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:05.172 17:10:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:05.172 17:10:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:05.172 17:10:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:05.172 17:10:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:05.172 17:10:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:05.172 17:10:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:05.172 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:05.172 17:10:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:05.172 17:10:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:05.172 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:05.172 17:10:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:05.172 17:10:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:05.172 17:10:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:05.172 17:10:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:05.172 17:10:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:05.172 17:10:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:05.172 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:05.172 17:10:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:05.172 17:10:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:05.172 17:10:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:05.172 17:10:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:05.172 17:10:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:05.172 17:10:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:05.172 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:05.172 17:10:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:05.172 17:10:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:05.172 17:10:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:05.172 17:10:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:05.172 17:10:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:05.172 17:10:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:05.172 17:10:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:05.172 17:10:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:05.172 17:10:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:05.172 17:10:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:05.172 17:10:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:05.172 17:10:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:05.172 17:10:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:05.172 17:10:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:05.172 17:10:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:05.172 17:10:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:05.172 17:10:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:05.172 17:10:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:05.172 17:10:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:05.172 17:10:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:05.172 17:10:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:05.172 17:10:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:05.172 17:10:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:05.172 17:10:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:05.172 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:05.172 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:28:05.172 00:28:05.172 --- 10.0.0.2 ping statistics --- 00:28:05.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:05.172 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:28:05.172 17:10:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:05.172 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:05.172 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:28:05.172 00:28:05.172 --- 10.0.0.1 ping statistics --- 00:28:05.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:05.172 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:28:05.172 17:10:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:05.172 17:10:16 -- nvmf/common.sh@410 -- # return 0 00:28:05.172 17:10:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:05.172 17:10:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:05.172 17:10:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:05.172 17:10:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:05.172 17:10:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:05.172 17:10:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:05.172 17:10:16 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:28:05.172 17:10:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:05.172 17:10:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:05.172 17:10:16 -- common/autotest_common.sh@10 -- # set +x 00:28:05.172 ************************************ 00:28:05.172 START TEST nvmf_target_disconnect_tc1 00:28:05.172 ************************************ 00:28:05.172 17:10:16 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:28:05.172 17:10:16 -- host/target_disconnect.sh@32 -- # set +e 00:28:05.172 17:10:16 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:05.172 EAL: No free 2048 kB hugepages reported on node 1 00:28:05.172 [2024-11-29 17:10:16.304822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:05.172 [2024-11-29 17:10:16.304997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:05.172 [2024-11-29 17:10:16.305026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1620b40 with addr=10.0.0.2, port=4420 00:28:05.172 [2024-11-29 17:10:16.305067] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:05.172 [2024-11-29 17:10:16.305112] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:05.172 [2024-11-29 17:10:16.305129] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:28:05.172 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:28:05.172 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:28:05.172 Initializing NVMe Controllers 00:28:05.172 17:10:16 -- host/target_disconnect.sh@33 -- # trap - ERR 00:28:05.172 17:10:16 -- host/target_disconnect.sh@33 -- # print_backtrace 00:28:05.172 17:10:16 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:28:05.172 17:10:16 -- common/autotest_common.sh@1142 -- # return 0 00:28:05.172 17:10:16 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:28:05.172 17:10:16 -- host/target_disconnect.sh@41 -- # set -e 00:28:05.172 00:28:05.172 real 0m0.098s 00:28:05.172 user 0m0.036s 00:28:05.172 sys 0m0.061s 00:28:05.172 17:10:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:05.172 17:10:16 -- common/autotest_common.sh@10 -- # set +x 00:28:05.172 ************************************ 00:28:05.172 END TEST nvmf_target_disconnect_tc1 00:28:05.172 ************************************ 00:28:05.172 17:10:16 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:28:05.172 17:10:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:05.172 17:10:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:05.172 17:10:16 -- common/autotest_common.sh@10 -- # set +x 00:28:05.172 ************************************ 00:28:05.172 START TEST nvmf_target_disconnect_tc2 00:28:05.172 ************************************ 00:28:05.172 17:10:16 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:28:05.172 17:10:16 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:28:05.172 17:10:16 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:28:05.172 17:10:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:05.172 17:10:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:05.172 17:10:16 -- common/autotest_common.sh@10 -- # set +x 00:28:05.172 17:10:16 -- nvmf/common.sh@469 -- # nvmfpid=328317 00:28:05.172 17:10:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:28:05.172 17:10:16 -- nvmf/common.sh@470 -- # waitforlisten 328317 00:28:05.172 17:10:16 -- common/autotest_common.sh@829 -- # '[' -z 328317 ']' 00:28:05.172 17:10:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:05.172 17:10:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:05.173 17:10:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:05.173 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:05.173 17:10:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:05.173 17:10:16 -- common/autotest_common.sh@10 -- # set +x 00:28:05.173 [2024-11-29 17:10:16.394497] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:05.173 [2024-11-29 17:10:16.394576] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:05.173 EAL: No free 2048 kB hugepages reported on node 1 00:28:05.173 [2024-11-29 17:10:16.463821] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:05.173 [2024-11-29 17:10:16.575925] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:05.173 [2024-11-29 17:10:16.576073] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:05.173 [2024-11-29 17:10:16.576092] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:05.173 [2024-11-29 17:10:16.576104] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:05.173 [2024-11-29 17:10:16.576210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:28:05.173 [2024-11-29 17:10:16.576251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:28:05.173 [2024-11-29 17:10:16.576342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:28:05.173 [2024-11-29 17:10:16.576346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:28:06.106 17:10:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:06.106 17:10:17 -- common/autotest_common.sh@862 -- # return 0 00:28:06.106 17:10:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:06.106 17:10:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:06.106 17:10:17 -- common/autotest_common.sh@10 -- # set +x 00:28:06.106 17:10:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:06.106 17:10:17 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:06.106 17:10:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.106 17:10:17 -- common/autotest_common.sh@10 -- # set +x 00:28:06.106 Malloc0 00:28:06.106 17:10:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.106 17:10:17 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:28:06.106 17:10:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.106 17:10:17 -- common/autotest_common.sh@10 -- # set +x 00:28:06.106 [2024-11-29 17:10:17.403894] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:06.106 17:10:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.107 17:10:17 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:06.107 17:10:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.107 17:10:17 -- common/autotest_common.sh@10 -- # set +x 00:28:06.107 17:10:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.107 17:10:17 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:06.107 17:10:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.107 17:10:17 -- common/autotest_common.sh@10 -- # set +x 00:28:06.107 17:10:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.107 17:10:17 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:06.107 17:10:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.107 17:10:17 -- common/autotest_common.sh@10 -- # set +x 00:28:06.107 [2024-11-29 17:10:17.432257] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:06.107 17:10:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.107 17:10:17 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:06.107 17:10:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.107 17:10:17 -- common/autotest_common.sh@10 -- # set +x 00:28:06.107 17:10:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.107 17:10:17 -- host/target_disconnect.sh@50 -- # reconnectpid=328476 00:28:06.107 17:10:17 -- host/target_disconnect.sh@52 -- # sleep 2 00:28:06.107 17:10:17 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:06.107 EAL: No free 2048 kB hugepages reported on node 1 00:28:08.663 17:10:19 -- host/target_disconnect.sh@53 -- # kill -9 328317 00:28:08.663 17:10:19 -- host/target_disconnect.sh@55 -- # sleep 2 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 [2024-11-29 17:10:19.458275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Read completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.663 Write completed with error (sct=0, sc=8) 00:28:08.663 starting I/O failed 00:28:08.664 [2024-11-29 17:10:19.458557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 [2024-11-29 17:10:19.458854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Write completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 Read completed with error (sct=0, sc=8) 00:28:08.664 starting I/O failed 00:28:08.664 [2024-11-29 17:10:19.459200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:08.664 [2024-11-29 17:10:19.459504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.459741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.459785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.459954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.460102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.460130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.460223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.460427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.460454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.460620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.460813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.460855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.461017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.461138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.461166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.461309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.461515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.461556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.461711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.461818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.461844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.461938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.462059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.462087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.462180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.462308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.462335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.462477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.462619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.462646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.462784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.462920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.462946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.463058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.463181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.664 [2024-11-29 17:10:19.463206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-29 17:10:19.463368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.463541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.463568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.463717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.463862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.463890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.464009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.464122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.464148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.464240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.464385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.464411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.464525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.464665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.464696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.464873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.465147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.465403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.465664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.465893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.465994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.466115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.466226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.466253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.466338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.466529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.466561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.466794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.466952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.466987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.467104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.467188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.467213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.467326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.467415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.467440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.467583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.467698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.467725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.467860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.468005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.468032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.468124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.468268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.468294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.468387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.468494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.468518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.468604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.468717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.468743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.468850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.468970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.469012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.469126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.469267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.469298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.469440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.469533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.469558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.469649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.469737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.469763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.469900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.470033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.470060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.470143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.470230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.470256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.470372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.470510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.470536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.470653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.470769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.470795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-29 17:10:19.470913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.471071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.665 [2024-11-29 17:10:19.471098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.471243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.471386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.471413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.471490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.471597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.471622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.471731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.471813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.471844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.471930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.472076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.472103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.472216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.472337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.472363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.472512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.472619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.472647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.472731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.472883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.472910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.473035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.473152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.473177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.473302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.473389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.473413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.473552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.473659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.473686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.473812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.473926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.473953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.474099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.474217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.474245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.474385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.474497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.474527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.474640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.474751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.474777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.474912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.475032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.475060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.475221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.475310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.475335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.475424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.475565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.475591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.475713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.475852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.475879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.475999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.476112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.476139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.476257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.476345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.476370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.476482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.476597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.476624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.476768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.476905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.476931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.477057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.477158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.477189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.477350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.477463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.477489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.477603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.477683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.477708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.477856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.477965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.477993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.478075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.478182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.478207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.478320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.478457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.478483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.666 qpair failed and we were unable to recover it. 00:28:08.666 [2024-11-29 17:10:19.478563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.666 [2024-11-29 17:10:19.478698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.478725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.478821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.478898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.478922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.479072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.479181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.479209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.479331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.479437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.479464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.479600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.479726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.479769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.479919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.480068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.480096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.480184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.480313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.480339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.480453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.480544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.480571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.480683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.480792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.480818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.480932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.481018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.481043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.481185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.481325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.481353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.481439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.481548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.481573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.481686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.481803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.481830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.481952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.482105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.482132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.482273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.482353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.482378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.482525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.482605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.482631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.482774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.482928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.482980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.483098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.483215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.483242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.483352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.483482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.483512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.483671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.483786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.483812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.483903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.484022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.484047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.484189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.484329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.484356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.484465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.484588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.484615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.484730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.484841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.484867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.484980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.485097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.485125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.485245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.485356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.485383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.485501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.485584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.485617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.667 [2024-11-29 17:10:19.485703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.485843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.667 [2024-11-29 17:10:19.485877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.667 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.485991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.486100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.486125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.486244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.486387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.486414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.486525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.486636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.486663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.486782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.486894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.486921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.487045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.487162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.487190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.487330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.487435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.487463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.487573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.487674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.487701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.487791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.487903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.487930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.488024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.488118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.488142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.488224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.488361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.488386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.488493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.488631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.488658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.488782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.488903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.488933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.489093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.489208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.489235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.489377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.489492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.489518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.489660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.489771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.489798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.489938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.490041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.490068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.490182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.490271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.490300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.490421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.490566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.490593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.490711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.490818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.490845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.490971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.491087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.491112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.491222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.491330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.491357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.491448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.491521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.491545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.491683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.491789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.491816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.668 qpair failed and we were unable to recover it. 00:28:08.668 [2024-11-29 17:10:19.491967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.492085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.668 [2024-11-29 17:10:19.492112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.492249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.492338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.492364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.492454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.492559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.492583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.492667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.492741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.492766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.492906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.493113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.493363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.493641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.493834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.493976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.494058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.494165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.494189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.494305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.494413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.494440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.494578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.494658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.494685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.494801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.494911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.494938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.495059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.495172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.495199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.495321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.495459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.495486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.495604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.495713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.495740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.495857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.495931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.495963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.496047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.496162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.496186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.496304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.496381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.496406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.496496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.496605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.496632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.496746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.496886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.496912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.497047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.497185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.497211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.497320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.497402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.497426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.497544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.497680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.497706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.497847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.497971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.498000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.498092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.498202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.498229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.498335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.498449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.498476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.498594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.498699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.498725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.498816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.498925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.498966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.669 qpair failed and we were unable to recover it. 00:28:08.669 [2024-11-29 17:10:19.499058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.669 [2024-11-29 17:10:19.499140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.499165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.499279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.499393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.499419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.499544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.499658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.499684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.499820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.499952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.499988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.500098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.500234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.500261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.500378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.500527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.500554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.500696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.500811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.500837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.500954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.501089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.501115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.501260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.501365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.501392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.501503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.501619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.501645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.501761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.501847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.501871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.501970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.502052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.502077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.502161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.502302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.502328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.502459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.502627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.502653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.502769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.502910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.502942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.503039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.503193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.503219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.503352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.503470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.503498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.503631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.503781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.503807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.503918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.504044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.504070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.504185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.504274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.504300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.504397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.504522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.504551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.504661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.504802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.504832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.504948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.505046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.505090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.505223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.505339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.505367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.505478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.505601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.505628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.505708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.505816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.505845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.505942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.506077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.506104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.506187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.506317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.506344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.670 [2024-11-29 17:10:19.506465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.506547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.670 [2024-11-29 17:10:19.506572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.670 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.506680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.506782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.506809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.506918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.507053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.507079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.507170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.507297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.507324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.507410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.507554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.507581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.507666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.507777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.507803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.507946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.508101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.508128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.508231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.508370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.508401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.508511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.508617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.508649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.508763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.508854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.508879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.508999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.509142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.509169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.509297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.509419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.509445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.509557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.509699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.509726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.509844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.509951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.509985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.510114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.510225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.510253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.510344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.510456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.510483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.510592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.510707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.510733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.510874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.511025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.511055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.511143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.511287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.511313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.511413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.511526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.511552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.511666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.511777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.511805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.511922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.512044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.512070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.512175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.512309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.512336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.512451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.512566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.512593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.512710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.512848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.512875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.512986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.513121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.513150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.513317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.513459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.513485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.513590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.513708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.513739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.513829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.513983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.514013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.671 [2024-11-29 17:10:19.514098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.514216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.671 [2024-11-29 17:10:19.514241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.671 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.514383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.514526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.514553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.514672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.514810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.514836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.514951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.515087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.515114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.515264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.515398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.515426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.515549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.515697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.515741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.515855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.515943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.515976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.516092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.516205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.516244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.516357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.516471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.516499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.516597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.516707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.516734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.516823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.516940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.516975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.517082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.517165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.517191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.517340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.517456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.517482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.517612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.517714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.517741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.517836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.517950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.517985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.518117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.518196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.518222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.518334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.518502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.518529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.518642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.518780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.518806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.518932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.519032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.519059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.519157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.519248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.519275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.519388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.519493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.519519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.519628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.519764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.519790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.519907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.520025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.520051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.520146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.520234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.520261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.520376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.520458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.672 [2024-11-29 17:10:19.520482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.672 qpair failed and we were unable to recover it. 00:28:08.672 [2024-11-29 17:10:19.520569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.520653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.520679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.520763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.520904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.520933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.521085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.521197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.521224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.521337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.521454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.521480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.521572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.521691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.521718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.521875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.521982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.522014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.522122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.522266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.522293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.522406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.522488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.522513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.522619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.522707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.522736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.522857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.522967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.522993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.523107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.523246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.523273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.523382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.523483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.523510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.523621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.523729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.523756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.523870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.523981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.524007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.524157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.524241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.524266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.524373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.524450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.524474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.524617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.524723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.524749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.524878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.524973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.525002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.525106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.525246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.525272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.525412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.525529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.525556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.525670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.525746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.525770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.525856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.525986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.526014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.526151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.526277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.526304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.526447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.526562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.526589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.526742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.526867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.526897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.527067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.527156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.527181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.527291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.527438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.527465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.527606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.527723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.527749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.673 [2024-11-29 17:10:19.527831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.527992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.673 [2024-11-29 17:10:19.528019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.673 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.528105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.528210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.528237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.528352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.528481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.528511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.528606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.528752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.528782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.528940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.529093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.529119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.529262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.529375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.529403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.529498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.529603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.529629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.529708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.529796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.529822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.529970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.530088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.530115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.530247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.530363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.530392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.530496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.530577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.530602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.530719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.530833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.530860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.530999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.531079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.531105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.531217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.531301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.531325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.531408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.531499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.531524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.531633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.531766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.531803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.531955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.532099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.532126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.532239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.532348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.532390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.532543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.532659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.532688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.532818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.532934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.532968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.533116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.533226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.533255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.533383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.533514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.533540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.533654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.533794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.533820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.533990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.534118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.534149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.534288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.534406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.534431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.534516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.534632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.534659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.534782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.534869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.534895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.535035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.535176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.535203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.535286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.535400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.535427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.674 qpair failed and we were unable to recover it. 00:28:08.674 [2024-11-29 17:10:19.535540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.535656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.674 [2024-11-29 17:10:19.535682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.535804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.535896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.535922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.536059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.536176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.536203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.536320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.536428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.536454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.536539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.536680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.536706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.536792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.536872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.536898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.536984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.537097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.537122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.537289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.537392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.537436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.537558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.537636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.537664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.537769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.537911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.537938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.538061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.538166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.538193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.538304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.538416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.538444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.538538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.538656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.538683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.538767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.538848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.538871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.538983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.539122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.539149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.539285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.539402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.539428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.539517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.539631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.539657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.539775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.539918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.539944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.540091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.540222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.540267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.540404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.540520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.540547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.540663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.540767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.540794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.540915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.541143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.541425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.541621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.541835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.541998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.542137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.542253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.542280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.542391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.542479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.542523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.542677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.542772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.542800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.675 qpair failed and we were unable to recover it. 00:28:08.675 [2024-11-29 17:10:19.542932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.675 [2024-11-29 17:10:19.543055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.543083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.543194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.543290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.543324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.543446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.543597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.543626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.543785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.543925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.543951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.544114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.544258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.544286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.544372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.544460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.544484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.544580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.544683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.544709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.544835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.544929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.544967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.545119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.545248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.545274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.545388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.545461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.545488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.545564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.545668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.545693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.545770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.545865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.545893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.546000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.546116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.546142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.546222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.546335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.546363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.546476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.546602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.546633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.546765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.546886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.546912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.547038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.547133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.547160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.547273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.547352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.547379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.547524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.547630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.547661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.547755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.547867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.547894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.547985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.548071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.548096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.548191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.548329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.548365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.548475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.548585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.548611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.548694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.548778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.548822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.548926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.549046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.549074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.549187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.549305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.549332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.549476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.549600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.549630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.549740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.549884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.549910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.549999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.550136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.550167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.676 qpair failed and we were unable to recover it. 00:28:08.676 [2024-11-29 17:10:19.550283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.676 [2024-11-29 17:10:19.550462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.550488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.550629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.550716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.550744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.550902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.551053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.551081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.551196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.551318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.551344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.551426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.551513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.551538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.551647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.551750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.551777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.551942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.552076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.552102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.552217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.552335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.552362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.552512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.552621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.552663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.552778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.552862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.552893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.553008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.553118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.553144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.553264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.553388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.553417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.553555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.553671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.553698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.553811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.553915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.553941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.554073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.554164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.554190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.554331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.554408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.554432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.554514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.554620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.554646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.554752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.554829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.554856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.554979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.555063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.555089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.555200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.555312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.555343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.555486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.555600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.555627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.555740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.555855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.555883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.556000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.556085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.556112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.556200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.556315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.556342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.556453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.556593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.556620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.677 qpair failed and we were unable to recover it. 00:28:08.677 [2024-11-29 17:10:19.556749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.677 [2024-11-29 17:10:19.556873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.556903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.557047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.557195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.557221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.557365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.557490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.557517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.557637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.557723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.557750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.557862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.557983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.558012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.558106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.558215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.558242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.558354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.558432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.558458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.558597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.558681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.558706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.558796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.558871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.558896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.559036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.559145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.559172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.559282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.559423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.559449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.559530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.559609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.559635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.559777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.559860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.559887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.560003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.560116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.560142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.560230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.560335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.560362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.560509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.560622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.560648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.560727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.560835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.560862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.561006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.561128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.561155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.561265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.561379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.561407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.561554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.561668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.561695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.561773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.561889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.561916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.562041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.562150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.562176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.562319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.562433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.562462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.562577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.562684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.562711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.562859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.562976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.563005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.563105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.563187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.563214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.563302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.563419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.563445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.563553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.563666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.563693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.563830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.563942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.563977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.678 qpair failed and we were unable to recover it. 00:28:08.678 [2024-11-29 17:10:19.564094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.678 [2024-11-29 17:10:19.564174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.564200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.564338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.564452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.564478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.564599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.564740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.564767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.564857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.564942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.564975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.565088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.565201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.565229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.565306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.565414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.565440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.565555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.565690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.565716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.565861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.566002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.566028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.566171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.566281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.566306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.566462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.566572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.566600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.566742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.566815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.566839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.566926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.567075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.567103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.567192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.567339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.567365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.567505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.567595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.567620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.567788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.567929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.567955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.568084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.568218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.568247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.568361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.568473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.568499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.568644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.568755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.568781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.568938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.569072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.569102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.569232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.569356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.569396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.569513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.569599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.569631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.569749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.569833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.569859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.569995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.570082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.570108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.570195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.570280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.570307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.570456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.570541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.570566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.570706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.570831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.570859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.571032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.571142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.571168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.571285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.571393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.571419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.571557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.571644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.571670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.679 qpair failed and we were unable to recover it. 00:28:08.679 [2024-11-29 17:10:19.571798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.679 [2024-11-29 17:10:19.571922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.571974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.572121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.572247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.572273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.572440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.572554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.572581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.572694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.572809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.572836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.572928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.573022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.573046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.573125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.573209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.573233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.573315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.573421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.573446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.573567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.573686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.573712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.573850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.574138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.574371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.574602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.574817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.574925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.575064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.575189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.575217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.575354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.575476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.575502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.575591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.575715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.575740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.575852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.575969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.575997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.576142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.576318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.576345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.576458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.576596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.576623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.576716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.576815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.576844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.576966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.577077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.577105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.577221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.577333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.577378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.577520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.577659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.577684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.577772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.577855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.577887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.578029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.578114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.578141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.578224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.578339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.578382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.578536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.578661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.578690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.578791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.578908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.578936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.680 qpair failed and we were unable to recover it. 00:28:08.680 [2024-11-29 17:10:19.579032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.579110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.680 [2024-11-29 17:10:19.579134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.579223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.579321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.579352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.579474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.579639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.579666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.579780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.579921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.579947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.580094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.580255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.580281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.580430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.580510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.580536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.580649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.580792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.580821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.580964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.581050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.581080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.581162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.581237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.581261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.581346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.581475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.581505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.581596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.581717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.581747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.581862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.581978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.582006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.582124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.582237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.582265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.582378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.582484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.582512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.582597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.582686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.582711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.582825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.582939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.582982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.583103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.583259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.583288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.583389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.583542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.583571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.583695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.583853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.583880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.583997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.584140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.584166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.584280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.584375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.584402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.584539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.584653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.584680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.584822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.584944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.584981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.585092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.585204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.585231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.585340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.585457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.585483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.681 [2024-11-29 17:10:19.585597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.585703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.681 [2024-11-29 17:10:19.585729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.681 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.585812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.585919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.585951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.586078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.586160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.586186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.586295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.586434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.586461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.586581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.586751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.586780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.586905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.587172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.587397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.587600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.587825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.587968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.588111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.588225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.588252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.588373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.588502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.588544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.588660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.588793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.588822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.588963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.589073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.589099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.589217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.589354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.589385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.589502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.589647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.589676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.589767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.589882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.589922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.590029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.590149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.590175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.590290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.590397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.590423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.590536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.590685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.590711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.590831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.590941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.590977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.591065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.591178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.591205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.591318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.591434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.591460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.591603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.591716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.591742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.591883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.591988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.592034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.592135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.592296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.592326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.592461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.592547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.592574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.592685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.592823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.592868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.592995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.593119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.593159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.682 qpair failed and we were unable to recover it. 00:28:08.682 [2024-11-29 17:10:19.593300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.593383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.682 [2024-11-29 17:10:19.593409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.593500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.593612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.593638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.593790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.593917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.593945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.594091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.594205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.594233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.594348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.594455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.594481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.594624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.594732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.594763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.594890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.595003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.595050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.595151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.595299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.595328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.595493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.595602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.595628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.595745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.595868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.595894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.596017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.596135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.596161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.596247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.596383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.596412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.596537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.596699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.596725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.596867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.597010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.597055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.597149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.597279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.597307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.597397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.597510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.597542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.597659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.597776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.597803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.597928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.598067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.598095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.598177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.598256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.598283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.598371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.598486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.598513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.598660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.598772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.598799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.598878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.598984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.599011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.599155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.599269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.599295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.599423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.599535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.599563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.599700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.599816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.599842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.599947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.600094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.600121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.600287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.600408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.600439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.600580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.600667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.600695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.600783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.600872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.600897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.683 qpair failed and we were unable to recover it. 00:28:08.683 [2024-11-29 17:10:19.601035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.683 [2024-11-29 17:10:19.601148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.601175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.601311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.601403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.601432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.601562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.601713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.601743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.601841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.601953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.601987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.602078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.602155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.602181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.602292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.602408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.602435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.602593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.602743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.602771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.602900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.603061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.603092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.603224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.603364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.603391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.603514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.603668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.603699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.603828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.603930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.603980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.604064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.604173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.604200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.604341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.604421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.604447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.604535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.604676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.604703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.604816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.604932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.604968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.605053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.605136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.605160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.605300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.605413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.605440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.605526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.605643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.605668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.605758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.605836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.605863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.605972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.606087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.606113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.606232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.606339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.606365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.606496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.606621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.606649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.606753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.606859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.606886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.607005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.607118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.607145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.607288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.607427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.607453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.607539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.607622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.607647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.607786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.607862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.607888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.608020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.608134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.608160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.608304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.608391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.608417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.684 qpair failed and we were unable to recover it. 00:28:08.684 [2024-11-29 17:10:19.608528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.684 [2024-11-29 17:10:19.608636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.608662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.608748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.608853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.608883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.609012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.609130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.609173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.609289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.609369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.609397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.609511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.609629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.609655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.609813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.609901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.609946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.610077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.610187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.610214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.610360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.610471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.610498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.610617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.610751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.610793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.610880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.610993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.611021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.611128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.611239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.611266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.611378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.611519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.611545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.611658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.611749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.611775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.611893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.611975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.612003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.612149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.612268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.612295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.612411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.612521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.612547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.612669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.612777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.612803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.612918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.613133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.613367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.613603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.613852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.613962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.614080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.614185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.614212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.614326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.614433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.614460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.614539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.614630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.614656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.614748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.614867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.614902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.615018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.615090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.615118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.615200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.615282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.615309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.615399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.615515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.685 [2024-11-29 17:10:19.615542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.685 qpair failed and we were unable to recover it. 00:28:08.685 [2024-11-29 17:10:19.615657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.615786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.615816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.615982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.616081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.616109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.616223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.616311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.616337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.616448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.616523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.616549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.616661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.616773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.616800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.616910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.617052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.617080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.617168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.617247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.617274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.617355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.617429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.617455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.617594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.617715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.617742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.617887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.617996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.618023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.618140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.618284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.618311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.618462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.618605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.618632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.618737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.618848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.618876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.619017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.619135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.619162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.619283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.619424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.619451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.619536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.619646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.619673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.619795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.619934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.619968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.620086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.620200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.620227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.620311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.620448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.620475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.620561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.620720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.620748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.620889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.621030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.621059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.621171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.621286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.621313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.621429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.621573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.621600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.621718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.621824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.621850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.621964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.622081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.622107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.686 qpair failed and we were unable to recover it. 00:28:08.686 [2024-11-29 17:10:19.622192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.686 [2024-11-29 17:10:19.622335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.622364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.622500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.622589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.622615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.622753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.622885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.622914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.623086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.623205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.623234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.623363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.623488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.623514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.623628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.623711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.623738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.623865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.623984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.624014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.624161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.624291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.624319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.624441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.624533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.624577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.624715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.624833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.624859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.624978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.625129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.625155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.625241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.625377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.625421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.625573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.625692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.625721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.625893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.626034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.626061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.626179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.626301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.626336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.626479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.626620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.626645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.626781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.626893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.626918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.627098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.627209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.627239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.627327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.627488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.627533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.627644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.627808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.627835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.627951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.628040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.628068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.628213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.628339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.628384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.628479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.628639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.628665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.628777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.628889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.628915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.629063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.629143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.629176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.629304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.629430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.629459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.629590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.629676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.629702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.629782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.629893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.629920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.630012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.630091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.687 [2024-11-29 17:10:19.630118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.687 qpair failed and we were unable to recover it. 00:28:08.687 [2024-11-29 17:10:19.630236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.630322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.630349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.630460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.630579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.630605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.630690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.630827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.630854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.630972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.631091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.631117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.631200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.631273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.631299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.631440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.631549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.631584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.631702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.631846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.631873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.631955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.632073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.632100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.632182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.632295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.632321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.632432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.632545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.632572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.632654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.632766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.632793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.632906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.633019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.633046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.633128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.633235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.633262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.633404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.633482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.633509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.633614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.633751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.633778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.633890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.633980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.634012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.634127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.634238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.634265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.634378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.634498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.634525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.634612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.634728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.634755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.634874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.634983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.635011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.635129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.635208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.635234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.635317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.635457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.635484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.635598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.635673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.635700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.635821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.635968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.635996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.636077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.636188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.636216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.636303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.636414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.636445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.636558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.636674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.636702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.636784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.636926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.636953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.688 [2024-11-29 17:10:19.637080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.637166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.688 [2024-11-29 17:10:19.637193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.688 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.637314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.637425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.637452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.637588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.637692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.637718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.637862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.637947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.637980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.638090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.638171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.638198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.638281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.638371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.638398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.638545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.638653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.638679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.638770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.638909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.638935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.639071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.639164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.639192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.639301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.639424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.639451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.639564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.639681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.639707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.639822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.639938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.639973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.640066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.640178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.640207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.640352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.640464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.640490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.640605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.640719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.640746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.640889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.640972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.641000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.641112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.641197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.641224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.641315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.641429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.641455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.641605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.641717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.641744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.641885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.642030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.642058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.642177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.642293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.642320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.642410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.642522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.642549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.642663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.642745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.642773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.642914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.643068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.643113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.643219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.643346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.643391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.643517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.643633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.643660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.643800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.643914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.643941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.644076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.644175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.644201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.644323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.644469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.644495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.689 qpair failed and we were unable to recover it. 00:28:08.689 [2024-11-29 17:10:19.644609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.644748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.689 [2024-11-29 17:10:19.644776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.644883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.644975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.645003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.645084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.645159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.645186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.645267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.645354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.645380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.645502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.645611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.645637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.645757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.645871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.645898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.646022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.646154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.646181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.646267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.646379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.646406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.646515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.646630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.646657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.646750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.646892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.646918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.647049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.647166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.647192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.647285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.647370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.647398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.647490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.647604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.647631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.647716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.647826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.647853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.647932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.648052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.648080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.648189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.648311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.648338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.648454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.648568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.648595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.648708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.648825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.648852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.648998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.649093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.649120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.649263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.649403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.649429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.649543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.649660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.649688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.649803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.649917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.649944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.650064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.650203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.650230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.650370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.650452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.650478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.650558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.650697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.650724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.690 qpair failed and we were unable to recover it. 00:28:08.690 [2024-11-29 17:10:19.650805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.690 [2024-11-29 17:10:19.650884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.650911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.651024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.651182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.651209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.651287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.651401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.651428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.651541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.651651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.651678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.651766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.651878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.651904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.651996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.652082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.652109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.652218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.652329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.652357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.652473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.652557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.652585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.652723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.652836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.652863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.653004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.653118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.653145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.653234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.653341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.653368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.653484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.653592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.653618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.653728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.653835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.653861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.653968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.654105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.654132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.654251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.654390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.654416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.654554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.654636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.654664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.654805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.654880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.654905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.655016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.655144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.655188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.655307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.655443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.655471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.655586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.655694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.655720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.655835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.655912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.655938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.656080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.656171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.656198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.656291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.656403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.656430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.656520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.656600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.656628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.656759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.656898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.656928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.657055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.657148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.657193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.657351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.657446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.657477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.657594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.657693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.657722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.657850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.657927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.691 [2024-11-29 17:10:19.657953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.691 qpair failed and we were unable to recover it. 00:28:08.691 [2024-11-29 17:10:19.658097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.658199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.658240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.658391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.658521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.658550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.658654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.658788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.658819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.658942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.659086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.659113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.659241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.659362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.659392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.659541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.659693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.659722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.659859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.659934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.659966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.660086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.660192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.660235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.660360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.660489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.660517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.660639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.660768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.660797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.660915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.661054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.661082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.661208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.661323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.661352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.661484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.661581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.661610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.661742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.661887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.661916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.662090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.662211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.662254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.662402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.662563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.662593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.662744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.662865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.662906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.662995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.663106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.663132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.663276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.663373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.663416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.663510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.663656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.663685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.663798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.663904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.663931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.664054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.664140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.664167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.664276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.664401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.664429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.664539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.664631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.664657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.664775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.664856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.664882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.664973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.665085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.665129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.665261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.665401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.665427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.665513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.665614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.665639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.692 [2024-11-29 17:10:19.665752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.665877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.692 [2024-11-29 17:10:19.665906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.692 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.666040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.666128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.666156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.666251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.666375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.666403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.666566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.666679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.666707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.666837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.666995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.667025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.667155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.667306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.667335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.667433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.667547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.667575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.667710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.667857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.667884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.668050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.668201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.668229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.668367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.668459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.668484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.668594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.668709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.668735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.668866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.668969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.669014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.669167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.669331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.669373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.669512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.669596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.669622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.669743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.669867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.669897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.670018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.670132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.670159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.670290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.670438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.670467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.670563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.670678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.670712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.670813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.670932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.670969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.671070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.671180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.671208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.671331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.671455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.671485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.671645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.671755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.671780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.671856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.671983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.672010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.672124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.672259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.672285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.672465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.672578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.672604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.672719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.672831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.672856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.672976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.673058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.673084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.673196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.673308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.673339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.673505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.673634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.673664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.693 qpair failed and we were unable to recover it. 00:28:08.693 [2024-11-29 17:10:19.673796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.673971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.693 [2024-11-29 17:10:19.674001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.674101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.674217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.674245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.674380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.674467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.674493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.674665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.674790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.674820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.674973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.675129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.675157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.675288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.675441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.675470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.675597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.675732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.675758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.675867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.675976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.676006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.676132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.676251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.676284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.676412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.676509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.676537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.676649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.676729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.676756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.676886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.677047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.677077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.677165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.677319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.677348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.677499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.677621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.677649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.677764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.677902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.677928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.678025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.678165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.678190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.678323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.678485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.678510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.678616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.678753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.678779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.678915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.679064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.679096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.679252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.679372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.679401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.679558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.679698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.679725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.679868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.680003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.680034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.680170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.680308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.680335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.680462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.680552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.680580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.680715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.680799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.680825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.680935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.681031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.681058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.681178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.681294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.681320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.681419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.681517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.681547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.681699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.681832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.681862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.694 qpair failed and we were unable to recover it. 00:28:08.694 [2024-11-29 17:10:19.681973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.694 [2024-11-29 17:10:19.682078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.682104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.682220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.682304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.682330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.682436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.682570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.682599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.682721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.682869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.682898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.683006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.683173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.683201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.683314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.683397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.683423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.683535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.683620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.683647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.683729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.683870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.683895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.684012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.684159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.684188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.684355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.684497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.684540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.684674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.684789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.684818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.684980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.685097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.685124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.685252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.685392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.685419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.685532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.685645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.685672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.685756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.685893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.685919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.686028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.686146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.686174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.686293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.686415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.686445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.686605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.686744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.686770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.686873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.687002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.687029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.687114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.687270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.687298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.687391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.687481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.687510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.687641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.687750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.687776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.687903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.688026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.688056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.688199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.688306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.688332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.688417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.688531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.688556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.688666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.688741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.695 [2024-11-29 17:10:19.688768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.695 qpair failed and we were unable to recover it. 00:28:08.695 [2024-11-29 17:10:19.688876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.688989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.689017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.689186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.689287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.689329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.689437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.689548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.689575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.689689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.689797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.689823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.689948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.690071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.690113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.690225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.690374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.690417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.690561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.690687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.690715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.690849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.690929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.690963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.691076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.691185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.691226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.691390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.691507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.691536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.691698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.691799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.691828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.691987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.692098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.692124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.692239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.692391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.692419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.692572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.692732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.692760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.692925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.693030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.693060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.693196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.693334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.693360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.693523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.693622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.693650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.693772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.693896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.693925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.694083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.694260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.694286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.694403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.694513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.694539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.694676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.694830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.694859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.695001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.695147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.695173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.695271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.695395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.695423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.695555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.695645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.695672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.695794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.695923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.695951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.696073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.696227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.696256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.696387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.696525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.696551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.696692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.696777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.696803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.696 [2024-11-29 17:10:19.696884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.696999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.696 [2024-11-29 17:10:19.697027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.696 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.697134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.697264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.697292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.697449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.697547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.697576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.697688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.697799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.697825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.697964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.698078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.698106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.698192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.698349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.698375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.698517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.698636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.698665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.698799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.698878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.698904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.698998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.699104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.699130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.699270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.699373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.699404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.699525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.699666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.699692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.699779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.699859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.699885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.699969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.700071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.700102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.700208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.700299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.700343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.700455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.700558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.700600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.700759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.700868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.700893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.701063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.701221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.701251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.701368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.701497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.701527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.701651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.701767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.701796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.701939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.702036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.702063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.702178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.702291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.702319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.702451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.702548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.702577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.702709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.702846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.702872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.703012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.703119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.703144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.703274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.703416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.703442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.703581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.703697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.703722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.703834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.703972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.704002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.704136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.704246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.704272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.704456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.704657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.704683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.697 qpair failed and we were unable to recover it. 00:28:08.697 [2024-11-29 17:10:19.704799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.697 [2024-11-29 17:10:19.704901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.704929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.705045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.705137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.705163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.705302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.705412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.705437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.705586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.705681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.705709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.705823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.705939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.705972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.706134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.706266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.706309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.706444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.706558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.706583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.706690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.706825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.706860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.706980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.707108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.707133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.707217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.707326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.707352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.707431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.707512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.707539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.707682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.707813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.707842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.707967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.708094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.708119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.708271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.708444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.708473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.708574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.708682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.708708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.708839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.708925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.708975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.709793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.709945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.709981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.710108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.710227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.710252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.710336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.710475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.710500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.710591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.710676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.710701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.710814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.710924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.710949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.711068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.711151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.711175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.711268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.711372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.711398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.711484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.711569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.711613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.711719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.711822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.711849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.711948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.712118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.712144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.712234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.712350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.712376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.712514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.712598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.712623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.712746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.712854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.712880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.698 qpair failed and we were unable to recover it. 00:28:08.698 [2024-11-29 17:10:19.712972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.698 [2024-11-29 17:10:19.713058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.713084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.713178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.713295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.713321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.713435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.713519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.713545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.713684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.713774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.713799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.713882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.713983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.714040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.714118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.714203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.714229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.714312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.714399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.714425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.714513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.714593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.714618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.714705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.714822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.714847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.714980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.715144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.715175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.715261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.715362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.715393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.715524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.715665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.715693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.715837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.715928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.715956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.716057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.716146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.716174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.716269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.716384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.716411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.716492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.716606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.716633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.716741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.716827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.716856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.716940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.717150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.717352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.717569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.717799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.717913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.718025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.718140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.718167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.718291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.718391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.718419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.718514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.718634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.718662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.718746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.718867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.718901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.699 qpair failed and we were unable to recover it. 00:28:08.699 [2024-11-29 17:10:19.719014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.699 [2024-11-29 17:10:19.719097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.719123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.719202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.719322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.719348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.719437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.719524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.719550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.719670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.719791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.719833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.719949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.720062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.720088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.720200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.720318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.720359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.720513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.720603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.720631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.720719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.720833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.720861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.720947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.721077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.721102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.721193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.721289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.721315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.721403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.721485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.721510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.721608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.721728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.721756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.721888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.721990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.722016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.722110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.722227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.722265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.722380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.722486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.722515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.722600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.722713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.722740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.722859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.722955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.722988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.723122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.723200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.723236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.723330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.723469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.723494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.723594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.723710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.723737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.723854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.723943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.723979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.724105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.724190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.724215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.724298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.724447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.724473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.724622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.724716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.724745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.724846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.724939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.724991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.725072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.725153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.725178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.725298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.725389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.725415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.725541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.725641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.725665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.700 qpair failed and we were unable to recover it. 00:28:08.700 [2024-11-29 17:10:19.725774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.725900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.700 [2024-11-29 17:10:19.725928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.726051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.726132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.726157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.726271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.726352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.726395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.726485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.726612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.726639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.726752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.726890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.726915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.727023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.727132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.727156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.727280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.727424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.727449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.727545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.727689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.727716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.727868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.727950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.727999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.728092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.728205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.728235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.728390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.728497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.728521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.728653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.728773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.728800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.728900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.729003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.729046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.729165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.729279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.729304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.729395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.729478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.729503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.729633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.729722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.729749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.729876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.729984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.730019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.730108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.730187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.730212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.730352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.730435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.730464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.730588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.730682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.730710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.730832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.730955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.731005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.731087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.731167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.731192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.731307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.731395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.731423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.731528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.731628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.731656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.731811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.731898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.731926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.732057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.732132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.732158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.732245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.732334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.732359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.732491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.732615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.732642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.732767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.732858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.732886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.701 qpair failed and we were unable to recover it. 00:28:08.701 [2024-11-29 17:10:19.732976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.733078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.701 [2024-11-29 17:10:19.733103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.733185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.733270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.733293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.733399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.733515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.733543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.733665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.733780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.733808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.733902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.734049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.734074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.734162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.734243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.734268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.734402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.734515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.734542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.734637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.734758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.734792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.734890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.735049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.735075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.735188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.735315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.735340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.735484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.735607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.735635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.735753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.735844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.735886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.736008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.736085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.736110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.736199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.736332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.736360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.736486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.736672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.736715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.736836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.736926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.736954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.737066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.737161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.737186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.737323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.737445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.737473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.737573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.737671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.737699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.737784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.737877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.737904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.738015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.738096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.738120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.738199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.738347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.738372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.738481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.738561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.738588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.738682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.738773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.738800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.738921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.739077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.739103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.739191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.739315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.739339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.739434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.739545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.739572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.739698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.739790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.739834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.739943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.740076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.740101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.702 qpair failed and we were unable to recover it. 00:28:08.702 [2024-11-29 17:10:19.740192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.740265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.702 [2024-11-29 17:10:19.740288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.740398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.740475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.740501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.740611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.740728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.740754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.740843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.740925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.740950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.741076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.741157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.741182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.741264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.741339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.741363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.741439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.741546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.741572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.741681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.741768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.741793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.741883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.741989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.742020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.742119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.742227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.742258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.742349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.742492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.742519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.742637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.742724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.742755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.742840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.742947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.742984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.743072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.743155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.743181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.743270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.743367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.743396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.743486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.743596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.743625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.743744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.743821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.743848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.743966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.744239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.744437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.744615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.744840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.744946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.745079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.745200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.745231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.745381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.745518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.745549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.745691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.745805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.745833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.745954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.746078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.746103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.746236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.746342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.746370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.746497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.746622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.746650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.746799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.746950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.746985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.703 qpair failed and we were unable to recover it. 00:28:08.703 [2024-11-29 17:10:19.747083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.703 [2024-11-29 17:10:19.747199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.747235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.747321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.747423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.747450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.747549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.747698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.747726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.747825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.747915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.747964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.748064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.748148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.748173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.748316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.748408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.748437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.748593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.748704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.748732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.748826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.748926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.748952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.749081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.749168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.749194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.749307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.749421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.749449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.749553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.749653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.749686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.749834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.749930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.749998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.750093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.750208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.750234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.750315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.750383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.750425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.750509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.750655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.750682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.750801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.750894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.750921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.751071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.751163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.751190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.751356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2465600 is same with the state(5) to be set 00:28:08.704 [2024-11-29 17:10:19.751518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.751684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.751731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.751855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.751947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.751987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.752125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.752254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.752299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.752418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.752514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.752542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.752635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.752716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.752757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.752863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.752990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.753018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.753132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.753244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.753273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.753364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.753443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.753469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.704 [2024-11-29 17:10:19.753583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.753697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.704 [2024-11-29 17:10:19.753727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.704 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.753842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.753920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.753947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.754067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.754177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.754205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.754290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.754370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.754398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.754513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.754603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.754630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.754772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.754897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.754923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.755036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.755122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.755148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.755285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.755370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.755397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.755549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.755660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.755686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.755774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.755891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.755919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.756044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.756146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.756173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.756273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.756383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.756411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.756552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.756666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.756694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.756777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.756897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.756926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.757061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.757154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.757184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.757305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.757391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.757423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.757518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.757600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.757630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.757716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.757808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.757836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.757926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.758030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.758058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.758176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.758294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.758324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.758449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.758565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.758593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.758678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.758752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.758779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.758893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.758977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.759012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.759088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.759197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.759225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.759313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.759396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.759424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.759536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.759627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.759660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.759807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.759895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.759923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.760026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.760144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.760172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.705 qpair failed and we were unable to recover it. 00:28:08.705 [2024-11-29 17:10:19.760267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.705 [2024-11-29 17:10:19.760355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.760383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.760496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.760607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.760634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.760721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.760858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.760886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.760988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.761093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.761119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.761205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.761328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.761354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.761447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.761537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.761565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.761645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.761756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.761783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.761894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.762167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.762381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.762599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.762845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.762952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.763072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.763152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.763179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.763267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.763381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.763408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.763534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.763648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.763676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.763789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.763928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.763956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.764083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.764232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.764259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.764348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.764460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.764492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.764590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.764671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.764697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.764786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.764915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.764941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.765055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.765146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.765171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.765254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.765331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.765356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.765452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.765602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.765631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.765715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.765829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.765855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.765938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.766030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.766057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.766144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.766256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.766283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.766398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.766520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.766549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.766671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.766784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.766811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.766934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.767084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.767112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.767227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.767338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.767366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.706 qpair failed and we were unable to recover it. 00:28:08.706 [2024-11-29 17:10:19.767477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.706 [2024-11-29 17:10:19.767592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.767619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.767739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.767854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.767881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.767994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.768190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.768393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.768643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.768832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.768979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.769103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.769193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.769227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.769343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.769465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.769492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.769588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.769680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.769708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.769790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.769869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.769895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.770019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.770101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.770128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.770224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.770314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.770342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.770428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.770536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.770562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.770679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.770755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.770783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.770899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.770980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.771007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.771100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.771241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.771270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.771365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.771471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.771497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.771618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.771761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.771788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.771906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.772037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.772068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.772155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.772275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.772302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.772388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.772469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.772496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.772593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.772727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.772755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.772872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.772989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.773017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.773163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.773275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.773301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.773418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.773510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.773538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.773623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.773734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.773763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.773880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.773995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.774023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.774127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.774238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.774264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.774352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.774434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.774461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.774584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.774695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.774725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.707 qpair failed and we were unable to recover it. 00:28:08.707 [2024-11-29 17:10:19.774816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.707 [2024-11-29 17:10:19.774933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.774971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.775092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.775231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.775260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.775345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.775455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.775482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.775578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.775658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.775688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.775808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.775893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.775920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.776025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.776114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.776144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.776236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.776320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.776346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.776442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.776561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.776588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.776670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.776754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.776785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.776876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.776994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.777022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.777109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.777241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.777267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.777347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.777434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.777462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.777603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.777709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.777737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.777817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.777895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.777922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.778034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.778141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.778167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.778277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.778362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.778388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.778500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.778587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.778615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.778731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.778815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.778843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.778928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.779164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.779398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.779624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.779880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.779996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.780113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.780215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.780242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.780333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.780442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.780468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.780609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.780703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.780730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.780849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.780996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.781024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.708 qpair failed and we were unable to recover it. 00:28:08.708 [2024-11-29 17:10:19.781155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.708 [2024-11-29 17:10:19.781283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.781314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.781453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.781570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.781596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.781717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.781831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.781859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.781979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.782092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.782120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.782210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.782311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.782341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.782436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.782556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.782585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.782703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.782795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.782825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.782920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.783088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.783119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.783248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.783358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.783384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.783487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.783591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.783621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.783722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.783816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.783845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.783968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.784099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.784127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.784229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.784318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.784348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.784441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.784531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.784563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.784656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.784749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.784791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.784911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.785055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.785082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.785198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.785287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.785314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.785465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.785569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.785602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.785737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.785834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.785863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.785989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.786088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.786114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.786242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.786333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.786378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.786502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.786600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.786628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.786778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.786860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.786888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.786996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.787079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.787105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.787241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.787339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.787368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.787456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.787546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.709 [2024-11-29 17:10:19.787576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.709 qpair failed and we were unable to recover it. 00:28:08.709 [2024-11-29 17:10:19.787693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.787783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.787827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.787938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.788056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.788084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.788173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.788304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.788333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.788456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.788553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.788581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.788689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.788812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.788846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.788980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.789091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.789117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.789245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.789350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.789378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.789532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.789626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.789669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.789775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.789859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.789888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.790023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.790108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.790134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.790246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.790354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.790397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.790523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.790614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.790642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.790764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.790858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.790886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.790986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.791089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.791114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.791193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.791287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.791321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.791407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.791540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.791568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.791692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.791807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.791836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.791926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.792099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.792126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.792236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.792344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.792387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.792488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.792622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.792650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.792742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.792894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.792919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.793046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.793132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.793157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.793242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.793334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.793359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.793450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.793527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.793552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.793659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.793739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.793783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.710 [2024-11-29 17:10:19.793911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.794053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.710 [2024-11-29 17:10:19.794081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.710 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.794163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.794277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.794303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.794384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.794464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.794489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.794606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.794716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.794742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.794824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.794926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.794951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.795044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.795154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.795180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.795267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.795383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.795409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.795521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.795598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.795624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.795733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.795836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.795862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.795978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.796180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.796424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.796618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.796839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.796997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.797114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.797201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.797226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.797371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.797518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.797543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.797648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.797759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.797785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.797894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.797973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.797999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.798111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.798191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.798216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.798295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.798397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.798422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.798513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.798605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.798631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.798708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.798789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.798814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.798922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.799042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.799086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.799213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.799334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.799363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.799473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.799566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.799591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.799724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.799810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.799836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.799931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.800091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.800119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.800218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.800353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.800377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.800464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.800543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.800568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.711 [2024-11-29 17:10:19.800646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.800754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.711 [2024-11-29 17:10:19.800781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.711 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.800861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.800946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.800978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.801087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.801171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.801214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.801306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.801405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.801448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.801540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.801648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.801674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.801791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.801879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.801904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.802039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.802125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.802151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.802245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.802332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.802358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.802447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.802556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.802581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.802718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.802820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.802849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.802964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.803077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.803102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.803217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.803348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.803382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.803497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.803636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.803662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.803744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.803849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.803875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.804007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.804097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.804125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.804245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.804352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.804380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.804511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.804594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.804619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.804706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.804781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.804806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.804891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.804996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.805026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.805141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.805255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.805281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.805385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.805465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.805491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.805572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.805653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.805679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.805789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.805894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.805920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.806061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.806162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.806190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.806316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.806430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.806458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.806589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.806674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.806698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.806782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.806860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.806884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.806973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.807080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.807105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.807192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.807277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.807301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.712 [2024-11-29 17:10:19.807380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.807467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.712 [2024-11-29 17:10:19.807491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.712 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.807609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.807687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.807712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.807817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.807939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.807974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.808084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.808199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.808225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.808307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.808397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.808423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.808539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.808662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.808687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.808781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.808919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.808945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.809076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.809158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.809184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.809325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.809412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.809438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.809554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.809663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.809688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.809774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.809897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.809926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.810071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.810183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.810209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.810323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.810405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.810430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.810549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.810669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.810694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.810780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.810868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.810892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.810976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.811062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.811087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.811195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.811287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.811312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.811426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.811513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.811538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.811617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.811757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.811785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.811874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.811998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.812026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.812154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.812267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.812294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.812434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.812524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.812550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.812633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.812742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.812767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.812864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.812948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.812978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.813064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.813148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.813173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.713 qpair failed and we were unable to recover it. 00:28:08.713 [2024-11-29 17:10:19.813281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.713 [2024-11-29 17:10:19.813360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.813385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.813473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.813581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.813607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.813696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.813780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.813806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.813898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.813988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.814013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.814096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.814166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.814191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.814332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.814470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.814497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.814616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.814723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.814748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.814951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.815090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.815116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.815227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.815336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.815366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.815476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.815590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.815616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.815703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.815778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.815803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.815947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.816067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.816093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.816233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.816341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.816366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.816448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.816557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.816582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.816722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.816851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.816879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.817009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.817103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.817131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.817233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.817311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.817336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.817432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.817510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.817534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.817643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.817717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.817742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.817819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.817953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.818006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.818097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.818183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.818209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.818319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.818434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.818460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.818548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.818641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.818668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.818779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.818866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.818910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.819011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.819132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.819159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.819267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.819358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.819383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.819469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.819545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.819570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.819661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.819772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.819798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.819902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.820002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.714 [2024-11-29 17:10:19.820051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.714 qpair failed and we were unable to recover it. 00:28:08.714 [2024-11-29 17:10:19.820141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.820244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.820270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.820401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.820541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.820583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.820701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.820787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.820813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.820955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.821055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.821081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.821192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.821339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.821364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.821453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.821542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.821568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.821682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.821794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.821820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.821910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.821991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.822017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.822125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.822207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.822232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.822323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.822414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.822439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.822520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.822631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.822656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.822767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.822912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.822937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.823058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.823157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.823184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.823271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.823400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.823442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.823525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.823636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.823662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.823751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.823860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.823885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.823969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.824075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.824100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.824187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.824293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.824318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.824456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.824564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.824589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.824704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.824791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.824819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.824951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.825146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.825335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.825553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.825770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.825894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.826009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.826088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.826114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.826226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.826347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.826372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.826479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.826573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.826598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.826676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.826759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.826785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.715 qpair failed and we were unable to recover it. 00:28:08.715 [2024-11-29 17:10:19.826916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.715 [2024-11-29 17:10:19.827057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.827083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.827176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.827252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.827282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.827360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.827432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.827456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.827571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.827649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.827675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.827755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.827835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.827878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.827996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.828094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.828135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.828218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.828327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.828352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.828459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.828572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.828597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.828689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.828807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.828833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.828955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.829160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.829361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.829630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.829813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.829978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.830066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.830166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.830191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.830281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.830415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.830441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.830527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.830616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.830642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.830755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.830913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.830941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.831083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.831199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.831225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.831341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.831464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.831492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.831620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.831728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.831754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.831862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.831940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.831973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.832090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.832172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.832197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.832288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.832403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.832428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.832510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.832615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.832640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.832751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.832861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.832886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.832994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.833074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.833100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.833183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.833290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.833315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.833448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.833536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.833564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.716 qpair failed and we were unable to recover it. 00:28:08.716 [2024-11-29 17:10:19.833660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.716 [2024-11-29 17:10:19.833802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.833828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.833915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.834146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.834342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.834559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.834809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.834936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.835029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.835140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.835165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.835303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.835384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.835409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.835549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.835645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.835670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.835762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.835869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.835894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.835990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.836187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.836416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.836606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.836858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.836971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.837059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.837167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.837208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.837344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.837432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.837458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.837598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.837682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.837725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.837816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.837941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.837977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.838089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.838177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.838203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.838293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.838369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.838394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.838516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.838621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.838646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.838731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.838847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.838872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.838967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.839053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.839079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.839158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.839265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.839291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.839379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.839464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.839490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.839597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.839729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.839757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.839883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.839989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.840018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.840127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.840266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.840292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.717 qpair failed and we were unable to recover it. 00:28:08.717 [2024-11-29 17:10:19.840384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.717 [2024-11-29 17:10:19.840493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.840519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.840607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.840693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.840718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.840841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.840928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.840955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.841099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.841181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.841208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.841299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.841384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.841413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.841501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.841617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.841642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.841721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.841806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.841832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.841936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.842177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.842407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.842601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.842808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.842972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.843062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.843150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.843176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.843285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.843368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.843394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.843480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.843592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.843617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.843704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.843793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.843818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.843924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.844018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.844044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.844152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.844240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.844265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.844357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.844531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.844557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.844674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.844758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.844783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.844893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.844991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.845017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.845107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.845194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.845239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.845354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.845459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.845484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.845568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.845652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.845678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.845758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.845865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.845892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.718 [2024-11-29 17:10:19.846015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.846097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.718 [2024-11-29 17:10:19.846122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.718 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.846235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.846314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.846338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.846435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.846548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.846573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.846662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.846776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.846802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.846916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.847035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.847062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.847179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.847291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.847317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.847396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.847503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.847528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.847638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.847715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.847740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.847895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.847988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.848016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.848138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.848291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.848320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.848461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.848572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.848598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.848718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.848798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.848824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.848932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.849044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.849072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.849232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.849337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.849363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.849446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.849559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.849584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.849725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.849800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.849825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.849944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.850059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.850083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.850194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.850278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.850303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.850403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.850519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.850547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.850679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.850797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.850822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.850897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.851038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.851066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.851191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.851302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.851328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.851415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.851521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.851546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.851656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.851795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.851820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.851916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.852147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.852337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.852565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.852810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.852924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.719 qpair failed and we were unable to recover it. 00:28:08.719 [2024-11-29 17:10:19.853087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.719 [2024-11-29 17:10:19.853222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.853247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.853384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.853533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.853563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.853673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.853758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.853785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.853874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.853949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.853981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.854077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.854154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.854179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.854269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.854409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.854434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.854513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.854600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.854625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.854768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.854846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.854872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.854991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.855079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.855105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.855242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.855391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.855419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.855527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.855617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.855643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.855752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.855843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.855867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.855985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.856076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.856103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.856254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.856378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.856404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.856517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.856601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.856627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.856720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.856800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.856826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.856933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.857017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.857042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.857161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.857272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.857297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.857432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.857582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.857607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.857722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.857803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.857830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.857937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.858041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.858066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.858156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.858265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.858290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.858416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.858526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.858551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.858663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.858775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.858800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.858886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.858999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.859025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.859139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.859222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.859247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.859389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.859497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.859523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.859633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.859723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.859748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.859886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.859976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.860019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.720 qpair failed and we were unable to recover it. 00:28:08.720 [2024-11-29 17:10:19.860161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.860271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.720 [2024-11-29 17:10:19.860296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.860387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.860473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.860498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.860581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.860671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.860697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.860794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.860919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.860948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.861051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.861135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.861162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.861277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.861390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.861419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.861499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.861603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.861632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.861773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.861853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.861880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.862002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.862089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.862116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.862204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.862311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.862338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.862455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.862545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.862573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.862666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.862773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.862799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.862915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.863064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.863090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.863169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.863252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.863278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.863389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.863518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.863546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.863665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.863761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.863789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.863873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.864017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.864043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.864126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.864242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.864268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.864363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.864510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.864537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.864655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.864744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.864771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.864896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.864982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.865028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.865140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.865257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.865282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.865396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.865547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.865575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.865686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.865846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.865872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.865966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.866046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.866071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.866154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.866241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.866266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.866366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.866459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.866488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.866636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.866729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.866757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.866888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.866978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.867005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.721 qpair failed and we were unable to recover it. 00:28:08.721 [2024-11-29 17:10:19.867120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.867255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.721 [2024-11-29 17:10:19.867283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.867453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.867570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.867598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.867709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.867822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.867849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.867968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.868107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.868133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.868221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.868294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.868343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.868462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.868586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.868615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.868713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.868824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.868852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.868984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.869069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.869097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.869211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.869319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.869345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.869418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.869529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.869557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.869690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.869816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.869841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.869949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.870091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.870117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.870234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.870370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.870399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.870525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.870641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.870683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.870797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.870887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.870915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.871071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.871160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.871185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.871295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.871399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.871424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.871522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.871647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.871675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.871827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.871919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.871948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.872089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.872175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.872201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.872292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.872405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.872450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.872579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.872662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.872691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.872825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.872997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.873038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.873129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.873215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.873241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.873353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.873439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.873464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.873551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.873664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.873691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.722 qpair failed and we were unable to recover it. 00:28:08.722 [2024-11-29 17:10:19.873837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.722 [2024-11-29 17:10:19.873914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.873940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.874056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.874193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.874234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.874377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.874492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.874519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.874682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.874806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.874834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.874949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.875082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.875110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.875236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.875353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.875378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.875497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.875634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.875662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.875787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.875904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.875932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.876049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.876166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.876191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.876288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.876446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.876476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.876570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.876656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.876684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.876774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.876912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.876938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.877096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.877210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.877237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.877355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.877472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.877499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.877606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.877744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.877770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.877885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.878001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.878028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.878142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.878252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.878278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.878364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.878480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.878507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.878597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.878737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.878763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.878842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.879034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.879062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.879184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.879272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.879299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.879437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.879513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.879539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.879652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.879764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.879791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.879903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.880014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.880041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.880183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.880265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.880293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.880412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.880488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.880514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.880691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.880805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.880832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.880972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.881104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.881134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.881232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.881354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.881380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-29 17:10:19.881497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.723 [2024-11-29 17:10:19.881636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.881663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.881803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.881943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.881981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.882114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.882234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.882260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.882368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.882456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.882483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.882599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.882713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.882740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.882886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.883021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.883051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.883191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.883328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.883353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.883493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.883636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.883665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.883755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.883872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.883898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.883983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.884093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.884118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.884200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.884314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.884340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.884458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.884561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.884590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.884718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.884858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.884884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.885010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.885102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.885130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.885243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.885369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.885399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.885537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.885674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.885700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.885812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.885904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.885934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.886072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.886192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.886219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.886307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.886410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.886435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.886521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.886611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.886639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.886716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.886857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.886884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.887027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.887167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.887194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.887311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.887446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.887476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.887626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.887749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.887778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.887907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.888034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.888060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.888174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.888315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.888341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.888471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.888566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.888597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.888765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.888854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.888880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.889020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.889110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.724 [2024-11-29 17:10:19.889135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-29 17:10:19.889271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.889353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.889381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.889464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.889569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.889600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.889715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.889854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.889899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.890050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.890139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.890166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.890280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.890391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.890417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.890528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.890646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.890673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.890789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.890900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.890925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.891050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.891137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.891164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.891317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.891412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.891441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.891544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.891669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.891698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.891810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.891899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.891925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.892081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.892196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.892227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.892342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.892479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.892509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.892666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.892784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.892811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.892976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.893125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.893155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.893274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.893422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.893451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.893613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.893754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.893780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.893893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.894041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.894070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.894224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.894394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.894421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.894556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.894667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.894694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.894782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.894868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.894894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.894996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.895071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.895101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.895187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.895342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.895368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.895544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.895662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.895689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.895833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.895967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.895997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.896109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.896248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.896274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.896451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.896573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.896599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.896712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.896826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.896852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-29 17:10:19.897031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.897138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.725 [2024-11-29 17:10:19.897164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.897279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.897361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.897388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.897502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.897657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.897686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.897785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.897962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.898012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.898134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.898248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.898274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.898381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.898489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.898519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.898622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.898708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.898735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.898848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.898987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.899014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.899095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.899184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.899212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.899321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.899463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.899490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.899607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.899722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.899766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.899905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.900030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.900058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.900152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.900261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.900288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.900409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.900486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.900512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.900603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.900713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.900739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.900868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.901014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.901042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.901180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.901282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.901312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.901440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.901551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.901580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.901710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.901818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.901845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.901924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.902020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.902064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.902166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.902284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.902314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.902470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.902580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.902607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.902722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.902890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.902919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.903051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.903152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.903180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.903317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.903421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.903447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.903559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.903669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.903697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.903849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.903976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.904005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.904105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.904217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.904243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.904366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.904479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.904505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.726 [2024-11-29 17:10:19.904638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.904762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.726 [2024-11-29 17:10:19.904791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.726 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.904979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.905110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.905136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.905248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.905337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.905363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.905499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.905613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.905640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.905729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.905848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.905874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.905969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.906080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.906108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.906226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.906332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.906362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.906465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.906575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.906602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.906694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.906798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.906824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.906899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.907020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.907046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.907186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.907295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.907322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.907431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.907582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.907611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.907727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.907836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.907862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.908004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.908144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.908170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.908266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.908425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.908454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.908562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.908690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.908720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.908859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.908997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.909024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.909138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.909225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.909251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.909367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.909482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.909524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.909632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.909719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.909746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.909825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.909948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.909983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.910107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.910203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.910232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.910364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.910449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.910476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.910619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.910710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.910737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.910848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.910982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.911027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.727 [2024-11-29 17:10:19.911142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.911256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.727 [2024-11-29 17:10:19.911282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.727 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.911418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.911530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.911556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.911671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.911833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.911862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.912022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.912141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.912168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.912289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.912428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.912454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.912571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.912685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.912711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.912824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.912936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.912971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.913088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.913199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.913226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.913344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.913485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.913512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.913626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.913724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.913750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.913864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.913949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.913984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.914067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.914179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.914205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.914344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.914460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.914486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.914602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.914688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.914714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.914805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.914918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.914945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.915060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.915179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.915205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.915327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.915409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.915436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.915581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.915719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.915747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.915830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.915939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.915972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.916086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.916169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.916195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.916310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.916417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.916442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.916584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.916695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.916720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.916828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.916977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.917004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.917087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.917224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.917250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.917345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.917488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.917514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.917670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.917786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.917812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.917925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.918047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.918074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.918189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.918272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.918299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.918419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.918532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.918559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.728 qpair failed and we were unable to recover it. 00:28:08.728 [2024-11-29 17:10:19.918674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.918841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.728 [2024-11-29 17:10:19.918870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.919015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.919173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.919203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.919334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.919477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.919527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.919688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.919813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.919840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.919968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.920066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.920093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.920207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.920319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.920346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.920458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.920572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.920600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.920715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.920838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.920865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.920953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.921052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.921080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.921199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.921310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.921337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.921491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.921611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.921641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.921812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.921923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.921949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.922103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.922194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.922220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.922380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.922534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.922563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.922712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.922857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.922886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.922975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.923082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.923109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.923214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.923393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.923437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.923553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.923711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.923756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.923905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.924063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.924109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.924239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.924339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.924365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.924484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.924589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.924615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.924692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.924814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.924841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.924928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.925064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.925092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.925213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.925354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.925380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.925470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.925556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.925581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.925720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.925860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.925886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.926027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.926182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.926211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.926336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.926457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.926486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.926580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.926701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.926731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.729 qpair failed and we were unable to recover it. 00:28:08.729 [2024-11-29 17:10:19.926855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.729 [2024-11-29 17:10:19.926999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.927026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.927111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.927198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.927224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.927345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.927444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.927474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.927591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.927681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.927711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.927798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.927911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.927940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.928118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.928244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.928289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.928390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.928531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.928560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.928693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.928805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.928832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.928948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.929068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.929095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.929215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.929328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.929354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.929433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.929569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.929595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.929682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.929796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.929822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.929909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.930006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.930033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.930115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.930226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.930252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.930391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.930502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.930528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.930643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.930756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.930781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.930894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.930980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.931007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.931110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.931194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.931223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.931341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.931436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.931466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.931586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.931732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.931761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.931864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.931949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.931996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.932138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.932225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.932252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.932372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.932453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.932505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.932657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.932805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.932834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.932932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.933073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.933100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.933181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.933312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.933342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.933512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.933631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.933660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.933783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.933923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.933973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.934076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.934216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.934242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.730 qpair failed and we were unable to recover it. 00:28:08.730 [2024-11-29 17:10:19.934350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.730 [2024-11-29 17:10:19.934567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.934597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.934748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.934899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.934927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.935054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.935134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.935161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.935261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.935430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.935465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.935575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.935734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.935764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.935864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.935996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.936023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.936102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.936191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.936219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.936333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.936438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.936469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.936615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.936741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.936786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.936946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.937091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.937117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.937259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.937387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.937416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.937547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.937683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.937712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.937829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.937965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.937993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.938136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.938243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.938274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.938389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.938550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.938579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.938807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.938928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.938965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.939104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.939187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.939213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.939342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.939434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.939462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.939639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.939787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.939816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.939955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.940061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.940088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.940196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.940305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.940332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.940483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.940605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.940634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.940788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.940986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.941014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.941155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.941270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.941302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.941442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.941639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.941669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.941816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.941910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.731 [2024-11-29 17:10:19.941939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.731 qpair failed and we were unable to recover it. 00:28:08.731 [2024-11-29 17:10:19.942113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.942228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.942255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.942370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.942516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.942543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.942657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.942771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.942799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.942880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.942989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.943017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.943158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.943280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.943307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.943393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.943535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.943565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.943689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.943812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.943842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.943976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.944095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.944123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.944243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.944352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.944394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.944545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.944667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.944696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.944906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.945054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.945083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.945174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.945261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.945289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.945404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.945528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.945557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.945690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.945823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.945853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.945988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.946099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.946125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.946246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.946386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.946413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.946542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.946635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.946666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.946762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.946889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.946916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.947016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.947101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.947129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.947246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.947357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.947383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.947468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.947586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.947613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.947750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.947860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.947887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.947983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.948087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.948113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.948256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.948367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.948394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.948510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.948659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.948686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.948802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.948922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.948949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.949101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.949230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.949257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.949370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.949493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.949520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.732 [2024-11-29 17:10:19.949644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.949758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.732 [2024-11-29 17:10:19.949785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.732 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.949899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.949997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.950025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.950110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.950223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.950251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.950362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.950470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.950497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.950638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.950752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.950778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.950894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.951159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.951368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.951596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.951833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.951993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.952106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.952217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.952244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.952357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.952466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.952493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.952576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.952692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.952718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.952857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.952975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.953003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.953121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.953203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.953230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.953358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.953438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.953463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.953577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.953682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.953709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.953833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.953949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.953985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.954102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.954179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.954206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.954318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.954401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.954429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.954520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.954630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.954657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.954829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.954973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.955006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.955131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.955295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.955340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.955427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.955585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.955630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.955712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.955822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.955848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.955987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.956131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.956157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.956314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.956496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.956542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.956684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.956821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.956847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.956927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.957037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.957068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.733 qpair failed and we were unable to recover it. 00:28:08.733 [2024-11-29 17:10:19.957175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.733 [2024-11-29 17:10:19.957280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.957309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.957465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.957622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.957649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.957761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.957843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.957870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.957964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.958082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.958109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.958222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.958362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.958389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.958481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.958597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.958624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.958744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.958828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.958855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.958937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.959050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.959077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.959164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.959280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.959306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.959460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.959601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.959631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.959751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.959843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.959871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.959987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.960094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.960126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.960259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.960348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.960376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.960521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.960608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.960634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.960748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.960830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.960860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.960972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.961064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.961091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.961205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.961324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.961350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.961434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.961516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.961542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.961632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.961742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.961772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.961890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.961979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.962007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.962090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.962175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.962202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.962329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.962426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.962456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.962570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.962657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.962683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.962780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.962864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.962892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.963030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.963143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.963170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.963278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.963389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.963414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.963501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.963636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.963662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.963783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.963880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.963908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.964009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.964097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.964124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.734 qpair failed and we were unable to recover it. 00:28:08.734 [2024-11-29 17:10:19.964283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.734 [2024-11-29 17:10:19.964405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.964442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.964568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.964716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.964745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.964864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.965020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.965064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.965182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.965268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.965294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.965408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.965531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.965560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.965660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.965785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.965814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.965901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.966013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.966041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.966155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.966269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.966295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.966401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.966490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.966519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.966672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.966795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.966826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.966935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.967059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.967086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.967199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.967284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.967328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.967428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.967529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.967563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.967664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.967766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.967795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.967955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.968069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.968099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.968214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.968357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.968384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.968490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.968634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.968663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.968782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.968909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.968939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.969085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.969201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.969229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.969359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.969487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.969516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.969636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.969728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.969758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.969855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.969979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.970026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.970118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.970220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.970247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.970356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.970436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.970478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.970600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.970722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.970751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.970883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.970966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.970993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.971084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.971169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.971195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.971301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.971409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.971438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.971594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.971713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.971742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.735 qpair failed and we were unable to recover it. 00:28:08.735 [2024-11-29 17:10:19.971865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.735 [2024-11-29 17:10:19.971968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.972014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.972155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.972236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.972262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.972348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.972434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.972460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.972604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.972716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.972748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.972832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.972939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.972974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.973057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.973140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.973167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.973283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.973359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.973386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.973507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.973591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.973617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.973732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.973809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.973852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.973965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.974054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.974082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.974166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.974285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.974311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.974454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.974572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.974598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.974713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.974796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.974823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.974909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.975028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.975061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.975148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.975251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.975278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.975358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.975469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.975495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.975579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.975724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.975750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.975864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.975981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.976008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.976097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.976230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.976256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.976390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.976474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.976501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.976590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.976700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.976727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.976877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.976990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.977018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.977104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.977214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.977240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.977333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.977425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.977457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.977552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.977631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.977658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.736 [2024-11-29 17:10:19.977768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.977855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.736 [2024-11-29 17:10:19.977882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.736 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.978003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.978118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.978144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.978253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.978360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.978386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.978462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.978552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.978578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.978662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.978743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.978768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.978880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.978989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.979015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.979109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.979219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.979245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.979330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.979434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.979460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.979540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.979625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.979655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.979761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.979881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.979910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.980063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.980176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.980202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.980285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.980401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.980427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.980538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.980628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.980655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.980799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.980883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.980911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.981048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.981138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.981167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.981256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.981345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.981373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.981464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.981577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.981603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.981716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.981799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.981825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.981935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.982018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.982046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.982164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.982278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.982304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.982396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.982502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.982528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.982641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.982730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.982756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.982870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.983122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.983347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.983572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.983793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.983898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.983985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.984064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.984089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.984184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.984293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.984318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.737 qpair failed and we were unable to recover it. 00:28:08.737 [2024-11-29 17:10:19.984441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.737 [2024-11-29 17:10:19.984548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.984574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.984657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.984739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.984766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.984851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.984983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.985010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.985126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.985241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.985267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.985358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.985438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.985464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.985576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.985715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.985741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.985830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.985940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.985973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.986059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.986136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.986161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.986279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.986395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.986422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.986537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.986627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.986654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.986734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.986841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.986867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.986996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.987140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.987167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.987254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.987333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.987359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.987470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.987554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.987579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.987660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.987738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.987764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.987906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.988043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.988071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.988157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.988264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.988290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.988429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.988542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.988568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.988692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.988771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.988797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.988887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.989122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.989371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.989558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.989790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.989950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.990098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.990192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.990219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.990295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.990409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.990435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.990517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.990624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.990650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.990764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.990909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.990936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.991073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.991194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.991221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.738 qpair failed and we were unable to recover it. 00:28:08.738 [2024-11-29 17:10:19.991334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.738 [2024-11-29 17:10:19.991446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.991472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.991596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.991679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.991704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.991793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.991876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.991902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.992021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.992110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.992137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.992252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.992343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.992370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.992486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.992600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.992627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.992771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.992884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.992910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.993034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.993175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.993202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.993340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.993432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.993460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.993572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.993658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.993684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.993800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.993913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.993940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.994064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.994160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.994187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.994280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.994360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.994386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.994469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.994556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.994583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.994659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.994802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.994828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.994931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.995077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.995104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.995195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.995339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.995365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.995478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.995586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.995612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.995724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.995809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.995835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.995915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.996009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.996036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.996122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.996212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.996238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.996346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.996463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.996497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.996652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.996802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.996847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.996976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.997072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.997101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.997211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.997315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.997342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.997428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.997536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.997562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.997655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.997770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.997798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.997945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.998037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.998065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.739 [2024-11-29 17:10:19.998208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.998324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.739 [2024-11-29 17:10:19.998351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.739 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:19.998437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.998547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.998573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:19.998671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.998795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.998824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:19.998935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.999086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.999117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:19.999222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.999379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.999410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:19.999509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.999605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.999634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:19.999750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.999870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:19.999900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.000008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.000104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.000131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.000233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.000359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.000387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.000486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.000609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.000639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.000753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.000856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.000887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.001044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.001168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.001205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.001346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.001447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.001485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.001608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.001707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.001735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.001852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.001944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.001977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.002072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.002182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.002207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.002293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.002369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.002393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.002502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.002657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.002685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.002786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.002915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.002942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.003032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.003116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.003141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.003256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.003338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.003363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.003502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.003594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.003623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.003718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.003867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.003905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.004018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.004115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.004141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.004262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.004340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.004367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.004487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.004624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.004653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.740 qpair failed and we were unable to recover it. 00:28:08.740 [2024-11-29 17:10:20.004791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.740 [2024-11-29 17:10:20.004877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.004903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.005036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.005156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.005183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.005289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.005376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.005404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.005531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.005652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.005680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.005780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.005866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.005893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.006044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.006124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.006149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.006288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.006371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.006415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.006538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.006652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.006686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.006806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.006910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.006935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.007041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.007170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.007201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.007342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.007446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.007476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.007591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.007732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.007759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.007872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.007964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.007992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.008080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.008177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.008206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.008322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.008406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.008437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.008552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.008641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.008668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.008762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.008848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.008875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.008993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.009134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.009167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.009264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.009347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.009374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.009453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.009536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.009561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.009675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.009788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.009815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.009904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.009984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.010010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.010104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.010193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.010220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.010312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.010396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.010422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.010512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.010603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.010633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.010754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.010860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.010888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.010982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.011066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.011091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.011224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.011308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.011341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.011459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.011569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.011596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.741 qpair failed and we were unable to recover it. 00:28:08.741 [2024-11-29 17:10:20.011682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.741 [2024-11-29 17:10:20.011766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.011793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.011908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.012131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.012334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.012561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.012818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.012928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.013029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.013121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.013149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.013238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.013361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.013388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.013495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.013635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.013666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.013802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.013925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.013952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.014056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.014150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.014177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.014307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.014436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.014466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.014557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.014665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.014692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.014773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.014886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.014913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.015065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.015152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.015178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.015295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.015421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.015447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.015558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.015699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.015726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.015842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.015927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.015954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.016049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.016135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.016162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.016250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.016364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.016391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.016535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.016617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.016643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.016762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.016844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.016870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.016990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.017124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.017151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.017272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.017369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.017395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.017492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.017600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.017627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.017729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.017813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.017838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.017944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.018043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.018071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.018163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.018255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.018282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.742 qpair failed and we were unable to recover it. 00:28:08.742 [2024-11-29 17:10:20.018376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.018463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.742 [2024-11-29 17:10:20.018488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.018582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.018663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.018687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.018772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.018851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.018876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.018969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.019163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.019375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.019590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.019829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.019966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.020050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.020162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.020187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.020330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.020450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.020475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.020586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.020806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.020830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.020947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.021102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.021127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.021221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.021306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.021332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.021476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.021634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.021661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.021779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.021866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.021890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.022059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.022193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.022223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.022408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.022497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.022525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.022626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.022748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.022775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.022892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.022999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.023026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.023165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.023279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.023305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.023415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.023526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.023552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.023696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.023811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.023839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.023987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.024071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.024098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.024210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.024350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.024377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.024490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.024604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.024631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.024766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.024963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.024991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.025127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.025265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.025292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.025406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.025525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.025551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.025670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.025807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.025833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.743 qpair failed and we were unable to recover it. 00:28:08.743 [2024-11-29 17:10:20.025921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.743 [2024-11-29 17:10:20.026041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.026068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.026155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.026238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.026265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.026352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.026490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.026517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.026639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.026780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.026807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.026893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.027125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.027375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.027624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.027879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.027991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.028078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.028191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.028217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.028346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.028461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.028488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.028627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.028739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.028766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.028940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.029069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.029100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.029251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.029375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.029402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.029511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.029635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.029664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.029759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.029878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.029906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.030036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.030175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.030207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.030317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.030444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.030476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.030582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.030704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.030733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.030821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.030937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.030997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.031111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.031230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.031271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.031397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.031503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.031531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.031628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.031720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.031749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.031847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.031979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.032023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.032164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.032243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.032269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.032386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.032535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.032563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.032682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.032776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.032805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.032931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.033025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.033051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.033128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.033258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.033286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.744 qpair failed and we were unable to recover it. 00:28:08.744 [2024-11-29 17:10:20.033409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.744 [2024-11-29 17:10:20.033496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.033526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.033615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.033801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.033830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.033971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.034067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.034092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.034190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.034314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.034348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.034491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.034589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.034618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.034748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.034874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.034916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.035010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.035098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.035123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.035228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.035340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.035366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.035503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.035640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.035666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.035771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.035894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.035923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.036059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.036150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.036177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.036308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.036427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.036456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.036570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.036695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.036724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.036819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.036945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.036991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.037127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.037234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.037260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.037355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.037525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.037553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.037650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.037737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.037766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.037863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.037943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.037995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.038105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.038217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.038261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.038396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.038476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.038503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.038625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.038749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.038778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.038871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.038978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.039005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.039113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.039202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.039228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.039308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.039471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.039500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.039657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.039739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.039767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.745 qpair failed and we were unable to recover it. 00:28:08.745 [2024-11-29 17:10:20.039861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.745 [2024-11-29 17:10:20.039972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.039999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.040118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.040276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.040305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.040405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.040564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.040607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.040757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.040878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.040907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.041025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.041115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.041142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.041222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.041380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.041409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.041570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.041685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.041713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.041812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.041935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.041971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.042102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.042181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.042208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.042376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.042502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.042531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.042645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.042740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.042770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.042864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.043001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.043030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.043142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.043217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.043243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.043326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.043417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.043443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.043589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.043755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.043780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.043919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.044035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.044062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.044174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.044320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.044349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.044507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.044654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.044680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.044761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.044877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.044904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.045046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.045146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.045175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.045263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.045359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.045388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.045520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.045636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.045670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.045822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.045975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.046002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.046130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.046245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.046274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.046409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.046527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.046553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.046686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.046810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.046838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.046952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.047081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.047108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.047228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.047306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.047332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.047443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.047547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.047573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.746 qpair failed and we were unable to recover it. 00:28:08.746 [2024-11-29 17:10:20.047687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.746 [2024-11-29 17:10:20.047798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.047824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.048015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.048098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.048124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.048242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.048332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.048377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.048528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.048617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.048646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.048807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.048915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.048940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.049078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.049237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.049264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.049393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.049521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.049549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.049663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.049758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.049788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.049918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.050027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.050054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.050139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.050267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.050296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.050432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.050572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.050602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.050691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.050806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.050832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.050923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.051045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.051072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.051153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.051261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.051286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.051398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.051479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.051502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.051609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.051689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.051712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.051859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.052004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.052029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.052156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.052282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.052306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.052395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.052543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.052570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.052668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.052781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.052805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.052899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.053011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.053038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.053167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.053326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.053350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.053495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.053616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.053640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.053766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.053914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.053940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.054050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.054132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.054159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.054322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.054472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.054512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.054622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.054743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.054771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.054872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.054977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.747 [2024-11-29 17:10:20.055005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.747 qpair failed and we were unable to recover it. 00:28:08.747 [2024-11-29 17:10:20.055112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.055218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.055242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.055359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.055446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.055470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.055552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.055631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.055655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.055800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.055909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.055932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.056038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.056119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.056144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.056216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.056329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.056354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.056440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.056548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.056572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.056656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.056761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.056788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.056874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.057112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.057308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.057514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.057795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.057929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.058046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.058171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.058201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.058292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.058406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.058434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.058554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.058661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.058688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.058797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.058902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.058928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.059060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.059144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.059169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.059254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.059339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.059365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.059473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.059584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.059610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.059697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.059810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.059836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.059950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.060095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.060122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.060207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.060300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.060327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.060440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.060563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.060590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.060677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.060762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.060790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.060931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.061076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.061104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.061299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.061385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.061413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.061528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.061640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.061667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.748 [2024-11-29 17:10:20.061753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.061840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.748 [2024-11-29 17:10:20.061868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.748 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.061970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.062166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.062406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.062607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.062829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.062949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.063053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.063165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.063191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.063302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.063378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.063404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.063495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.063573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.063599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.063740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.063858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.063885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.063981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.064205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.064402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.064607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.064839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.064949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.065074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.065172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.065199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.065298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.065416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.065443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.065552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.065640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.065668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.065750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.065873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.065899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.065996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.066113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.066140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.066261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.066374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.066401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.066487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.066597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.066624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.066719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.066832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.066859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.066965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.067092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.067123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.067215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.067311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.067339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.067429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.067550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.067576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.067654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.067791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.067817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.067905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.068009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.068038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.749 [2024-11-29 17:10:20.068128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.068216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:08.749 [2024-11-29 17:10:20.068243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:08.749 qpair failed and we were unable to recover it. 00:28:08.750 [2024-11-29 17:10:20.068329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.068457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.068484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.033 qpair failed and we were unable to recover it. 00:28:09.033 [2024-11-29 17:10:20.068571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.068688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.068715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.033 qpair failed and we were unable to recover it. 00:28:09.033 [2024-11-29 17:10:20.068830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.068912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.068938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.033 qpair failed and we were unable to recover it. 00:28:09.033 [2024-11-29 17:10:20.069031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.069114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.069142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.033 qpair failed and we were unable to recover it. 00:28:09.033 [2024-11-29 17:10:20.069260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.069336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.069363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.033 qpair failed and we were unable to recover it. 00:28:09.033 [2024-11-29 17:10:20.069473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.069554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.069589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.033 qpair failed and we were unable to recover it. 00:28:09.033 [2024-11-29 17:10:20.069706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.033 [2024-11-29 17:10:20.069809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.069849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.069971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.070111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.070145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.070258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.070362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.070405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.070545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.070651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.070694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.070819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.070922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.070955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.071055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.071248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.071444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.071655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.071857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.071999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.072083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.072173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.072205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.072297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.072380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.072407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.072489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.072570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.072597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.072689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.072802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.072828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.072908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.072987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.073015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.073107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.073224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.073251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.073379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.073468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.073496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.073622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.073712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.073738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.073833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.073979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.074006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.074097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.074192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.074220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.074316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.074400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.074432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.074549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.074654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.074681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.074799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.074936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.074969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.075062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.075182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.075209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.075325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.075416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.075443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.075582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.075721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.075747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.075836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.075923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.075949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.076041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.076151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.076177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.034 [2024-11-29 17:10:20.076373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.076508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.034 [2024-11-29 17:10:20.076535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.034 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.076651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.076769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.076795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.076886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.076999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.077031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.077109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.077222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.077248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.077336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.077448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.077474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.077558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.077656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.077682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.077789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.077899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.077925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.078018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.078100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.078126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.078206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.078321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.078348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.078486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.078567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.078594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.078707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.078818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.078845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.078935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.079021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.079048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.079143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.079261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.079287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.079381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.079490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.079518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.079609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.079690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.079717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.079816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.080027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.080054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.080145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.080225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.080251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.080344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.080424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.080452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.080543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.080705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.080731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.080885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.081025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.081052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.081173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.081286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.081312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.081426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.081574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.081601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.081717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.081794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.081820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.081914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.082039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.082067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.082188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.082297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.082324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.082472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.082589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.082616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.082735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.082849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.082877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.082987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.083143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.083169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.083318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.083435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.083461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.035 qpair failed and we were unable to recover it. 00:28:09.035 [2024-11-29 17:10:20.083578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.035 [2024-11-29 17:10:20.083693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.083734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.083855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.083952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.083985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.084119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.084211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.084248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.084355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.084499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.084526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.084650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.084799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.084826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.084906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.084992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.085019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.085099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.085211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.085238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.085383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.085492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.085519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.085662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.085778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.085805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.085951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.086044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.086071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.086190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.086331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.086359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.086447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.086560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.086588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.086729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.086848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.086874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.086985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.087074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.087100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.087241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.087354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.087380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.087474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.087586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.087613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.087807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.087902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.087928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.088044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.088184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.088210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.088300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.088446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.088472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.088591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.088677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.088703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.088825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.088914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.088941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.089042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.089241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.089268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.089378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.089489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.089515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.089620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.089734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.089761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.089876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.089983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.090011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.090090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.090280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.090308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.090386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.090525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.090551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.090673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.090793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.090820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.090953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.091094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.036 [2024-11-29 17:10:20.091121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.036 qpair failed and we were unable to recover it. 00:28:09.036 [2024-11-29 17:10:20.091259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.091373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.091401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.091513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.091653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.091679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.091832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.091939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.091970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.092080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.092207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.092235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.092351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.092443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.092470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.092618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.092709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.092736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.092849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.092973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.093001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.093092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.093199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.093227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.093365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.093510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.093536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.093622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.093758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.093784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.093892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.094034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.094062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.094177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.094323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.094350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.094433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.094549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.094576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.094695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.094831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.094858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.094971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.095079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.095106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.095227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.095370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.095397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.095515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.095592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.095619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.095725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.095886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.095915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.096039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.096120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.096147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.096260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.096370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.096398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.096540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.096682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.096708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.096856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.096969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.096997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.097120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.097233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.097260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.097380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.097514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.097541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.097683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.097797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.097825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.097973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.098085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.098111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.098193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.098308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.098334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.098417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.098555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.098581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.037 [2024-11-29 17:10:20.098693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.098804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.037 [2024-11-29 17:10:20.098831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.037 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.098971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.099083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.099110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.099226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.099337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.099363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.099477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.099580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.099606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.099725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.099863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.099890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.100032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.100115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.100143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.100227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.100336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.100364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.100475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.100588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.100615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.100808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.100948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.100991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.101133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.101218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.101246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.101360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.101441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.101469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.101580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.101669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.101697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.101836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.101927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.101953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.102049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.102159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.102185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.102335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.102450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.102477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.102618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.102758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.102785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.102917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.103087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.103114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.103207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.103327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.103353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.103463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.103579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.103605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.103681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.103796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.103822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.103942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.104039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.104065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.104151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.104232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.104259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.104366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.104483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.104509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.104598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.104735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.104762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.104874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.104985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.038 [2024-11-29 17:10:20.105013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.038 qpair failed and we were unable to recover it. 00:28:09.038 [2024-11-29 17:10:20.105158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.105273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.105300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.105391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.105500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.105526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.105606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.105723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.105749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.105890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.106031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.106059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.106185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.106297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.106323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.106448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.106565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.106592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.106784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.106921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.106948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.107069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.107154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.107182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.107300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.107409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.107436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.107573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.107687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.107714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.107805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.107919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.107947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.108065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.108256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.108283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.108399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.108519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.108546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.108630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.108765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.108791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.108936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.109080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.109107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.109186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.109295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.109321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.109442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.109582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.109608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.109703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.109814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.109840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.109967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.110086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.110112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.110252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.110336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.110362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.110446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.110563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.110590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.110673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.110785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.110811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.110939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.111065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.111096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.111208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.111316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.111343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.111462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.111542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.111568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.111666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.111804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.111830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.111948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.112073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.112100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.112186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.112302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.112329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.039 [2024-11-29 17:10:20.112472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.112586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.039 [2024-11-29 17:10:20.112612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.039 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.112743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.112869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.112898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.113082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.113216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.113246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.113397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.113554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.113598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.113755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.113911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.113944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.114066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.114200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.114244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.114357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.114474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.114501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.114618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.114766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.114793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.114915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.115040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.115068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.115181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.115289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.115316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.115404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.115480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.115506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.115611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.115755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.115781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.115910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.115993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.116021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.116103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.116213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.116239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.116351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.116439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.116470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.116616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.116711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.116737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.116821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.116927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.116954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.117047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.117119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.117145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.117258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.117371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.117398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.117517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.117630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.117656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.117773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.117888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.117914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.118042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.118126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.118153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.118293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.118428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.118454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.118584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.118703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.118729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.118838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.118922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.118953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.119076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.119187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.119213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.119353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.119462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.119490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.119634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.119737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.119764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.119849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.119953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.119988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.040 qpair failed and we were unable to recover it. 00:28:09.040 [2024-11-29 17:10:20.120094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.040 [2024-11-29 17:10:20.120178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.120205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.120348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.120428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.120455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.120595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.120712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.120738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.120854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.120973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.121001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.121140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.121249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.121276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.121362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.121479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.121506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.121654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.121768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.121795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.121916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.122032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.122059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.122168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.122304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.122331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.122473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.122610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.122637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.122718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.122825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.122852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.122933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.123019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.123047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.123194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.123364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.123398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.123568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.123710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.123737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.123854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.123970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.124014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.124109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.124261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.124290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.124417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.124534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.124564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.124692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.124819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.124850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.124985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.125096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.125141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.125273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.125376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.125404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.125538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.125665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.125691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.125809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.125952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.125984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.126115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.126280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.126324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.126482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.126639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.126665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.126746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.126828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.126855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.127017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.127144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.127173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.127358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.127513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.127540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.127652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.127760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.127787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.127902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.128008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.128036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.041 qpair failed and we were unable to recover it. 00:28:09.041 [2024-11-29 17:10:20.128145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.041 [2024-11-29 17:10:20.128227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.128253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.128359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.128444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.128471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.128548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.128632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.128660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.128771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.128886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.128913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.129020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.129153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.129185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.129282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.129395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.129423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.129540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.129657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.129686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.129810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.129949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.129986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.130092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.130211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.130240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.130389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.130512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.130540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.130675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.130819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.130846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.130987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.131082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.131109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.131215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.131299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.131326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.131433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.131583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.131613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.131734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.131868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.131897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.132040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.132178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.132208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.132419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.132538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.132567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.132673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.132778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.132807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.132907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.133025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.133065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.133177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.133286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.133312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.133450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.133542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.133573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.133693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.133816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.133846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.134003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.134143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.134170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.134257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.134365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.134392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.134507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.134597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.134623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.042 qpair failed and we were unable to recover it. 00:28:09.042 [2024-11-29 17:10:20.134747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.134883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.042 [2024-11-29 17:10:20.134912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.135058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.135176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.135203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.135326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.135415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.135442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.135569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.135697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.135727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.135878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.136019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.136047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.136160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.136306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.136332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.136474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.136629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.136674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.136797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.136929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.136966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.137058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.137218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.137264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.137429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.137595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.137650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.137768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.137882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.137913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.138069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.138246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.138289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.138432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.138588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.138633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.138749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.138864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.138890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.139031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.139159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.139189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.139350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.139462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.139489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.139596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.139708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.139735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.139832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.139938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.139971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.140073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.140183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.140221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.140336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.140460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.140486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.140602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.140738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.140765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.140854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.140977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.141009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.141129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.141252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.141281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.141404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.141492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.141519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.141660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.141801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.141829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.141917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.142006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.142039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.142174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.142306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.142333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.142421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.142530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.142556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.142705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.142812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.043 [2024-11-29 17:10:20.142839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.043 qpair failed and we were unable to recover it. 00:28:09.043 [2024-11-29 17:10:20.142948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.143044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.143071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.143157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.143264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.143290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.143431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.143553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.143580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.143716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.143798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.143826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.143940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.144116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.144165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.144258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.144343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.144370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.144510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.144597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.144623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.144730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.144857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.144884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.144981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.145092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.145119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.145241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.145379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.145406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.145523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.145658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.145684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.145797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.145913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.145939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.146038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.146123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.146149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.146287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.146410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.146438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.146562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.146671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.146698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.146794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.146903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.146929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.147047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.147130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.147157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.147271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.147381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.147408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.147514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.147633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.147659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.147775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.147858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.147884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.147966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.148185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.148449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.148648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.148882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.148999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.149194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.149337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.149363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.149509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.149598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.149624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.149764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.149845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.149873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.044 qpair failed and we were unable to recover it. 00:28:09.044 [2024-11-29 17:10:20.150023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.150134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.044 [2024-11-29 17:10:20.150179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.150302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.150384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.150411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.150604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.150717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.150742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.150856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.150948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.150989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.151103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.151195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.151223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.151360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.151514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.151545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.151631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.151779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.151806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.151943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.152081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.152111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.152219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.152754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.152785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.152916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.153042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.153073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.153217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.153379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.153406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.153487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.153601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.153628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.153772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.153862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.153890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.153999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.154116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.154142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.154225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.154308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.154334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.154479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.154673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.154706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.154814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.155012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.155043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.155230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.155362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.155389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.155532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.155648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.155674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.155791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.155870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.155898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.156063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.156224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.156267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.156408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.156600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.156626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.156767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.156908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.156935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.157062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.157180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.157212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.157310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.157478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.157521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.157721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.157882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.157914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.158064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.158156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.158182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.158324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.158453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.158482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.158605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.158751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.158779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.045 qpair failed and we were unable to recover it. 00:28:09.045 [2024-11-29 17:10:20.158888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.045 [2024-11-29 17:10:20.159010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.159038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.159153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.159288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.159316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.159411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.159531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.159559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.159672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.159806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.159835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.159969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.160071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.160097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.160182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.160263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.160289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.160400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.160487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.160522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.160607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.160759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.160787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.160910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.161056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.161083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.161196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.161315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.161359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.161504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.161602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.161631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.161765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.161885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.161914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.162030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.162115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.162141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.162232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.162362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.162392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.162481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.162570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.162599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.162748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.162907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.162936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.163084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.163222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.163257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.163352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.163489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.163518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.163644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.163731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.163760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.163906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.164055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.164082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.164633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.164797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.164828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.164984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.165094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.165121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.165212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.165298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.165342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.165498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.165612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.165642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.165760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.165880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.165922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.166069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.166162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.166189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.166348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.166474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.166503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.166635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.166754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.166782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.166919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.167039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.046 [2024-11-29 17:10:20.167066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.046 qpair failed and we were unable to recover it. 00:28:09.046 [2024-11-29 17:10:20.167185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.167322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.167363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.167473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.167557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.167600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.167734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.167885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.167913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.168054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.168137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.168164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.168262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.168411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.168439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.168597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.168719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.168748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.168913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.169083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.169110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.169689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.169826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.169857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.169996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.170092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.170118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.170249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.170350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.170378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.170506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.170661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.170687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.170815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.170906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.170934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.171080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.171171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.171197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.171344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.171486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.171512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.171597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.171676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.171704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.171839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.171931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.171968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.172085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.172174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.172200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.172291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.172407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.172433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.172598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.172695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.172720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.172800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.172889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.172916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.173016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.173100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.173126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.173214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.173351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.173395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.173537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.173678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.173704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.173793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.173873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.173900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.174024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.174145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.174171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.047 qpair failed and we were unable to recover it. 00:28:09.047 [2024-11-29 17:10:20.174323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.174483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.047 [2024-11-29 17:10:20.174513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.174631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.174723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.174748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.174848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.174981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.175029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.175120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.175191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.175218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.175310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.175386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.175412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.175499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.175624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.175652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.175744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.175865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.175894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.176001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.176090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.176116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.176191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.176296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.176324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.176421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.176503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.176532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.176669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.176782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.176809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.176950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.177084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.177111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.177186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.177271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.177298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.177387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.177508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.177534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.177670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.177760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.177790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.177915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.178036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.178063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.178155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.178322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.178348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.178480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.178599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.178627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.178761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.178849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.178891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.179033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.179139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.179165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.179246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.179407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.179435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.179555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.179707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.179735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.179908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.180052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.180078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.180196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.180288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.180314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.180433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.180521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.180547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.180673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.180796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.180821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.180938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.181077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.181104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.181189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.181351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.181377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.181484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.181572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.181598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.048 qpair failed and we were unable to recover it. 00:28:09.048 [2024-11-29 17:10:20.181693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.181775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.048 [2024-11-29 17:10:20.181800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.181890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.182130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.182370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.182625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.182856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.182982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.183072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.183157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.183183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.183296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.183398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.183426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.183587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.183669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.183695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.183803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.183914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.183939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.184032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.184109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.184135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.184222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.184331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.184358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.184473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.184587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.184613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.184739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.184827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.184856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.184969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.185055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.185081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.185166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.185305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.185334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.185483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.185616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.185642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.185729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.185805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.185831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.185915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.186035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.186061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.186150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.186284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.186313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.186441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.186520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.186547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.186676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.186805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.186834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.186921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.187155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.187346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.187587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.187826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.187939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.188039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.188131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.188156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.188243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.188358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.188383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.049 qpair failed and we were unable to recover it. 00:28:09.049 [2024-11-29 17:10:20.188500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.188586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.049 [2024-11-29 17:10:20.188612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.188729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.188812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.188856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.188947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.189065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.189091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.189201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.189317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.189343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.189504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.189596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.189625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.189721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.189849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.189878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.189988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.190066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.190092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.190178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.190288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.190316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.190426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.190523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.190549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.190665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.190756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.190782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.190888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.191027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.191054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.191137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.191234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.191260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.191374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.191514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.191540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.191647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.191732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.191760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.191873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.192000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.192046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.192161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.192252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.192279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.192420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.192525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.192551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.192659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.192744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.192770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.192932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.193058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.193084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.193168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.193249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.193294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.193392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.193480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.193508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.193649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.193757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.193783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.193897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.193991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.194019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.194097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.194183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.194209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.194335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.194415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.194441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.194530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.194614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.194640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.194759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.194898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.194930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.195047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.195136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.195162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.195255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.195365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.195391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.050 [2024-11-29 17:10:20.195485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.195628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.050 [2024-11-29 17:10:20.195657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.050 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.195797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.195903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.195929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.196046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.196130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.196174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.196274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.196383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.196408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.196550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.196635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.196660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.196754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.196845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.196874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.196972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.197184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.197387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.197602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.197815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.197915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.198004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.198157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.198183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.198274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.198382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.198426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.198563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.198652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.198678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.198754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.198869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.198894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.198983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.199130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.199155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.199270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.199374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.199399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.199507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.199581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.199607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.199722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.199851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.199880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.199980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.200081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.200106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.200188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.200289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.200318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.200408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.200528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.200573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.200662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.200771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.200797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.200888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.201018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.201046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.201186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.201269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.201295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.201413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.201527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.201552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.051 qpair failed and we were unable to recover it. 00:28:09.051 [2024-11-29 17:10:20.201682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.201795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.051 [2024-11-29 17:10:20.201823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.201915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.202141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.202338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.202536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.202772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.202906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.203088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.203175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.203204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.203321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.203441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.203470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.203605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.203719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.203745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.203879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.203984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.204014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.204113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.204233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.204262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.204369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.204486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.204512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.204617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.204704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.204748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.204835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.204926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.204956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.205071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.205158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.205184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.205271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.205407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.205435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.205566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.205680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.205707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.205793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.205901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.205927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.206009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.206163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.206189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.206274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.206389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.206415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.206554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.206643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.206669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.206787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.206919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.206970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.207056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.207143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.207175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.207322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.207411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.207437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.207541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.207629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.207657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.207754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.207879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.207907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.208035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.208123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.208149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.208249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.208338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.208364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.208442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.208532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.052 [2024-11-29 17:10:20.208560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.052 qpair failed and we were unable to recover it. 00:28:09.052 [2024-11-29 17:10:20.208695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.208806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.208831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.208946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.209042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.209068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.209149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.209270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.209296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.209412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.209496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.209529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.209635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.209735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.209761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.209880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.209995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.210022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.210147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.210235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.210261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.210341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.210455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.210482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.210623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.210762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.210787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.210901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.210985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.211012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.211099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.211179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.211204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.211285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.211378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.211404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.211518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.211631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.211657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.211758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.211887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.211913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.212053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.212139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.212165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.212260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.212372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.212397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.212536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.212612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.212638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.212721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.212830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.212856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.212943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.213073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.213098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.213187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.213340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.213366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.213452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.213539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.213565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.213651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.213753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.213779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.213862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.213976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.214002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.214088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.214175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.214201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.214320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.214421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.214447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.214535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.214647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.214672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.214755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.214834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.214860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.215004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.215085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.215111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.215200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.215322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.053 [2024-11-29 17:10:20.215348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.053 qpair failed and we were unable to recover it. 00:28:09.053 [2024-11-29 17:10:20.215434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.215522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.215547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.215662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.215748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.215773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.215884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.215983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.216009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.216090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.216198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.216224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.216343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.216420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.216445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.216522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.216665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.216691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.216773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.216909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.216937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.217054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.217138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.217164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.217251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.217359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.217385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.217495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.217577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.217603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.217689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.217794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.217820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.217897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.217984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.218011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.218091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.218179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.218205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.218331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.218416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.218442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.218531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.218615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.218640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.218726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.218807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.218833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.218908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.219023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.219049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.219147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.219229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.219262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.219370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.219507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.219533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.219650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.219759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.219785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.219882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.219997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.220024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.220114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.220197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.220223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.220330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.220405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.220431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.220521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.220629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.220655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.220769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.220857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.220883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.220969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.221089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.221119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.221201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.221289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.221315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.221433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.221543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.221568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.221679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.221786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.054 [2024-11-29 17:10:20.221812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.054 qpair failed and we were unable to recover it. 00:28:09.054 [2024-11-29 17:10:20.221920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.222045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.222071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.222158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.222255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.222282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.222421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.222514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.222540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.222649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.222756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.222782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.222891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.222972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.223004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.223088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.223203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.223228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.223337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.223446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.223472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.223566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.223677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.223703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.223815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.223976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.224013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.224089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.224166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.224191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.224286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.224371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.224396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.224479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.224562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.224587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.224726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.224831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.224861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.224978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.225198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.225394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.225597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.225865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.225991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.226078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.226286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.226471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.226662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.226841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.226953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.227042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.227123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.227148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.227229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.227307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.227331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.227442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.227547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.227572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.227687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.227765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.227791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.227914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.228008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.228034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.228116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.228202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.055 [2024-11-29 17:10:20.228227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.055 qpair failed and we were unable to recover it. 00:28:09.055 [2024-11-29 17:10:20.228345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.228448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.228473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.228559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.228698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.228724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.228827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.228923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.228951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.229066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.229153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.229179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.229297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.229379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.229405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.229526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.229609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.229635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.229744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.229822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.229848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.229938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.230174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.230413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.230591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.230810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.230919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.231034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.231149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.231174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.231264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.231353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.231378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.231488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.231603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.231628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.231710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.231803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.231829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.231914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.232114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.232312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.232518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.232769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.232874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.233048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.233123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.233148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.233251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.233364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.233390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.233510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.233604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.233629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.233713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.233828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.233855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.056 [2024-11-29 17:10:20.233977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.234059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.056 [2024-11-29 17:10:20.234086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.056 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.234175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.234291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.234321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.234433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.234521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.234546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.234670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.234781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.234807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.234894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.234987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.235017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.235103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.235185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.235211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.235297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.235442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.235467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.235577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.235647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.235673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.235778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.235884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.235910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.236006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.236089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.236114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.236201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.236299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.236325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.236441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.236523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.236548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.236642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.236749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.236775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.236887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.236969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.237021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.237146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.237242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.237267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.237360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.237440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.237465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.237557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.237640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.237665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.237790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.237909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.237937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.238111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.238196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.238232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.238311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.238395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.238430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.238512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.238651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.238677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.238779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.238868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.238896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.239032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.239155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.239183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.239296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.239413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.239448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.239549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.239672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.239700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.239818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.239935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.239968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.240074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.240152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.240178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.240316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.240394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.240431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.240524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.240662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.240688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.057 [2024-11-29 17:10:20.240775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.240858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.057 [2024-11-29 17:10:20.240883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.057 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.240969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.241061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.241087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.241166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.241254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.241280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.241366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.241472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.241498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.241585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.241683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.241726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.241893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.241985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.242019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.242117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.242204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.242230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.242315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.242393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.242419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.242501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.242638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.242663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.242786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.242901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.242944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.243076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.243160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.243187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.243300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.243428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.243456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.243558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.243657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.243684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.243778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.243869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.243895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.244002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.244088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.244130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.244238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.244359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.244391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.244510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.244663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.244689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.244776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.244889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.244915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.245039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.245122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.245147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.245240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.245368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.245393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.245502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.245627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.245653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.245741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.245812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.245836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.245956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.246046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.246073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.246153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.246238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.246264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.246375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.246478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.246504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.246616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.246746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.246776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.246896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.247037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.247063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.247178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.247321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.247346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.247429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.247506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.247532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.247617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.247730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.058 [2024-11-29 17:10:20.247756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.058 qpair failed and we were unable to recover it. 00:28:09.058 [2024-11-29 17:10:20.247881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.247985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.248012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.248103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.248189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.248215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.248294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.248365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.248391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.248501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.248616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.248641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.248733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.248856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.248882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.248970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.249076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.249102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.249192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.249310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.249336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.249428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.249507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.249533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.249640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.249757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.249783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.249894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.249987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.250016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.250131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.250210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.250235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.250324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.250399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.250425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.250549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.250636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.250661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.250774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.250871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.250897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.250992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.251142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.251168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.251250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.251335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.251361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.251473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.251558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.251584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.251664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.251747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.251773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.251911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.251997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.252024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.252145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.252238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.252264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.252379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.252453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.252479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.252559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.252680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.252705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.252796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.252889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.252915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.253031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.253168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.253194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.253284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.253367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.253394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.253482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.257065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.257107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.257243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.257400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.257427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.257542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.257625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.257651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.257739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.257820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.059 [2024-11-29 17:10:20.257846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.059 qpair failed and we were unable to recover it. 00:28:09.059 [2024-11-29 17:10:20.257986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.258115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.258141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.258237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.258333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.258361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.258498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.258587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.258614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.258695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.258805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.258831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.258944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.259185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.259385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.259574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.259777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.259921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.260021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.260112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.260138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.260250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.260336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.260361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.260479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.260595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.260622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.260706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.260831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.260857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.260970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.261084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.261110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.261196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.261275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.261301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.261417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.261529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.261554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.261642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.261752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.261777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.261892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.261987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.262027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.262134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.262246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.262272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.262354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.262435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.262460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.262547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.262631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.262658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.262744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.262854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.262880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.262994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.263088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.263113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.263204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.263317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.263343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.263463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.263551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.263576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.263666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.263781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.263806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.263901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.263986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.264025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.264114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.264186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.264212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.060 qpair failed and we were unable to recover it. 00:28:09.060 [2024-11-29 17:10:20.264299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.264375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.060 [2024-11-29 17:10:20.264400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.264480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.264598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.264624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.264742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.264838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.264864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.264953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.265040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.265066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.265178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.265286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.265312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.265400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.265484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.265510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.265627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.265755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.265783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.265900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.266121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.266341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.266561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.266761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.266891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.267000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.267207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.267400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.267629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.267833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.267978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.268067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.268192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.268218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.268301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.268383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.268408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.268490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.268580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.268605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.268716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.268836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.268868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.269032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.269152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.269179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.269266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.269351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.269378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.269466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.269550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.269593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.269700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.269805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.269831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.269935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.270033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.270060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.061 [2024-11-29 17:10:20.270145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.270269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.061 [2024-11-29 17:10:20.270295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.061 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.270439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.270523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.270548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.270635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.270758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.270785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.270906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.271166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.271399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.271623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.271815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.271963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.272063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.272156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.272181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.272300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.272412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.272438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.272523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.272635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.272661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.272743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.272837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.272882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.273002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.273095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.273121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.273242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.273346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.273372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.273476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.273573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.273607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.273722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.273830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.273874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.273956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.274048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.274073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.274166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.274251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.274278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.274392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.274501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.274527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.274632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.274711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.274737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.274819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.274986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.275022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.275137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.275234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.275260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.275367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.275479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.275505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.275611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.275719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.275744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.275884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.275971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.276002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.276092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.276168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.276194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.276307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.276391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.276416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.276554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.276665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.276691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.276779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.276891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.276917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.062 [2024-11-29 17:10:20.277015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.277105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.062 [2024-11-29 17:10:20.277132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.062 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.277220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.277298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.277324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.277468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.277552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.277578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.277664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.277745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.277771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.277883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.277993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.278019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.278101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.278186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.278223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.278308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.278421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.278447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.278563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.278714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.278740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.278842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.278934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.278982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.279062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.279145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.279171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.279287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.279399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.279426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.279515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.279620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.279646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.279736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.279843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.279868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.279965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.280176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.280385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.280584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.280851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.280966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.281071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.281148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.281175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.281296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.281380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.281406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.281516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.281611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.281637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.281742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.281854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.281880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.281988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.282068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.282094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.282196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.282283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.282309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.282401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.282486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.282512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.282628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.282767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.282808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.282900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.283016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.283043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.283133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.283221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.283256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.283397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.283510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.283535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.063 [2024-11-29 17:10:20.283634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.283744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.063 [2024-11-29 17:10:20.283769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.063 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.283852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.283925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.283951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.284070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.284151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.284177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.284320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.284399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.284425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.284533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.284645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.284670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.284783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.284895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.284939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.285119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.285203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.285229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.285394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.285482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.285509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.285617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.285690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.285716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.285842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.285980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.286016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.286094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.286176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.286202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.286315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.286394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.286420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.286506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.286631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.286657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.286739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.286857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.286882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.287013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.287092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.287118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.287197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.287322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.287348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.287432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.287546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.287571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.287652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.287744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.287777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.287907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.287995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.288032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.288114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.288229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.288255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.288371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.288477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.288503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.288594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.288746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.288772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.288848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.288999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.289033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.289145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.289239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.289265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.289369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.289445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.289470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.289586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.289762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.289806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.289899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.290048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.290074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.290159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.290247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.290274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.290355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.290492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.290517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.064 [2024-11-29 17:10:20.290698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.290806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.064 [2024-11-29 17:10:20.290832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.064 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.290918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.291052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.291079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.291166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.291294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.291322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.291434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.291579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.291607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.291778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.291933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.291965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.292048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.292160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.292185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.292292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.292402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.292428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.292536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.292661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.292687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.292800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.292923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.292948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.293060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.293134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.293160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.293308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.293392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.293418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.293563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.293653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.293681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.293778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.293905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.293942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.294042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.294122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.294150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.294233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.294341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.294367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.294485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.294623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.294649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.294784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.294903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.294931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.295054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.295142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.295168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.295257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.295369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.295395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.295479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.295561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.295586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.295663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.295745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.295770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.295875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.295979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.296015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.296103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.296220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.296245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.296337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.296445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.296489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.296581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.296742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.296767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.296856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.296985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.297012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.065 qpair failed and we were unable to recover it. 00:28:09.065 [2024-11-29 17:10:20.297110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.297187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.065 [2024-11-29 17:10:20.297213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.297351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.297463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.297491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.297630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.297772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.297798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.297907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.298073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.298099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.298190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.298379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.298405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.298517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.298625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.298651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.298786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.298912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.298940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.299056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.299198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.299232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.299381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.299499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.299525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.299658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.299780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.299809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.299947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.300046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.300073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.300155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.300233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.300258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.300412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.300518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.300545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.300654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.300760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.300790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.300943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.301048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.301074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.301163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.301289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.301315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.301429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.301519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.301546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.301629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.301723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.301749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.301858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.301990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.302034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.302134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.302218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.302261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.302424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.302533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.302559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.302689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.302774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.302802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.302924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.303033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.303060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.303141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.303241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.303267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.303361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.303477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.303503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.303592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.303695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.303721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.303859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.303980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.304006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.304095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.304206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.304232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.304316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.304451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.304494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.066 qpair failed and we were unable to recover it. 00:28:09.066 [2024-11-29 17:10:20.304633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.304725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.066 [2024-11-29 17:10:20.304751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.304832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.304974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.305013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.305098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.305252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.305278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.305419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.305508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.305534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.305642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.305752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.305778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.305911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.306125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.306151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.306252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.306362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.306388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.306474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.306608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.306637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.306762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.306859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.306887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.307006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.307099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.307124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.307215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.307311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.307337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.307421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.307530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.307558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.307661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.307776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.307802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.307892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.308002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.308028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.308108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.308210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.308238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.308345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.308451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.308476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.308637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.308747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.308778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.308874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.309004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.309031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.309117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.309202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.309231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.309364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.309522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.309550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.309669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.309797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.309824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.309943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.310052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.310078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.310186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.310307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.310335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.310502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.310620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.310647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.310727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.310845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.310871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.311011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.311142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.311170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.311266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.311377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.311405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.311507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.311626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.311652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.311806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.311892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.311934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.067 qpair failed and we were unable to recover it. 00:28:09.067 [2024-11-29 17:10:20.312038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.312126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.067 [2024-11-29 17:10:20.312151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.312237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.312348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.312374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.312464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.312542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.312569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.312674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.312808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.312837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.312951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.313053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.313079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.313166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.313300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.313327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.313471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.313623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.313656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.313774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.313878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.313904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.314035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.314139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.314183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.314320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.314451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.314494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.314613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.314754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.314780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.314945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.315080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.315106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.315207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.315372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.315414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.315549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.315670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.315695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.315798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.315896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.315922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.316033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.316212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.316238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.316360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.316469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.316499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.316613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.316790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.316818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.316936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.317085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.317113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.317290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.317400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.317426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.317529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.317693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.317721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.317850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.317975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.318019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.318127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.318271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.318297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.318406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.318522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.318547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.318635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.318757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.318800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.318924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.319037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.319065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.319176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.319288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.319334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.319456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.319580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.319623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.319764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.319868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.319893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.068 [2024-11-29 17:10:20.319977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.320101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.068 [2024-11-29 17:10:20.320128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.068 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.320225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.320362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.320391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.320520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.320632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.320657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.320737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.320846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.320872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.320966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.321079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.321105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.321186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.321300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.321326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.321452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.321566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.321592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.321707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.321853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.321881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.322019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.322217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.322446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.322628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.322846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.322963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.323100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.323182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.323221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.323349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.323489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.323515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.323609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.323726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.323753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.323886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.324027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.324055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.324150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.324236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.324262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.324373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.324525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.324557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.324644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.324732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.324758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.324859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.324986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.325036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.325174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.325299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.325328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.325494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.325605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.325631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.325746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.325833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.325859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.326003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.326103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.326130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.326263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.326437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.326463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.326552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.326662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.326689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.326873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.326975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.327020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.327128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.327238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.327266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.069 [2024-11-29 17:10:20.327433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.327541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.069 [2024-11-29 17:10:20.327567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.069 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.327661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.327809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.327837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.328001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.328098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.328126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.328253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.328343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.328369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.328520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.328672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.328697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.328784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.328968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.329005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.329121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.329228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.329254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.329384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.329567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.329593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.329708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.329883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.329909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.330034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.330149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.330179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.330267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.330358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.330384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.330557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.330662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.330691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.330798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.330888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.330914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.331020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.331094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.331120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.331254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.331373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.331401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.331507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.331643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.331669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.331780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.331886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.331915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.332137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.332272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.332300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.332398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.332508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.332534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.332638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.332794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.332838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.332972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.333148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.333174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.333255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.333339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.333365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.333481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.333584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.333626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.333712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.333841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.333867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.070 [2024-11-29 17:10:20.333940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.334033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.070 [2024-11-29 17:10:20.334060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.070 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.334153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.334233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.334259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.334398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.334546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.334574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.334706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.334789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.334814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.334955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.335112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.335138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.335279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.335401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.335429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.335574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.335711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.335736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.335877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.335987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.336033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.336194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.336359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.336400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.336506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.336639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.336665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.336812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.336922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.336949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.337104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.337194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.337220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.337344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.337458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.337484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.337597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.337726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.337755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.337851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.337950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.338000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.338076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.338160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.338186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.338353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.338449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.338478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.338599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.338758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.338784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.338897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.339030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.339056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.339202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.339309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.339334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.339488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.339608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.339637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.339804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.339910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.339936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.340079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.340217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.340259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.340340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.340452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.340479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.340589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.340672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.340698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.340829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.340972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.341017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.341157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.341289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.341318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.341449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.341565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.341591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.341678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.341796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.341822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.071 qpair failed and we were unable to recover it. 00:28:09.071 [2024-11-29 17:10:20.341902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.342046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.071 [2024-11-29 17:10:20.342073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.342154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.342230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.342255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.342368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.342500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.342527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.342653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.342757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.342784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.342914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.343059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.343086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.343200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.343296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.343325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.343432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.343520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.343547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.343673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.343847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.343880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.343988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.344084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.344110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.344227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.344337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.344365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.344485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.344580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.344609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.344735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.344904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.344932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.345098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.345187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.345213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.345325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.345412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.345437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.345581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.345652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.345694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.345869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.345992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.346023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.346163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.346268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.346295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.346430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.346556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.346597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.346746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.346881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.346910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.347009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.347088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.347114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.347250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.347397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.347423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.347539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.347646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.347688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.347843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.347935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.347965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.348053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.348171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.348198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.348340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.348469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.348497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.348636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.348717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.348744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.348859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.348972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.349015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.349124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.349278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.349306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.349449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.349588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.349613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.072 [2024-11-29 17:10:20.349725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.349850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.072 [2024-11-29 17:10:20.349878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.072 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.349966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.350065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.350091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.350204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.350320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.350346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.350441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.350601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.350627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.350717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.350828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.350854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.350970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.351119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.351145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.351256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.351351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.351380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.351494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.351609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.351637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.351800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.351915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.351941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.352112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.352231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.352259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.352362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.352485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.352527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.352664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.352800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.352826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.352967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.353060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.353089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.353212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.353366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.353392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.353479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.353595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.353621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.353700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.353855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.353883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.354012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.354161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.354189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.354277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.354410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.354436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.354518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.354654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.354697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.354799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.354911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.354937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.355034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.355145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.355171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.355316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.355447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.355473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.355632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.355806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.355833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.355988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.356127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.356153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.356233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.356390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.356416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.356507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.356621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.356648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.356734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.356818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.356844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.356964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.357113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.357141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.357292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.357411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.357440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.073 [2024-11-29 17:10:20.357567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.357704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.073 [2024-11-29 17:10:20.357734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.073 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.357870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.358030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.358058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.358182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.358297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.358325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.358463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.358576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.358602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.358715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.358851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.358878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.359000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.359138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.359164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.359302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.359386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.359411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.359543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.359665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.359690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.359803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.359909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.359935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.360091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.360229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.360255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.360339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.360447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.360477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.360571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.360655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.360681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.360809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.360899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.360941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.361060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.361171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.361198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.361285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.361432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.361458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.361571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.361708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.361733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.361873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.361986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.362012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.362129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.362210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.362236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.362354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.362435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.362461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.362549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.362684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.362712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.362831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.362992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.363018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.363163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.363274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.363299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.363381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.363488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.363514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.363629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.363737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.363763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.363861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.364000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.364026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.364151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.364283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.364310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.074 qpair failed and we were unable to recover it. 00:28:09.074 [2024-11-29 17:10:20.364449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.364535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.074 [2024-11-29 17:10:20.364563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.364698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.364776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.364803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.364920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.365013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.365040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.365131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.365239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.365265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.365380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.365495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.365522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.365612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.365724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.365750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.365845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.365988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.366015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.366094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.366200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.366226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.366338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.366478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.366504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.366600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.366685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.366712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.366816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.366926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.366952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.367084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.367194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.367220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.367336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.367447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.367473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.367587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.367724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.367750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.367864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.367946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.367980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.368070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.368215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.368241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.368324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.368428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.368454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.368565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.368677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.368703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.368842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.368923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.368949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.369049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.369190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.369216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.369297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.369403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.369429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.369579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.369700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.369727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.369832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.369970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.369998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.370087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.370180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.370206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.370316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.370426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.370452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.370598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.370746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.370772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.370884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.370980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.371007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.371086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.371173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.371199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.371311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.371415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.371441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.075 qpair failed and we were unable to recover it. 00:28:09.075 [2024-11-29 17:10:20.371550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.075 [2024-11-29 17:10:20.371691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.371717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.371856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.371978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.372005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.372130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.372213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.372240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.372329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.372439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.372465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.372601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.372713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.372739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.372852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.372979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.373006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.373112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.373219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.373249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.373333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.373445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.373472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.373623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.373725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.373751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.373833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.373944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.373979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.374064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.374149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.374175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.374317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.374426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.374452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.374559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.374669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.374695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.374800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.374913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.374939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.375112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.375207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.375237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.375321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.375457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.375483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.375633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.375745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.375768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.376196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.376343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.376370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.376495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.376610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.376635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.376746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.376854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.376879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.376971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.377058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.377084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.377197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.377309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.377335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.377472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.377585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.377611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.377715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.377851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.377877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.378002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.378120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.378146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.378286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.378373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.378397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.378502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.378586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.378611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.378730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.378842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.378867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.378977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.379092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.379117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.379236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.379350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.379376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.379497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.379610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.076 [2024-11-29 17:10:20.379635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.076 qpair failed and we were unable to recover it. 00:28:09.076 [2024-11-29 17:10:20.379752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.379871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.379896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.380009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.380104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.380129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.380237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.380327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.380353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.380467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.380576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.380600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.380713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.380823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.380848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.380968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.381176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.381399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.381623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.381814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.381918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.382042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.382153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.382180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.382263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.382373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.382399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.382508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.382613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.382638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.382751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.382888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.382913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.383015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.383101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.383126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.383239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.383378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.383403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.383523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.383609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.383634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.383715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.383828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.383852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.383937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.384141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.384386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.384604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.384853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.384969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.385110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.385224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.385249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.385331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.385439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.385464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.385547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.385663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.385688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.385800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.385874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.385899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.385983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.386057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.386082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.386197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.386306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.386330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.386442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.386521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.386546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.386629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.386710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.386735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.077 qpair failed and we were unable to recover it. 00:28:09.077 [2024-11-29 17:10:20.386815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.077 [2024-11-29 17:10:20.386920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.386945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.387040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.387126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.387150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.387269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.387376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.387400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.387511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.387621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.387645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.387761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.387872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.387898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.388006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.388126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.388151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.388298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.388381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.388406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.388523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.388628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.388653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.388793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.388870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.388895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.389004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.389154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.389179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.389268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.389374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.389399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.389480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.389590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.389614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.389719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.389834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.389859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.390001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.390082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.390107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.390196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.390305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.390330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.390441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.390546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.390575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.390651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.390756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.390780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.390920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.391066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.391091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.391198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.391335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.391359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.391476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.391612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.391637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.391722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.391830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.391855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.392001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.392141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.392165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.392288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.392399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.392424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.392534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.392675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.392699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.392813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.392888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.392913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.393035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.393143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.393168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.393278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.393387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.393412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.393491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.393600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.393625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.393739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.393843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.393868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.393983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.394064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.394089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.078 qpair failed and we were unable to recover it. 00:28:09.078 [2024-11-29 17:10:20.394196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.394326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.078 [2024-11-29 17:10:20.394351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.394467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.394546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.394570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.394674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.394812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.394837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.394952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.395046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.395071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.395177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.395296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.395320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.395404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.395509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.395533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.395647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.395748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.395773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.395863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.395980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.396006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.396090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.396196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.396221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.396361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.396471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.396496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.396572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.396677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.396701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.396785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.396892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.396917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.397050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.397161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.397186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.397291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.397373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.397397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.397506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.397596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.397621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.397709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.397847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.397872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.397998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.398114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.398139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.398228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.398310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.398334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.398421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.398495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.398520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.398609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.398713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.398738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.079 qpair failed and we were unable to recover it. 00:28:09.079 [2024-11-29 17:10:20.398854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.079 [2024-11-29 17:10:20.398970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.398995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.399102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.399208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.399232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.399344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.399454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.399479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.399589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.399732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.399756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.399873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.399965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.399991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.400077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.400156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.400181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.400317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.400432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.400457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.400541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.400652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.400677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.400824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.400935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.400968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.401057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.401175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.401200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.401287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.401395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.401420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.401561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.401707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.401732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.401816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.401896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.401920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.402055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.402134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.402159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.402302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.402424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.402452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.402586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.402700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.402725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.402801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.402883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.402912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.403046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.403160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.403185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.403336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.403442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.403467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.403550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.403666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.403691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.403773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.403883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.403908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.404018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.404239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.404449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.404635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.404871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.404983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.405102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.405214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.405244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.405328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.405465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.405490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.405628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.405754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.405781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.080 qpair failed and we were unable to recover it. 00:28:09.080 [2024-11-29 17:10:20.405937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.406080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.080 [2024-11-29 17:10:20.406105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.406191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.406285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.406310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.406446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.406551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.406575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.406651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.406734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.406758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.406841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.406948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.406998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.407079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.407217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.407242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.407359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.407498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.407523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.407634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.407739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.407764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.407850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.407954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.407987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.408102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.408205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.408230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.408337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.408439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.408463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.408575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.408698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.408725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.408830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.408949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.408982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.409091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.409200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.409225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.409331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.409485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.409512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.409665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.409808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.409836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.409994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.410136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.410161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.410275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.410400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.410426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.410544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.410632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.410657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.410743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.410857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.410881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.410968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.411179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.411381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.411624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.411842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.411940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.412051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.412165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.412190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.412299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.412378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.412403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.412539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.412677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.412701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.412814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.412900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.412924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.081 qpair failed and we were unable to recover it. 00:28:09.081 [2024-11-29 17:10:20.413051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.081 [2024-11-29 17:10:20.413163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.413188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.413303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.413412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.413437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.413551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.413659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.413684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.413773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.413908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.413933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.414054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.414138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.414163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.414260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.414376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.414400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.414485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.414563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.414587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.414698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.414836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.414861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.414992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.415225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.415484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.415656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.415861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.415995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.416112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.416192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.416217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.416356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.416461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.416485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.416596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.416676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.416701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.416793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.416906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.416931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.417054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.417161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.417186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.417264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.417398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.417422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.417498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.417604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.417633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.417713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.417892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.417916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.418002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.418120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.418145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.418238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.418383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.418408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.418487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.418597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.418622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.418769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.418907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.418934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.419107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.419193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.419217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.419307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.419392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.419417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.419527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.419602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.419627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.419702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.419845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.419870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.082 qpair failed and we were unable to recover it. 00:28:09.082 [2024-11-29 17:10:20.420011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.082 [2024-11-29 17:10:20.420095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.420120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.420258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.420375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.420399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.420512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.420617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.420642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.420752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.420830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.420854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.420971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.421063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.421088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.421236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.421342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.421366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.421456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.421565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.421590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.421670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.421752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.421777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.421921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.422121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.422332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.422522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.422766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.422893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.423010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.423121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.423146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.423263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.423372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.423397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.423537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.423652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.423677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.423757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.423836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.423861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.423982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.424123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.424148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.424227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.424299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.424323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.424463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.424573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.424597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.424743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.424875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.424918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.425063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.425138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.425163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.425278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.425392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.425416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.425496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.425608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.425633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.083 [2024-11-29 17:10:20.425745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.425832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.083 [2024-11-29 17:10:20.425857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.083 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.425971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.426063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.426088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.426207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.426288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.426313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.426432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.426517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.426542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.426632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.426773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.426797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.426918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.427079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.427105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.427216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.427324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.427348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.427458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.427539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.427564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.427678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.427781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.427806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.427896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.428149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.428374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.428614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.428855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.428995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.429106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.429211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.429236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.429348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.429427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.429452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.429562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.429707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.429732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.429813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.429923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.429954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.430081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.430198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.430223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.430339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.430486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.430511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.430624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.430732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.430757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.430869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.430981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.431007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.431119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.431234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.431258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.431400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.431486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.431511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.431618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.431727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.431753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.431861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.431973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.431998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.432107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.432188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.432212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.432322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.432436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.432461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.432575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.432656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.432681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.084 qpair failed and we were unable to recover it. 00:28:09.084 [2024-11-29 17:10:20.432808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.432920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.084 [2024-11-29 17:10:20.432945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.433026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.433109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.433134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.433240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.433328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.433353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.433491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.433575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.433600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.433712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.433795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.433820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.433934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.434028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.434054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.434168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.434276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.434301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.434438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.434554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.434578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.434694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.434822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.434848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.434990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.435110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.435136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.435248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.435326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.435351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.435424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.435539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.435563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.435650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.435798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.435823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.435909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.435991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.436017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.436131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.436219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.436244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.436329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.436466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.436491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.436608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.436693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.436736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.436846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.436968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.436994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.437072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.437161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.437185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.437296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.437430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.437459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.437556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.437668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.437694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.437810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.437899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.437925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.438049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.438135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.438162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.438275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.438386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.438411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.438538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.438680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.438706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.085 qpair failed and we were unable to recover it. 00:28:09.085 [2024-11-29 17:10:20.438821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.438906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.085 [2024-11-29 17:10:20.438932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.439024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.439141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.439166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.439297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.439470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.439495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.439584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.439675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.439701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.439788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.439910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.439936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.440068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.440159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.440185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.440329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.440415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.440441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.440529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.440604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.440629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.440721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.440808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.440833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.440964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.441186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.441387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.441605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.373 qpair failed and we were unable to recover it. 00:28:09.373 [2024-11-29 17:10:20.441795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.373 [2024-11-29 17:10:20.441929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.442025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.442236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.442457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.442648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.442871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.442992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.443115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.443224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.443250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.443362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.443480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.443506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.443591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.443679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.443705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.443793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.443901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.443926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.444022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.444133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.444158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.444239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.444363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.444388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.444496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.444580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.444607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.444690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.444779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.444804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.444910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.444985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.445021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.445132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.445215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.445240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.445361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.445470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.445496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.445601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.445704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.445729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.445867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.445953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.445985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.446101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.446213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.446239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.446324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.446463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.446488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.446600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.446710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.446740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.446852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.446965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.446991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.447109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.447216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.447242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.447322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.447434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.447459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.447570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.447711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.447736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.447851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.447988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.448015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.448097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.448180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.448206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.448294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.448403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.448429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.374 qpair failed and we were unable to recover it. 00:28:09.374 [2024-11-29 17:10:20.448540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.374 [2024-11-29 17:10:20.448675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.448700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.448813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.448892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.448917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.449025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.449103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.449133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.449241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.449345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.449370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.449480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.449600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.449625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.449744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.449829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.449854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.449996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.450139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.450164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.450252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.450358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.450384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.450473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.450581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.450606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.450719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.450834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.450861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.450939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.451035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.451061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.451173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.451282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.451308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.451419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.451506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.451543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.451653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.451767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.451792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.451943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.452059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.452085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.452207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.452343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.452369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.452449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.452591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.452617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.452721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.452829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.452854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.452968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.453090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.453115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.453233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.453349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.453375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.453519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.453630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.453656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.453768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.453882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.453907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.453997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.454140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.454169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.454259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.454350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.454376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.454493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.454598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.454623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.454742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.454826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.454869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.455001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.455118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.455144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.455296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.455410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.455456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.375 [2024-11-29 17:10:20.455634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.455777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.375 [2024-11-29 17:10:20.455804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.375 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.455931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.456019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.456046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.456163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.456248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.456275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.456388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.456503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.456529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.456671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.456813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.456838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.456968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.457101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.457126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.457244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.457350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.457376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.457501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.457612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.457638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.457775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.457862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.457887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.457977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.458086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.458111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.458192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.458278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.458304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.458423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.458560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.458585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.458694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.458778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.458802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.458912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.459030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.459055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.459172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.459285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.459310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.459423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.459539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.459565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.459690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.459830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.459856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.459933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.460065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.460095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.460261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.460386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.460411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.460502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.460615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.460640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.460764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.460872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.460897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.460977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.461104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.461132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.461238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.461349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.461374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.461521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.461604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.461630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.461744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.461857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.461884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.461978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.462105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.462131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.462221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.462335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.462360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.462475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.462574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.462600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.462686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.462794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.462821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.376 qpair failed and we were unable to recover it. 00:28:09.376 [2024-11-29 17:10:20.462932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.376 [2024-11-29 17:10:20.463040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.463067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.463160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.463271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.463297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.463389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.463501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.463528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.463613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.463751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.463776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.463863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.463952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.463987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.464108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.464194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.464219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.464340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.464423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.464450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.464560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.464670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.464696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.464818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.464943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.464976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.465062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.465198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.465226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.465332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.465419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.465445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.465567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.465676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.465702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.465785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.465869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.465896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.466010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.466091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.466117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.466199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.466306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.466331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.466441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.466550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.466575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.466672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.466782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.466809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.466899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.466984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.467011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.467124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.467236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.467261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.467402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.467510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.467536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.467616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.467698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.467724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.467838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.467921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.467946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.468039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.468123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.468148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.468233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.468315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.468340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.468446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.468558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.468583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.468707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.468794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.468821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.468940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.469036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.469062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.469173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.469251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.469276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.469363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.469506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.377 [2024-11-29 17:10:20.469533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.377 qpair failed and we were unable to recover it. 00:28:09.377 [2024-11-29 17:10:20.469683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.469768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.469794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.469881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.469986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.470013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.470129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.470217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.470242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.470328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.470414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.470439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.470540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.470618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.470643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.470753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.470837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.470863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.470953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.471221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.471415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.471609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.471808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.471918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.472019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.472101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.472127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.472251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.472331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.472358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.472440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.472582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.472608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.472724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.472806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.472832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.472950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.473034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.473059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.473200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.473295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.473320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.473409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.473526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.473551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.473643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.473758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.473784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.473897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.473991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.474018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.474103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.474245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.474271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.474351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.474469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.474494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.474577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.474659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.474684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.474766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.474908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.474933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.378 qpair failed and we were unable to recover it. 00:28:09.378 [2024-11-29 17:10:20.475026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.378 [2024-11-29 17:10:20.475196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.475224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.475333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.475456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.475480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.475617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.475730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.475755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.475865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.475965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.475992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.476074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.476192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.476217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.476336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.476416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.476441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.476535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.476646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.476671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.476754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.476867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.476893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.476986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.477180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.477402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.477611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.477850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.477999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.478090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.478236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.478262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.478353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.478440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.478467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.478554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.478668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.478694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.478795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.478905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.478930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.479047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.479174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.479199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.479329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.479417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.479443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.479555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.479641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.479668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.479780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.479891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.479916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.480038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.480154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.480180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.480264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.480347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.480373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.480479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.480596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.480621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.480715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.480853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.480879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.480990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.481103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.481128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.481214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.481333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.481359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.481453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.481574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.481601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.379 qpair failed and we were unable to recover it. 00:28:09.379 [2024-11-29 17:10:20.481713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.481822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.379 [2024-11-29 17:10:20.481848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.481927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.482025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.482051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.482143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.482305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.482330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.482438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.482551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.482576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.482658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.482770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.482795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.482911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.483154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.483407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.483602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.483820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.483935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.484069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.484182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.484207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.484294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.484370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.484396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.484536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.484620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.484664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.484769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.484849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.484875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.484971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.485085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.485112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.485227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.485357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.485387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.485477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.485567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.485591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.485681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.485795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.485820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.485917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.486124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.486352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.486576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.486800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.486911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.487012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.487216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.487416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.487615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.487866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.487989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.488130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.488216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.380 [2024-11-29 17:10:20.488243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.380 qpair failed and we were unable to recover it. 00:28:09.380 [2024-11-29 17:10:20.488345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.488437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.488463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.488578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.488662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.488688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.488778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.488869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.488894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.488986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.489098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.489124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.489237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.489347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.489372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.489457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.489544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.489569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.489650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.489764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.489794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.489879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.489994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.490021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.490131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.490219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.490244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.490353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.490467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.490492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.490578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.490666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.490693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.490808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.490921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.490947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.491071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.491182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.491207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.491322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.491432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.491458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.491537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.491651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.491676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.491793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.491877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.491904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.491995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.492114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.492143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.492235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.492316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.492341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.492432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.492546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.492571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.492658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.492739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.492764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.492876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.492982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.493009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.493136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.493218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.493243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.493326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.493437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.493462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.493569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.493680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.493706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.493802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.493918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.493944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.494047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.494128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.494155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.494241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.494361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.494386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.494485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.494575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.494602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.381 [2024-11-29 17:10:20.494720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.494802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.381 [2024-11-29 17:10:20.494827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.381 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.494915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.495007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.495035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.495130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.495220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.495246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.495363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.495476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.495501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.495619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.495732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.495757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.495879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.495993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.496020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.496135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.496244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.496270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.496382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.496464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.496491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.496582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.496662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.496687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.496802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.496913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.496939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.497036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.497120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.497146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.497241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.497379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.497405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.497543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.497635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.497660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.497746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.497828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.497854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.497974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.498196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.498425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.498612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.498836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.498954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.499104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.499188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.499213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.499331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.499444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.499469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.499557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.499733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.499758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.499877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.499990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.500017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.500104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.500233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.500263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.500395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.500506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.500531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.382 qpair failed and we were unable to recover it. 00:28:09.382 [2024-11-29 17:10:20.500640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.382 [2024-11-29 17:10:20.500733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.500758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.500843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.500954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.500988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.501104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.501240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.501265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.501375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.501462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.501488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.501584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.501701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.501726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.501815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.501928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.501953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.502058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.502140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.502167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.502290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.502405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.502431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.502520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.502635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.502660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.502800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.502881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.502908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.503024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.503115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.503141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.503223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.503339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.503366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.503452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.503539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.503565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.503677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.503761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.503788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.503880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.503984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.504012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.504109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.504219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.504245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.504337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.504476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.504502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.504588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.504722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.504747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.504830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.504912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.504939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.505025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.505144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.505169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.505246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.505360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.505387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.505500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.505589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.505615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.505695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.505834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.505863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.506001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.506140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.506165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.506256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.506329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.506355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.506444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.506565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.506590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.506710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.506816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.506841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.506964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.507046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.507071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.383 [2024-11-29 17:10:20.507184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.507267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.383 [2024-11-29 17:10:20.507293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.383 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.507436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.507513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.507539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.507631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.507713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.507738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.507847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.507930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.507974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.508071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.508210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.508236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.508330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.508415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.508440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.508543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.508670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.508700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.508792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.508902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.508928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.509097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.509278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.509322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.509449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.509585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.509612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.509730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.509846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.509871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.509990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.510119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.510163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.510264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.510396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.510422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.510510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.510650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.510676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.510792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.510915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.510942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.511072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.511155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.511182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.511286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.511401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.511427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.511523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.511608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.511634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.511719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.511858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.511884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.511979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.512067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.512093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.512214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.512341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.512369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.512491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.512641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.512669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.512760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.512893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.512918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.513040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.513122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.513148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.513275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.513407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.513435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.513535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.513638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.513667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.513821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.513947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.513984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.514084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.514193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.514236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.514326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.514448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.514476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.384 qpair failed and we were unable to recover it. 00:28:09.384 [2024-11-29 17:10:20.514574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.514659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.384 [2024-11-29 17:10:20.514688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.514817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.514902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.514928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.515049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.515130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.515157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.515257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.515370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.515395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.515525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.515615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.515644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.515736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.515820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.515862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.515973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.516178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.516407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.516604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.516848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.516974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.517062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.517138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.517181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.517307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.517401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.517431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.517520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.517613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.517641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.517738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.517863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.517890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.517998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.518127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.518153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.518274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.518370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.518398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.518494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.518634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.518663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.518796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.518933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.518969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.519079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.519167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.519192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.519290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.519379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.519407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.519530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.519647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.519676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.519766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.519887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.519912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.520003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.520088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.520114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.520239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.520353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.520378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.520542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.520679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.520709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.520801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.520903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.520928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.521053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.521200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.521230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.521343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.521428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.385 [2024-11-29 17:10:20.521453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.385 qpair failed and we were unable to recover it. 00:28:09.385 [2024-11-29 17:10:20.521553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.521639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.521683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.521779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.521870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.521899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.522031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.522116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.522141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.522258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.522367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.522407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.522497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.522620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.522648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.522771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.522864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.522892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.523010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.523087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.523112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.523198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.523283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.523308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.523403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.523518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.523553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.523655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.523804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.523832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.523952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.524065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.524090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.524231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.524333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.524362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.524493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.524606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.524634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.524725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.524873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.524901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.525049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.525166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.525191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.525276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.525385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.525410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.525496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.525577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.525602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.525731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.525849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.525876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.525972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.526076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.526105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.526216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.526303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.526328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.526439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.526554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.526581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.526692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.526803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.526829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.526945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.527172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.527404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.527619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.527843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.527950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.528049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.528139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.528164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.386 qpair failed and we were unable to recover it. 00:28:09.386 [2024-11-29 17:10:20.528308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.528421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.386 [2024-11-29 17:10:20.528450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.528565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.528686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.528711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.528801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.528885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.528910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.529051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.529170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.529195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.529304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.529394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.529419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.529559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.529668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.529693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.529783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.529874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.529901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.529994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.530108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.530133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.530248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.530328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.530355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.530455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.530597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.530622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.530703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.530843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.530872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.530975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.531131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.531156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.531270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.531355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.531381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.531467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.531605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.531631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.531716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.531795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.531820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.531913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.531998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.532024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.532139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.532250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.532275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.532384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.532470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.532495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.532614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.532696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.532722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.532802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.532888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.532913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.533001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.533088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.533113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.533236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.533341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.533367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.533451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.533573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.533599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.533684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.533762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.387 [2024-11-29 17:10:20.533787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.387 qpair failed and we were unable to recover it. 00:28:09.387 [2024-11-29 17:10:20.533881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.533991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.534018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.534130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.534239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.534264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.534399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.534480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.534505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.534619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.534726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.534751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.534871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.535157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.535352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.535557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.535773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.535939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.536045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.536136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.536162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.536271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.536385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.536410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.536527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.536633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.536658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.536771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.536911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.536936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.537032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.537151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.537178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.537280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.537435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.537481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.537595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.537699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.537726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.537841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.537933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.537967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.538092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.538180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.538205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.538292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.538430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.538455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.538589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.538737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.538765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.538890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.539023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.539050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.539140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.539224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.539249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.539386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.539477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.539505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.539593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.539714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.539744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.539873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.539994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.540037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.540130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.540251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.540278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.540399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.540522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.540551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.540682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.540771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.540799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.388 qpair failed and we were unable to recover it. 00:28:09.388 [2024-11-29 17:10:20.540925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.541044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.388 [2024-11-29 17:10:20.541071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.541161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.541251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.541277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.541372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.541480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.541525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.541646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.541763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.541791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.541915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.542055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.542081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.542179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.542291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.542316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.542448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.542574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.542601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.542690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.542815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.542843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.542936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.543187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.543386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.543608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.543841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.543983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.544072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.544182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.544208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.544321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.544396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.544436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.544559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.544675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.544703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.544826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.544914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.544942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.545062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.545173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.545199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.545337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.545488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.545516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.545658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.545757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.545785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.545937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.546082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.546108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.546220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.546332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.546357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.546449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.546524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.546566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.546695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.546787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.546814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.546944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.547037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.547062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.547171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.547259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.547284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.547403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.547499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.547529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.547623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.547773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.547802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.547901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.547994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.548037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.389 qpair failed and we were unable to recover it. 00:28:09.389 [2024-11-29 17:10:20.548161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.389 [2024-11-29 17:10:20.548242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.548269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.548383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.548506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.548534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.548666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.548750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.548778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.548902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.549061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.549086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.549175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.549270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.549295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.549406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.549489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.549514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.549602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.549721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.549747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.549885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.550048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.550074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.550195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.550304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.550329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.550414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.550501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.550527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.550659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.550766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.550796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.550893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.550994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.551037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.551126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.551235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.551260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.551370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.551449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.551477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.551592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.551684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.551712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.551813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.551931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.551992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.552129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.552234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.552260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.552372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.552482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.552509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.552637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.552728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.552754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.552866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.552976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.553002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.553116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.553238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.553264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.553361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.553475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.553501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.553609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.553694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.553719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.553838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.553946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.553981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.554097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.554179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.554204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.554316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.554400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.554424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.554534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.554623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.554650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.554752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.554866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.554891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.555005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.555087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.390 [2024-11-29 17:10:20.555113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.390 qpair failed and we were unable to recover it. 00:28:09.390 [2024-11-29 17:10:20.555223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.555335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.555361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.555452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.555564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.555590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.555698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.555778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.555804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.555913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.556059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.556085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.556174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.556316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.556342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.556454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.556527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.556552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.556639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.556727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.556757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.556870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.556989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.557015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.557135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.557218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.557244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.557333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.557447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.557472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.557568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.557680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.557706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.557815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.557903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.557930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.558052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.558137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.558162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.558274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.558411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.558436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.558547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.558636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.558661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.558772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.558856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.558883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.559011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.559150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.559176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.559288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.559372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.559397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.559517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.559603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.559628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.559712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.559793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.559818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.559903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.560146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.560372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.560566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.560785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.560920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.391 qpair failed and we were unable to recover it. 00:28:09.391 [2024-11-29 17:10:20.561026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.391 [2024-11-29 17:10:20.561110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.561135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.561249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.561360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.561386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.561466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.561579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.561605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.561695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.561773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.561798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.561912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.562034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.562061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.562205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.562289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.562314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.562429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.562573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.562604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.562747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.562831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.562856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.562972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.563086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.563112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.563230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.563338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.563364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.563452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.563559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.563585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.563702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.563809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.563835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.563913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.564150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.564426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.564622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.564867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.564990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.565089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.565179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.565204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.565316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.565393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.565420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.565561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.565673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.565699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.565804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.565887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.565914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.566010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.566129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.566154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.566293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.566403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.566430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.566577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.566685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.566710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.566829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.566941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.566976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.567054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.567164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.567190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.567303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.567383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.567413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.567503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.567611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.567637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.567746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.567830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.392 [2024-11-29 17:10:20.567855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.392 qpair failed and we were unable to recover it. 00:28:09.392 [2024-11-29 17:10:20.567994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.568109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.568135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.568220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.568335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.568361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.568449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.568528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.568553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.568662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.568798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.568824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.568942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.569042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.569068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.569154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.569239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.569264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.569376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.569517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.569542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.569635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.569720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.569746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.569860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.569998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.570024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.570139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.570275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.570300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.570444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.570550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.570576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.570689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.570770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.570796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.570909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.570995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.571022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.571133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.571220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.571247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.571350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.571468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.571493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.571632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.571726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.571755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.571887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.572057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.572083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.572189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.572301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.572328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.572423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.572557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.572582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.572676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.572788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.572815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.572927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.573187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.573389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.573602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.573812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.573951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.574078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.574185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.574212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.574326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.574434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.574460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.574602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.574711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.574736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.393 [2024-11-29 17:10:20.574831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.574943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.393 [2024-11-29 17:10:20.574979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.393 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.575097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.575177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.575202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.575339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.575451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.575477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.575595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.575702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.575727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.575813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.575949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.575992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.576101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.576182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.576208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.576325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.576415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.576442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.576557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.576660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.576686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.576801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.576891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.576917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.577040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.577182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.577207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.577335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.577447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.577473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.577582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.577697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.577722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.577835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.577947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.577982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.578095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.578201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.578226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.578308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.578394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.578419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.578501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.578617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.578643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.578778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.578893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.578921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.579057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.579140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.579165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.579283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.579392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.579417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.579528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.579615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.579640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.579759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.579840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.579865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.579979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.580094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.580119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.580205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.580313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.580338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.580486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.580595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.580621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.580738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.580856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.580882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.580991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.581103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.581129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.581212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.581299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.581324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.581436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.581550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.581576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.581684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.581797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.581822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.394 qpair failed and we were unable to recover it. 00:28:09.394 [2024-11-29 17:10:20.581940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.394 [2024-11-29 17:10:20.582030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.582056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.582154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.582266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.582291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.582435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.582545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.582570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.582683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.582763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.582789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.582877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.582986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.583012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.583128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.583241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.583271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.583375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.583462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.583488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.583627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.583706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.583732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.583865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.584002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.584030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.584144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.584258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.584284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.584395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.584535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.584560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.584679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.584818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.584847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.585008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.585148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.585173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.585314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.585450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.585477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.585590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.585679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.585706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.585792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.585936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.585970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.586088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.586198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.586224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.586315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.586449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.586475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.586614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.586754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.586779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.586896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.587023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.587052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.587201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.587347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.587391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.587506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.587591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.587617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.587699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.587815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.587839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.587967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.588079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.588106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.588220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.588308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.588333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.588476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.588590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.588616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.588728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.588808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.588833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.588954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.589074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.589098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.589214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.589334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.589360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.395 qpair failed and we were unable to recover it. 00:28:09.395 [2024-11-29 17:10:20.589472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.395 [2024-11-29 17:10:20.589583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.589608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.589700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.589808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.589832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.589974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.590120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.590146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.590224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.590331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.590355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.590465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.590573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.590598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.590740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.590881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.590905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.591032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.591180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.591224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.591348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.591486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.591512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.591628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.591741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.591767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.591857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.591941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.591973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.592086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.592201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.592225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.592332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.592413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.592439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.592577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.592701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.592726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.592870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.592948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.592979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.593070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.593208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.593233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.593393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.593496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.593522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.593611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.593726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.593750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.593872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.593950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.593982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.594069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.594180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.594205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.594293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.594401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.594425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.594552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.594662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.594686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.594767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.594858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.594884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.594982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.595101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.595127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.595242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.595356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.595382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.595465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.595605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.595630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.396 qpair failed and we were unable to recover it. 00:28:09.396 [2024-11-29 17:10:20.595742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.396 [2024-11-29 17:10:20.595829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.595854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.595996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.596071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.596096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.596237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.596351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.596376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.596497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.596608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.596633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.596775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.596893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.596919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.597012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.597153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.597178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.597285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.597369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.597394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.597539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.597625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.597650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.597727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.597842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.597866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.597952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.598062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.598087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.598181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.598320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.598344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.598467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.598578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.598603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.598718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.598827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.598851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.598939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.599062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.599086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.599227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.599309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.599334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.599507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.599594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.599620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.599760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.599846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.599870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.599989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.600068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.600097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.600236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.600321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.600345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.600467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.600602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.600628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.600712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.600794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.600818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.600965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.601107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.601133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.601246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.601386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.601410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.601531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.601670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.601695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.601813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.601928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.601953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.602083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.602196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.602221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.602311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.602401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.602425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.602534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.602647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.602677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.602823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.602963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.602989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.397 qpair failed and we were unable to recover it. 00:28:09.397 [2024-11-29 17:10:20.603127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.397 [2024-11-29 17:10:20.603242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.603266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.603383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.603521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.603546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.603681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.603824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.603848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.603989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.604128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.604156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.604309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.604437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.604462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.604608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.604721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.604747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.604862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.604992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.605021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.605206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.605352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.605393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.605511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.605622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.605651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.605767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.605880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.605905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.606032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.606134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.606158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.606297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.606443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.606467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.606609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.606692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.606718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.606833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.606944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.606976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.607143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.607284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.607326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.607436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.607550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.607574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.607683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.607796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.607820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.607990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.608130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.608154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.608293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.608428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.608457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.608573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.608693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.608718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.608861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.608946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.608981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.609116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.609226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.609254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.609411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.609557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.609581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.609669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.609781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.609806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.609896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.610146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.610358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.610607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.610856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.398 [2024-11-29 17:10:20.610954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.398 qpair failed and we were unable to recover it. 00:28:09.398 [2024-11-29 17:10:20.611116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.611253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.611278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.611415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.611553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.611579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.611658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.611762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.611788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.611870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.611980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.612006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.612091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.612239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.612264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.612403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.612519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.612544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.612661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.612747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.612773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.612880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.612969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.612995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.613135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.613245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.613270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.613381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.613468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.613493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.613635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.613755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.613780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.613858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.613971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.613996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.614088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.614222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.614247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.614386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.614497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.614521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.614612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.614721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.614746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.614827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.614907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.614933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.615026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.615133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.615158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.615298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.615404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.615429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.615538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.615623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.615650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.615766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.615879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.615904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.616027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.616115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.616139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.616279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.616366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.616392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.616508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.616620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.616644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.616758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.616839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.616865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.616971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.617081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.617106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.617219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.617336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.617360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.617443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.617525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.617551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.617697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.617835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.617860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.399 [2024-11-29 17:10:20.617982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.618064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.399 [2024-11-29 17:10:20.618089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.399 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.618202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.618289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.618313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.618439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.618524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.618549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.618664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.618763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.618789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.618874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.618952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.618983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.619096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.619209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.619235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.619376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.619482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.619506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.619619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.619709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.619734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.619875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.620012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.620038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.620178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.620265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.620290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.620393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.620530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.620554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.620640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.620728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.620752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.620867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.620979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.621006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.621122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.621203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.621228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.621345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.621423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.621447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.621553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.621676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.621702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.621819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.621932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.621976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.622093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.622196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.622222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.622308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.622423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.622448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.622560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.622670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.622695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.622779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.622891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.622916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.623016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.623097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.623122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.623245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.623391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.623416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.623543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.623650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.623675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.623792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.623874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.623899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.624036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.624142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.624166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.400 qpair failed and we were unable to recover it. 00:28:09.400 [2024-11-29 17:10:20.624283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.624393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.400 [2024-11-29 17:10:20.624417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.624533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.624641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.624665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.624800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.624937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.624968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.625085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.625161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.625186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.625301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.625387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.625411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.625526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.625636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.625662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.625778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.625896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.625922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.626049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.626144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.626169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.626277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.626392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.626418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.626567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.626649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.626674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.626758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.626862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.626886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.626992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.627077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.627102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.627195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.627281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.627306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.627415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.627530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.627555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.627680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.627795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.627820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.627905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.628062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.628106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.628242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.628347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.628373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.628459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.628561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.628586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.628700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.628807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.628831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.628942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.629060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.629085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.629222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.629337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.629363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.629502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.629614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.629639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.629734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.629851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.629876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.629981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.630063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.630088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.630182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.630318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.630343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.630467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.630583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.630607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.630715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.630831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.630856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.401 [2024-11-29 17:10:20.630971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.631048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.401 [2024-11-29 17:10:20.631073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.401 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.631185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.631314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.631339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.631447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.631524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.631549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.631687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.631796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.631820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.631928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.632051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.632076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.632186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.632300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.632325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.632415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.632550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.632576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.632659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.632766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.632791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.632899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.633038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.633065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.633202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.633334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.633359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.633440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.633551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.633577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.633722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.633799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.633824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.633905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.634123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.634347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.634631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.634856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.634976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.635092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.635178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.635203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.635310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.635393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.635417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.635531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.635648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.635674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.635782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.635891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.635916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.636040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.636184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.636209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.636322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.636439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.636463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.636548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.636631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.636657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.636799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.636935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.636967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.637053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.637159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.637184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.637295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.637413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.637439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.637521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.637609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.637633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.637750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.637829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.637855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.402 qpair failed and we were unable to recover it. 00:28:09.402 [2024-11-29 17:10:20.637983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.638094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.402 [2024-11-29 17:10:20.638124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.638270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.638354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.638380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.638520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.638639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.638663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.638774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.638886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.638911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.639016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.639166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.639193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.639341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.639470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.639497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.639604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.639722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.639747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.639842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.639922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.639947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.640096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.640206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.640230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.640339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.640475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.640500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.640585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.640695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.640725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.640818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.640919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.640944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.641094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.641203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.641228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.641322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.641436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.641461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.641568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.641657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.641682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.641791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.641901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.641926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.642044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.642150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.642175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.642288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.642400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.642424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.642511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.642644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.642669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.642807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.642921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.642945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.643070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.643149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.643178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.643268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.643374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.643399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.643485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.643619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.643645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.643722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.643803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.643829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.643910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.644051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.644078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.644224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.644321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.644345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.644430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.644545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.644570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.644655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.644766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.644792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.644876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.644990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.645015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.403 qpair failed and we were unable to recover it. 00:28:09.403 [2024-11-29 17:10:20.645177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.403 [2024-11-29 17:10:20.645315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.645340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.645481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.645619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.645648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.645761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.645873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.645899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.645986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.646063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.646088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.646204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.646283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.646308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.646398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.646536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.646561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.646643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.646751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.646777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.646884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.647031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.647057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.647150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.647239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.647264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.647379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.647488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.647514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.647634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.647743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.647768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.647912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.648034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.648060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.648151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.648289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.648314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.648424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.648533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.648558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.648648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.648758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.648783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.648893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.648988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.649013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.649154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.649236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.649260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.649371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.649505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.649531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.649614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.649695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.649719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.649805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.649943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.649977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.650122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.650235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.650260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.650339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.650424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.650448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.650561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.650638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.650665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.650778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.650888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.650913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.651025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.651163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.651188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.651330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.651419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.651445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.651536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.651649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.651674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.651751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.651856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.651882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.651998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.652088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.404 [2024-11-29 17:10:20.652113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.404 qpair failed and we were unable to recover it. 00:28:09.404 [2024-11-29 17:10:20.652202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.652309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.652334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.652448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.652557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.652583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.652713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.652822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.652847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.652934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.653089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.653114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.653253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.653360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.653384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.653471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.653551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.653576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.653696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.653805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.653829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.653934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.654080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.654106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.654243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.654352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.654377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.654487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.654591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.654616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.654728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.654862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.654887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.654971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.655175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.655438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.655650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.655849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.655954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.656075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.656181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.656206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.656318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.656421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.656446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.656541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.656648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.656673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.656784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.656921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.656945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.657035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.657118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.657144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.657256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.657367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.657392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.657501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.657608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.657633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.657753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.657869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.657894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.658038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.658118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.658143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.405 qpair failed and we were unable to recover it. 00:28:09.405 [2024-11-29 17:10:20.658254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.405 [2024-11-29 17:10:20.658362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.658387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.658465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.658575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.658601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.658719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.658855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.658880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.659033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.659173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.659198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.659340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.659427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.659451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.659564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.659703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.659728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.659814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.659923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.659948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.660099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.660189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.660214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.660363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.660511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.660535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.660625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.660708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.660734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.660879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.661035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.661079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.661204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.661313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.661338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.661451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.661552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.661576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.661660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.661729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.661753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.661868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.662004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.662029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.662113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.662223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.662249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.662367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.662521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.662546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.662659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.662798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.662823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.662924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.663014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.663041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.663167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.663301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.663326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.663466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.663575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.663600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.663715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.663853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.663878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.663968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.664056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.664080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.664200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.664283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.664308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.664448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.664525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.664550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.664655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.664760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.664785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.664911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.665028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.665054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.665181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.665305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.665330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.406 [2024-11-29 17:10:20.665483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.665597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.406 [2024-11-29 17:10:20.665622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.406 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.665705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.665846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.665871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.665984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.666063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.666088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.666171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.666281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.666307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.666401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.666508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.666533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.666646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.666751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.666777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.666896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.667018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.667048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.667210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.667347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.667373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.667481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.667597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.667621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.667731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.667846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.667871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.668008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.668151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.668177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.668265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.668410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.668436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.668556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.668638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.668662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.668797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.668938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.668970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.669092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.669180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.669205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.669330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.669504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.669547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.669662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.669804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.669829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.669907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.669996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.670022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.670111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.670247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.670272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.670348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.670483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.670507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.670585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.670698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.670723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.670801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.670937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.670969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.671115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.671225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.671249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.671333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.671448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.671473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.671557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.671664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.671689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.671776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.671911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.671936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.672083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.672173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.672199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.672279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.672367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.672392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.672503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.672592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.672616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.407 qpair failed and we were unable to recover it. 00:28:09.407 [2024-11-29 17:10:20.672756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.407 [2024-11-29 17:10:20.672839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.672865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.672983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.673124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.673149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.673275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.673417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.673442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.673561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.673645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.673671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.673782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.673892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.673916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.674042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.674123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.674148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.674261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.674369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.674393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.674477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.674586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.674611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.674720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.674832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.674856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.674946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.675083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.675110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.675191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.675271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.675297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.675415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.675531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.675557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.675666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.675773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.675799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.675913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.675988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.676014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.676091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.676195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.676220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.676309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.676396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.676422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.676508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.676647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.676671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.676755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.676870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.676895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.676978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.677061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.677086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.677199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.677285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.677310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.677423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.677537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.677561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.677690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.677827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.677857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.678002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.678143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.678169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.678251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.678352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.678377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.678459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.678530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.678554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.678636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.678742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.678767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.678879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.679021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.679046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.679160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.679231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.679256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.679375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.679460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.679486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.408 qpair failed and we were unable to recover it. 00:28:09.408 [2024-11-29 17:10:20.679629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.408 [2024-11-29 17:10:20.679741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.679766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.679877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.679992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.680018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.680104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.680249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.680279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.680365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.680477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.680503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.680583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.680718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.680743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.680820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.680899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.680923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.681011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.681105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.681129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.681203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.681343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.681368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.681453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.681562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.681587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.681709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.681823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.681848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.681969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.682089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.682114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.682228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.682362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.682387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.682497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.682600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.682630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.682743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.682823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.682849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.682990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.683118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.683162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.683288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.683411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.683436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.683551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.683637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.683663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.683773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.683867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.683891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.684002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.684080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.684105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.684219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.684363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.684389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.684499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.684620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.684645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.684762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.684901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.684927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.685021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.685107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.685136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.685224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.685301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.685326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.685410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.685518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.685544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.685686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.685799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.685824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.685901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.685987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.686014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.686133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.686273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.686299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.686416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.686550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.409 [2024-11-29 17:10:20.686575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.409 qpair failed and we were unable to recover it. 00:28:09.409 [2024-11-29 17:10:20.686689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.686771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.686795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.686908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.687045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.687072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.687187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.687292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.687317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.687428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.687560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.687585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.687734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.687847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.687871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.688008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.688150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.688176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.688303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.688387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.688411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.688565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.688677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.688702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.688787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.688899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.688924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.689025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.689149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.689173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.689322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.689408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.689432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.689540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.689657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.689681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.689768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.689904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.689929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.690098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.690249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.690294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.690444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.690581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.690607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.690698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.690831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.690857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.690974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.691062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.691087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.691221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.691330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.691355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.691496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.691608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.691633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.691743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.691828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.691853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.691933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.692056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.692082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.692227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.692337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.692363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.692478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.692590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.692616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.692697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.692809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.692834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.692983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.693068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.410 [2024-11-29 17:10:20.693094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.410 qpair failed and we were unable to recover it. 00:28:09.410 [2024-11-29 17:10:20.693192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.693322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.693347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.693459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.693601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.693627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.693741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.693830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.693855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.693977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.694087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.694112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.694264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.694404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.694429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.694537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.694618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.694644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.694790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.694871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.694898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.695016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.695106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.695132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.695245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.695379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.695404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.695536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.695680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.695705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.695787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.695892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.695917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.696012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.696115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.696139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.696258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.696368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.696392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.696497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.696582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.696606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.696726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.696834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.696859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.696942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.697091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.697116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.697236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.697345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.697370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.697449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.697556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.697581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.697664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.697776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.697802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.697888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.698142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.698417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.698639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.698881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.698993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.699081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.699196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.699221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.699326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.699415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.699440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.699523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.699602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.699627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.699770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.699850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.699875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.411 [2024-11-29 17:10:20.699988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.700124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.411 [2024-11-29 17:10:20.700149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.411 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.700292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.700430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.700455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.700571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.700673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.700698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.700838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.700923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.700948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.701068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.701177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.701202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.701326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.701470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.701495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.701613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.701748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.701773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.701912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.702043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.702086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.702248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.702373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.702402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.702505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.702641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.702667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.702778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.702887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.702912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.703026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.703105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.703131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.703214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.703324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.703349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.703433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.703571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.703596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.703740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.703854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.703879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.703972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.704092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.704118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.704255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.704366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.704391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.704470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.704590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.704615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.704755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.704869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.704894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.704978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.705107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.705136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.705279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.705378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.705403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.705529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.705611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.705636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.705750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.705890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.705916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.706010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.706090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.706114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.706230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.706312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.706339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.706450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.706555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.706580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.706665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.706742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.706767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.706886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.707027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.707054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.707167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.707276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.707302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.412 qpair failed and we were unable to recover it. 00:28:09.412 [2024-11-29 17:10:20.707439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.412 [2024-11-29 17:10:20.707524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.707551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.707639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.707748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.707773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.707913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.708033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.708061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.708174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.708285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.708311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.708425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.708506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.708531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.708641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.708755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.708781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.708894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.708986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.709012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.709098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.709233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.709258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.709363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.709455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.709480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.709567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.709679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.709705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.709821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.709918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.709944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.710046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.710185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.710210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.710315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.710432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.710457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.710570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.710684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.710708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.710798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.710891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.710917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.711034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.711149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.711174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.711262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.711351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.711377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.711490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.711602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.711627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.711711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.711792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.711818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.711934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.712185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.712401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.712604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.712866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.712988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.713088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.713195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.713220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.713302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.713407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.713432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.713513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.713595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.713620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.713760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.713870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.713895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.713987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.714088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.413 [2024-11-29 17:10:20.714114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.413 qpair failed and we were unable to recover it. 00:28:09.413 [2024-11-29 17:10:20.714254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.714363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.714389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.714473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.714588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.714613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.714734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.714816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.714842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.714955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.715186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.715396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.715618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.715883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.715997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.716081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.716161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.716186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.716291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.716370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.716394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.716508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.716591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.716615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.716699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.716810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.716835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.716924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.717135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.717353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.717551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.717796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.717930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.718056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.718175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.718200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.718292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.718375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.718400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.718539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.718651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.718676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.718801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.718888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.718914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.719066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.719175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.719201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.719313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.719427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.719453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.719548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.719663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.719692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.719779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.719887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.719913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.414 qpair failed and we were unable to recover it. 00:28:09.414 [2024-11-29 17:10:20.720059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.414 [2024-11-29 17:10:20.720153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.720181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.720266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.720409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.720435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.720573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.720660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.720686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.720771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.720860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.720886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.720978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.721062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.721087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.721174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.721260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.721286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.721405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.721522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.721547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.721664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.721774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.721799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.721888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.722126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.722330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.722575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.722849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.722982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.723087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.723198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.723225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.723319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.723402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.723426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.723526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.723661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.723686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.723799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.723876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.723901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.723983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.724097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.724122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.724214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.724303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.724333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.724450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.724526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.724551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.724666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.724778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.724805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.724882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.724995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.725021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.725114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.725224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.725249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.725332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.725448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.725474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.725592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.725676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.725705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.725847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.725930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.725963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.726079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.726214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.726258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.726378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.726489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.726513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.726607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.726744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.415 [2024-11-29 17:10:20.726770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.415 qpair failed and we were unable to recover it. 00:28:09.415 [2024-11-29 17:10:20.726863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.727146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.727371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.727564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.727814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.727947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.728132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.728218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.728244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.728328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.728438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.728463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.728572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.728657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.728683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.728800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.728881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.728906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.728989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.729076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.729102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.729190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.729325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.729351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.729434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.729570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.729595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.729685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.729825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.729851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.729939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.730041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.730070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.730192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.730349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.730374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.730473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.730559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.730585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.730667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.730779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.730803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.730913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.730993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.731022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.731140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.731256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.731281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.731389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.731479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.731503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.731623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.731732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.731757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.731846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.731956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.731987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.732075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.732179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.732206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.732288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.732411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.732437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.732585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.732717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.732741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.732821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.732899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.732923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.733025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.733129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.733154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.733246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.733333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.733361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.416 [2024-11-29 17:10:20.733472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.733549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.416 [2024-11-29 17:10:20.733574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.416 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.733674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.733756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.733781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.733899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.733982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.734008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.734102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.734197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.734223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.734339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.734452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.734479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.734564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.734649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.734674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.734791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.734875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.734899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.735018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.735131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.735156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.735269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.735386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.735411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.735521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.735654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.735678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.735766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.735871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.735895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.736007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.736126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.736151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.736268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.736380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.736407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.736495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.736586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.736612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.736702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.736841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.736866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.736952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.737198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.737415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.737635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.737867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.737983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.738097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.738182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.738206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.738293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.738376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.738402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.738519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.738609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.738634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.738721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.738834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.738862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.738966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.739193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.739388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.739604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.739827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.739984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.417 qpair failed and we were unable to recover it. 00:28:09.417 [2024-11-29 17:10:20.740098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.417 [2024-11-29 17:10:20.740187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.740212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.740323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.740475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.740500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.740579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.740693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.740720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.740819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.740901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.740927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.741074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.741155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.741182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.741300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.741382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.741408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.741519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.741627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.741653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.741740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.741823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.741849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.741986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.742070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.742098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.742183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.742272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.742298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.742414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.742526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.742551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.742637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.742750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.742776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.742895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.743009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.743035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.743166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.743260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.743296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.743413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.743498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.743524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.743637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.743717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.743742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.743865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.743983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.744009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.744122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.744210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.744236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.744352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.744471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.744499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.744631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.744727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.744754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.744856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.745024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.745057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.745135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.745240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.745269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.745369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.745452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.745480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.745616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.745715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.745744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.745875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.745982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.746009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.746122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.746293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.746321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.746426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.746523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.746552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.746656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.746779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.746807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.746918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.747044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.747072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.747183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.747330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.747374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.747460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.747535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.418 [2024-11-29 17:10:20.747561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.418 qpair failed and we were unable to recover it. 00:28:09.418 [2024-11-29 17:10:20.747674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.747755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.747780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.747924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.748124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.748360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.748616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.748847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.748988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.749082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.749176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.749201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.749287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.749393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.749418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.749499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.749621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.749649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.749737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.749834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.749859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.750013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.750160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.750186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.750276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.750389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.750415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.750532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.750703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.750730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.750843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.750950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.750984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.751110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.751221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.751246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.751368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.751474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.751500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.751622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.751732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.751758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.751843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.751951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.751983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.419 [2024-11-29 17:10:20.752070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.752179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.419 [2024-11-29 17:10:20.752205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.419 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.752284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.752402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.752427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.752567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.752654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.752679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.752793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.752878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.752905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.753020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.753112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.753143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.753235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.753353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.753379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.753524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.753608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.753633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.753745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.753829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.753856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.753940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.754065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.754091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.754180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.754296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.754320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.754414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.754505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.754530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.754641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.754748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.754772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.754859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.754976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.755003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.755090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.755170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.755197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.755282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.755362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.755392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.755510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.755593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.755618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.755708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.755785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.755810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.755921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.756126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.756336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.756560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.756789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.756964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.757073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.757149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.757174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.757285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.757377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.757402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.757512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.757632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.757661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.757745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.757831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.757857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.757944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.758061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.758087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.758178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.758279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.758306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.420 qpair failed and we were unable to recover it. 00:28:09.420 [2024-11-29 17:10:20.758389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.420 [2024-11-29 17:10:20.758508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.758533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.758616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.758723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.758750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.758875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.758971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.758996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.759083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.759199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.759225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.759305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.759408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.759432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.759528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.759609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.759634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.759721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.759837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.759867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.759983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.760064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.760088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.760179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.760289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.760315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.760436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.760520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.760546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.760663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.760750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.760777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.760892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.760979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.761005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.761090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.761181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.761206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.761285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.761367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.761393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.761499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.761610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.761635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.761744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.761851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.761877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.762024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.762140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.762165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.762252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.762339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.762363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.762447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.762600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.762627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.762742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.762829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.762854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.762991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.763079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.763104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.763213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.763323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.763348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.763502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.763610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.763635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.763713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.763796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.763824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.763969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.764056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.764082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.764193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.764282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.764309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.764400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.764508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.764535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.764659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.764741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.764767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.764904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.764983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.421 [2024-11-29 17:10:20.765009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.421 qpair failed and we were unable to recover it. 00:28:09.421 [2024-11-29 17:10:20.765124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.765210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.765234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.765323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.765428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.765454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.765574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.765678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.765704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.765821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.765907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.765935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.766035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.766142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.766168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.766259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.766338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.766363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.766454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.766563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.766589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.766695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.766777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.766801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.766912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.767024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.767051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.767166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.767276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.767302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.767421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.767526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.767554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.767676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.767793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.767819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.767903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.767981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.768008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.768093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.768199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.768223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.768340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.768445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.768470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.768580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.768686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.768710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.768790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.768876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.768901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.768989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.769095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.769123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.769243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.769321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.769346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.769458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.769566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.769591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.769709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.769814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.769839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.769926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.770174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.770388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.770588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.770820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.770955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.771048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.771159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.771183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.771324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.771404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.771429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.422 qpair failed and we were unable to recover it. 00:28:09.422 [2024-11-29 17:10:20.771520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.771659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.422 [2024-11-29 17:10:20.771685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.771770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.771909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.771935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.772107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.772260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.772302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.772402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.772533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.772559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.772658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.772769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.772795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.772885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.772981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.773007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.773102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.773187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.773212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.773297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.773436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.773462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.773552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.773635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.773660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.773782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.773895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.773922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.774016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.774109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.774134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.774215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.774330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.774355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.774450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.774539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.423 [2024-11-29 17:10:20.774563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.423 qpair failed and we were unable to recover it. 00:28:09.423 [2024-11-29 17:10:20.774658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.774768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.774793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.774880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.774989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.775108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.775294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.775491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.775683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.775879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.775994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.776089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.776181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.776206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.776321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.776410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.776435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.776519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.776608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.776632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.776719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.776838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.776866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.776968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.777195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.777418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.777640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.777825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.706 [2024-11-29 17:10:20.777934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.706 qpair failed and we were unable to recover it. 00:28:09.706 [2024-11-29 17:10:20.778062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.778152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.778177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.778292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.778421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.778449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.778535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.778649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.778674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.778758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.778843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.778868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.778955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.779169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.779401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.779609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.779844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.779977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.780077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.780222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.780249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.780343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.780459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.780486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.780570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.780685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.780714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.780839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.780920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.780945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.781054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.781165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.781192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.781277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.781392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.781420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.781551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.781640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.781667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.781757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.781880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.781905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.782018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.782125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.782150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.782236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.782314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.782356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.782476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.782561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.782588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.782677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.782790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.782818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.782915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.783016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.783046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.783152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.783278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.783305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.783433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.783524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.783553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.783650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.783770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.783798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.783922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.784011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.784036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.784175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.784254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.784279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.784364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.784441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.784465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.707 [2024-11-29 17:10:20.784567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.784692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.707 [2024-11-29 17:10:20.784720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.707 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.784847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.784925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.784950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.785045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.785130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.785155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.785264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.785372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.785397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.785496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.785626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.785654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.785744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.785878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.785903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.785978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.786083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.786108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.786197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.786306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.786331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.786414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.786493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.786518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.786641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.786761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.786790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.786910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.787042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.787068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.787163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.787272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.787296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.787384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.787518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.787546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.787673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.787760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.787787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.787913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.788022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.788047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.788157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.788297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.788321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.788404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.788490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.788515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.788617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.788743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.788770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.788892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.788973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.789016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.789104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.789217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.789241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.789328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.789443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.789468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.789562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.789649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.789677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.789768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.789861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.789888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.789977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.790105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.790130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.790220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.790332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.790357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.790468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.790575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.790600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.790679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.790793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.790818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.790927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.791107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.791152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.791251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.791374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.791401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.708 qpair failed and we were unable to recover it. 00:28:09.708 [2024-11-29 17:10:20.791520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.791609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.708 [2024-11-29 17:10:20.791637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.791723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.791839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.791867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.791974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.792085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.792110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.792227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.792305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.792330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.792414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.792557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.792582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.792721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.792806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.792831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.792931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.793084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.793111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.793255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.793376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.793403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.793502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.793612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.793636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.793751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.793838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.793862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.793985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.794182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.794431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.794630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.794839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.794937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.795058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.795144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.795173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.795279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.795353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.795377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.795487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.795568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.795593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.795682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.795794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.795818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.795908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.795988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.796012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.796120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.796206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.796230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.796309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.796419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.796444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.796531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.796625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.796650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.796733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.796808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.796832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.796970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.797195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.797379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.797600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.797814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.797982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.709 qpair failed and we were unable to recover it. 00:28:09.709 [2024-11-29 17:10:20.798115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.798274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.709 [2024-11-29 17:10:20.798299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.798402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.798506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.798531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.798614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.798743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.798771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.798870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.798984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.799010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.799087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.799167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.799192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.799308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.799404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.799431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.799559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.799653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.799682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.799797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.799876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.799902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.800009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.800096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.800120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.800260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.800380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.800407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.800545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.800655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.800698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.800826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.800931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.800956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.801096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.801195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.801222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.801347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.801460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.801487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.801643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.801782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.801807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.801919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.802002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.802027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.802113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.802197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.802221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.802382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.802472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.802499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.802621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.802735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.802775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.802916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.803031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.803057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.803163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.803265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.803290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.803371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.803513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.803541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.803695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.803784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.803812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.803944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.804063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.804088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.804245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.804366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.804406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.804495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.804578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.804602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.710 qpair failed and we were unable to recover it. 00:28:09.710 [2024-11-29 17:10:20.804720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.804797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.710 [2024-11-29 17:10:20.804822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.804903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.805047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.805073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.805225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.805343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.805371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.805491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.805580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.805608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.805711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.805862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.805889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.806031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.806136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.806160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.806255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.806421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.806446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.806589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.806725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.806748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.806849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.806982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.807025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.807132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.807215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.807240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.807356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.807484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.807511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.807642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.807763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.807790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.807954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.808042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.808066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.808140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.808228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.808252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.808361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.808501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.808524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.808657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.808749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.808776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.808888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.809048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.809073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.809153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.809258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.809283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.809416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.809573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.809597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.809710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.809836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.809863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.809993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.810119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.810159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.810275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.810388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.810417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.810509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.810602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.810628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.810748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.810870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.810896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.711 qpair failed and we were unable to recover it. 00:28:09.711 [2024-11-29 17:10:20.811017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.811137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.711 [2024-11-29 17:10:20.811180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.811290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.811370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.811394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.811531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.811623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.811650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.811788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.811923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.811947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.812063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.812175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.812199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.812310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.812387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.812410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.812537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.812657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.812683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.812818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.812896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.812920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.813064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.813190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.813218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.813326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.813433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.813457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.813537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.813659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.813686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.813799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.813916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.813965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.814083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.814199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.814223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.814363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.814479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.814503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.814586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.814704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.814728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.814869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.814985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.815009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.815093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.815256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.815295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.815409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.815518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.815541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.815654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.815740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.815764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.815867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.815945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.815988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.816099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.816187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.816212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.816301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.816404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.816428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.816505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.816610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.816635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.816753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.816883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.816911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.817062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.817172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.817197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.817274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.817384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.817409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.817556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.817690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.817714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.817799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.817895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.817923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.818093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.818182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.818207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.712 [2024-11-29 17:10:20.818349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.818461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.712 [2024-11-29 17:10:20.818486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.712 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.818611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.818779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.818803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.818892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.818992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.819036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.819136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.819270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.819295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.819411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.819517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.819542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.819652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.819738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.819781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.819882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.820046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.820072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.820184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.820269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.820312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.820443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.820527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.820551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.820638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.820720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.820746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.820858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.821019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.821047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.821191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.821333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.821358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.821505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.821588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.821613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.821766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.821918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.821942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.822032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.822168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.822196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.822322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.822413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.822441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.822579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.822721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.822746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.822900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.822993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.823022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.823148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.823245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.823273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.823414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.823491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.823522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.823628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.823764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.823789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.823923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.824067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.824092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.824172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.824243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.824267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.824391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.824518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.824546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.824675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.824781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.824804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.824920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.825003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.825027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.713 [2024-11-29 17:10:20.825103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.825214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.713 [2024-11-29 17:10:20.825239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.713 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.825347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.825436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.825477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.825570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.825658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.825682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.825757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.825890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.825930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.826041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.826166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.826194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.826352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.826514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.826539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.826656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.826739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.826763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.826861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.826980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.827008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.827167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.827285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.827308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.827398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.827533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.827561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.827689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.827796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.827819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.827913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.828019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.828044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.828152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.828279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.828305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.828432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.828582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.828608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.828752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.828868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.828893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.829007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.829129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.829157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.829293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.829406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.829431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.829562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.829710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.829751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.829832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.829951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.829981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.830095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.830200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.830224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.830333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.830468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.830510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.830662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.830751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.830792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.830922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.831186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.831425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.831635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.831881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.831996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.832170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.832282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.832306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.832415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.832586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.832610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.832724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.832833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.714 [2024-11-29 17:10:20.832857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.714 qpair failed and we were unable to recover it. 00:28:09.714 [2024-11-29 17:10:20.832935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.833057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.833082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.833207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.833298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.833339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.833454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.833535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.833559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.833705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.833781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.833822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.833962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.834116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.834140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.834263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.834378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.834404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.834507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.834638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.834663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.834753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.834830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.834855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.834980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.835057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.835082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.835189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.835300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.835327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.835451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.835539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.835566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.835687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.835834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.835861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.835972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.836186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.836398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.836616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.836851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.836992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.837113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.837222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.837249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.837369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.837459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.837486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.837585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.837665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.837691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.837826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.837968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.837993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.838123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.838244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.838270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.838361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.838490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.838514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.838606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.838718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.838742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.715 [2024-11-29 17:10:20.838848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.838985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.715 [2024-11-29 17:10:20.839015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.715 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.839147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.839236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.839262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.839361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.839492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.839517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.839657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.839742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.839767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.839873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.839984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.840009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.840137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.840223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.840250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.840398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.840491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.840517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.840678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.840773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.840800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.840934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.841128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.841334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.841534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.841795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.841940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.842082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.842160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.842184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.842298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.842408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.842451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.842547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.842693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.842721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.842859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.842972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.842998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.843109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.843195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.843219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.843308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.843421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.843464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.843558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.843675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.843701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.843806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.843895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.843919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.844008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.844095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.844119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.844255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.844374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.844401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.844526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.844647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.844673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.844834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.844971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.844996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.845113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.845234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.845262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.845415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.845538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.845566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.716 qpair failed and we were unable to recover it. 00:28:09.716 [2024-11-29 17:10:20.845716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.716 [2024-11-29 17:10:20.845799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.845825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.845967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.846079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.846103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.846273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.846391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.846417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.846521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.846636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.846664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.846817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.846944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.846986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.847129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.847210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.847234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.847339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.847456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.847483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.847621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.847712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.847735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.847847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.847951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.847982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.848069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.848181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.848206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.848295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.848438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.848462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.848572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.848695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.848722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.848861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.849029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.849053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.849163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.849278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.849302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.849413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.849500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.849531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.849630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.849720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.849747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.849909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.850126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.850360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.850587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.850831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.850973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.851064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.851171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.851196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.851273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.851360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.851385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.851463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.851553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.851576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.851741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.851861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.851892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.852001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.852117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.852142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.852253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.852395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.852437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.852555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.852679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.852706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.717 [2024-11-29 17:10:20.852828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.852949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.717 [2024-11-29 17:10:20.852986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.717 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.853114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.853189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.853213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.853299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.853382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.853406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.853534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.853651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.853678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.853765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.853856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.853884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.854063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.854149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.854173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.854306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.854418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.854445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.854575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.854686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.854713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.854835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.855002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.855046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.855157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.855233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.855258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.855394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.855481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.855523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.855643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.855777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.855818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.855970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.856103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.856128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.856211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.856334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.856359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.856492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.856581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.856608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.856702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.856797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.856824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.856918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.857020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.857047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.857154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.857265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.857290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.857419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.857531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.857559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.857685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.857800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.857828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.857954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.858067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.858092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.858170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.858308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.858333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.858438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.858551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.858578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.858679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.858771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.858795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.858923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.859047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.859077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.859222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.859299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.859324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.859461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.859587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.859612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.859743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.859877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.859903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.860064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.860218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.860246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.718 [2024-11-29 17:10:20.860410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.860545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.718 [2024-11-29 17:10:20.860570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.718 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.860684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.860799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.860827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.860943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.861083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.861111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.861201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.861352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.861379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.861510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.861583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.861608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.861737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.861865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.861890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.862001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.862138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.862165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.862269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.862389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.862416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.862541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.862631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.862657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.862772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.862847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.862872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.863002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.863121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.863163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.863275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.863365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.863390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.863533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.863648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.863673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.863766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.863885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.863929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.864045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.864127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.864151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.864266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.864381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.864407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.864489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.864604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.864629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.864713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.864839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.864866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.864971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.865070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.865099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.865210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.865305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.865347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.865451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.865529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.865554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.865677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.865795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.865822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.865980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.866092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.866117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.866240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.866373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.866398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.866485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.866589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.866614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.866694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.866854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.866881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.867018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.867128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.867155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.719 qpair failed and we were unable to recover it. 00:28:09.719 [2024-11-29 17:10:20.867249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.719 [2024-11-29 17:10:20.867335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.867359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.867470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.867547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.867571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.867687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.867766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.867791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.867944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.868029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.868054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.868144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.868280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.868305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.868419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.868556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.868581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.868737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.868860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.868888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.869024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.869140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.869164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.869302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.869436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.869460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.869578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.869694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.869718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.869821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.869942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.869976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.870110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.870254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.870278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.870404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.870561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.870589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.870748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.870857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.870881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.871012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.871100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.871128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.871276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.871397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.871424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.871550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.871713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.871741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.871871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.871981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.872006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.872112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.872229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.872256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.872376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.872492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.872519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.872674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.872772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.872798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.872927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.873012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.873037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.873127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.873208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.873233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.873320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.873432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.873457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.873545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.873676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.873702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.720 qpair failed and we were unable to recover it. 00:28:09.720 [2024-11-29 17:10:20.873888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.720 [2024-11-29 17:10:20.873975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.874018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.874155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.874256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.874284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.874389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.874499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.874524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.874644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.874772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.874799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.874887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.875011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.875036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.875128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.875236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.875261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.875365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.875515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.875542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.875693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.875816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.875844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.875976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.876068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.876092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.876180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.876289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.876329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.876430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.876576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.876604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.876705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.876837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.876862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.877008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.877136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.877161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.877299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.877389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.877416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.877539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.877624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.877651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.877737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.877821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.877847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.877986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.878106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.878131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.878259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.878389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.878418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.878497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.878607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.878632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.878801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.878920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.878946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.879110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.879202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.879227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.879387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.879504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.879531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.879632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.879724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.879751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.879882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.879972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.880001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.880133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.880212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.880236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.880385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.880470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.880497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.880587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.880702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.880729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.880817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.880932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.880965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.721 [2024-11-29 17:10:20.881121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.881261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.721 [2024-11-29 17:10:20.881284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.721 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.881445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.881564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.881590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.881713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.881834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.881862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.881970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.882094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.882121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.882254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.882367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.882391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.882513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.882648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.882673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.882773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.882917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.882944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.883054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.883216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.883241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.883350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.883459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.883484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.883599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.883753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.883778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.883910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.884047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.884075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.884177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.884267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.884295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.884457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.884572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.884596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.884703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.884796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.884822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.884939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.885043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.885070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.885202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.885312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.885336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.885417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.885549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.885574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.885691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.885812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.885839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.885965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.886073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.886097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.886189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.886268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.886292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.886374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.886464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.886488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.886643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.886785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.886810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.886889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.886989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.887031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.887158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.887276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.887304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.887441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.887519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.887542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.887670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.887796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.887821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.887930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.888052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.888076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.888225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.888377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.888404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.888561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.888669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.888693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.722 [2024-11-29 17:10:20.888840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.888969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.722 [2024-11-29 17:10:20.889009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.722 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.889099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.889188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.889212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.889376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.889475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.889502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.889629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.889746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.889770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.889906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.890119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.890359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.890644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.890831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.890998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.891122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.891207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.891233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.891324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.891443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.891484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.891595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.891675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.891704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.891817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.891897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.891922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.892067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.892184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.892211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.892316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.892434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.892459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.892569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.892681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.892705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.892808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.892935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.892970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.893068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.893181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.893205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.893349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.893503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.893527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.893645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.893759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.893783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.893913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.894014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.894043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.894164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.894279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.894310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.894393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.894541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.894582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.894699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.894784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.894827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.894923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.895070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.895094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.895212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.895335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.895362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.895485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.895579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.895606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.895733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.895859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.895887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.895991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.896121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.723 [2024-11-29 17:10:20.896146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.723 qpair failed and we were unable to recover it. 00:28:09.723 [2024-11-29 17:10:20.896222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.896366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.896390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.896530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.896660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.896701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.896805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.896893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.896919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.897061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.897196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.897220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.897331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.897421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.897447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.897544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.897662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.897688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.897806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.897955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.898004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.898083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.898175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.898199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.898304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.898390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.898417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.898559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.898676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.898700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.898852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.899016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.899042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.899131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.899212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.899254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.899374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.899528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.899552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.899717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.899811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.899838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.899974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.900122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.900147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.900228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.900387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.900414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.900507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.900593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.900620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.900744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.900912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.900937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.901062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.901171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.901195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.901310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.901393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.901417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.901582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.901712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.901735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.901853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.901955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.902004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.902106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.902218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.902243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.902362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.902448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.902473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.902560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.902649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.902672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.902816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.902943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.903000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.903135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.903274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.903298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.903390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.903551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.903578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.724 [2024-11-29 17:10:20.903733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.903878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.724 [2024-11-29 17:10:20.903905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.724 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.904013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.904164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.904192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.904330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.904472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.904497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.904626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.904725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.904751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.904892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.905005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.905030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.905114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.905258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.905286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.905395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.905471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.905495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.905604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.905768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.905795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.905919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.906014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.906043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.906161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.906280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.906305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.906418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.906529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.906553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.906687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.906768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.906796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.906945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.907078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.907102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.907217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.907301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.907325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.907433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.907540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.907564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.907649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.907755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.907784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.907868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.908012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.908038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.908208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.908359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.908399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.908480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.908617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.908640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.908732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.908812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.908837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.908975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.909048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.909072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.725 [2024-11-29 17:10:20.909147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.909225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.725 [2024-11-29 17:10:20.909267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.725 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.909395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.909465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.909489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.909645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.909758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.909786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.909871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.909954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.909987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.910139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.910264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.910291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.910431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.910532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.910555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.910687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.910801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.910829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.910926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.911068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.911111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.911226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.911303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.911345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.911475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.911609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.911634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.911757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.911853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.911880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.912031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.912146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.912171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.912309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.912409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.912436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.912596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.912685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.912710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.912794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.912903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.912945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.913087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.913185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.913210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.913321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.913460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.913487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.913645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.913782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.913806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.913946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.914073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.914101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.914252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.914410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.914436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.914564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.914688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.914713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.914822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.914909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.914933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.915065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.915180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.915205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.915343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.915467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.915494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.915590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.915704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.915731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.915850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.915971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.915997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.916128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.916280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.916304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.916432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.916560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.916585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.916674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.916780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.916805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.726 [2024-11-29 17:10:20.916972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.917075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.726 [2024-11-29 17:10:20.917100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.726 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.917208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.917297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.917322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.917414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.917519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.917543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.917659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.917795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.917821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.917923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.918041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.918067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.918179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.918274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.918303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.918421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.918525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.918552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.918684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.918811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.918835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.918988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.919081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.919106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.919215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.919299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.919322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.919426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.919588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.919614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.919702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.919834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.919874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.920012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.920094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.920118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.920234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.920341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.920368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.920472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.920589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.920616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.920704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.920855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.920881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.921027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.921134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.921164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.921282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.921443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.921471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.921628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.921707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.921731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.921836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.921946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.921978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.922096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.922180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.922204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.922297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.922409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.922433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.922520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.922603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.922626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.922710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.922819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.922843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.922993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.923101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.923125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.923210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.923293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.923318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.923423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.923519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.923546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.923725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.923836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.923860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.923971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.924054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.924078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.727 [2024-11-29 17:10:20.924192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.924317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.727 [2024-11-29 17:10:20.924345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.727 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.924441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.924574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.924599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.924712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.924823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.924863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.924981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.925126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.925150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.925241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.925376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.925403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.925557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.925643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.925667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.925775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.925943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.925978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.926088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.926201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.926226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.926337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.926458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.926485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.926612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.926709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.926736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.926831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.926972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.926998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.927121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.927235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.927260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.927346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.927428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.927452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.927562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.927663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.927688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.927800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.927887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.927929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.928040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.928180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.928205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.928353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.928490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.928515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.928590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.928700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.928725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.928808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.928889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.928913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.929036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.929110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.929135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.929249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.929326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.929350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.929429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.929530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.929554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.929640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.929747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.929771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.929910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.930021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.930047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.930174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.930315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.930340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.930465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.930594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.930619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.930703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.930830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.930858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.930994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.931132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.931157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.931243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.931384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.931409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.728 [2024-11-29 17:10:20.931520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.931630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.728 [2024-11-29 17:10:20.931655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.728 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.931794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.931895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.931922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.932026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.932133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.932158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.932252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.932368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.932392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.932497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.932630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.932657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.932780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.932899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.932926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.933037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.933116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.933140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.933280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.933455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.933479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.933589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.933741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.933768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.933918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.934085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.934115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.934227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.934308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.934333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.934459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.934563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.934588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.934705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.934777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.934819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.934909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.935037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.935062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.935201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.935311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.935335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.935437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.935563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.935590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.935686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.935810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.935836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.935934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.936041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.936066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.936148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.936254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.936279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.936400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.936473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.936503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.936611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.936745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.936772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.936895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.937013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.937055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.937167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.937277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.937303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.729 qpair failed and we were unable to recover it. 00:28:09.729 [2024-11-29 17:10:20.937475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.937563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.729 [2024-11-29 17:10:20.937587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.937692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.937768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.937792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.937934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.938078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.938104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.938240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.938349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.938374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.938552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.938684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.938708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.938829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.938983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.939011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.939116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.939244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.939270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.939354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.939496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.939519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.939664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.939791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.939819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.939940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.940035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.940062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.940186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.940289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.940315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.940423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.940534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.940559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.940646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.940749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.940774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.940936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.941044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.941069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.941193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.941284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.941308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.941450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.941528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.941552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.941718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.941813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.941840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.941971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.942074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.942098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.942210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.942341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.942367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.942504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.942583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.942609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.942748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.942836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.942862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.942986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.943120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.943143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.943254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.943349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.943376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.943509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.943596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.943619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.943738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.943875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.943898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.944015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.944147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.944171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.730 qpair failed and we were unable to recover it. 00:28:09.730 [2024-11-29 17:10:20.944259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.730 [2024-11-29 17:10:20.944447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.944470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.944548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.944655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.944679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.944769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.944882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.944905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.944987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.945221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.945400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.945617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.945843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.945967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.946082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.946196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.946220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.946317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.946421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.946444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.946527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.946639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.946663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.946756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.946847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.946873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.946966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.947069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.947094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.947181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.947290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.947315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.947429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.947539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.947563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.947648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.947780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.947806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.947895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.948144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.948368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.948588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.948796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.948905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.948986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.949207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.949408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.949634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.949824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.949926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.950019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.950126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.950151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.950235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.950323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.950347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.950421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.950502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.950527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.731 qpair failed and we were unable to recover it. 00:28:09.731 [2024-11-29 17:10:20.950640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.731 [2024-11-29 17:10:20.950718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.950742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.950847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.950981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.951007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.951119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.951201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.951226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.951373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.951489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.951516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.951634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.951711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.951736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.951874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.951982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.952008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.952092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.952192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.952217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.952296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.952390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.952417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.952515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.952628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.952652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.952783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.952899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.952925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.953038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.953129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.953153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.953236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.953343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.953367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.953527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.953618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.953647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.953762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.953898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.953921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.954014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.954096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.954120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.954202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.954285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.954309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.954389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.954546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.954571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.954653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.954789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.954815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.954893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.954976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.955000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.955078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.955213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.955237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.955350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.955427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.955451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.955537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.955633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.955658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.955766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.955870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.955894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.955982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.956198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.956387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.956628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.956814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.956939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.957061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.957170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.957195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.732 qpair failed and we were unable to recover it. 00:28:09.732 [2024-11-29 17:10:20.957301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.732 [2024-11-29 17:10:20.957378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.957403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.957514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.957619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.957645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.957739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.957824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.957848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.957969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.958152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.958354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.958608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.958832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.958937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.959072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.959198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.959227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.959344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.959432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.959460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.959565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.959660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.959687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.959809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.959898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.959929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.960028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.960142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.960166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.960271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.960357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.960381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.960460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.960538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.960586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.960698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.960829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.960856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.960966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.961074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.961099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.961210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.961333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.961357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.961468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.961599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.961626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.961729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.961805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.961832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.961918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.962152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.962372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.962659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.962885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.962995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.963114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.963194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.963236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.963359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.963498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.963525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.963688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.963804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.963831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.963970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.964053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.964078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.733 qpair failed and we were unable to recover it. 00:28:09.733 [2024-11-29 17:10:20.964191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.733 [2024-11-29 17:10:20.964276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.964319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.964423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.964547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.964575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.964711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.964858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.964885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.965021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.965107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.965132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.965217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.965302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.965327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.965411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.965487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.965510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.965638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.965746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.965770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.965883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.965976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.966001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.966082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.966189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.966214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.966291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.966372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.966396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.966478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.966553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.966578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.966711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.966827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.966854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.967024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.967132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.967157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.967271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.967389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.967414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.967529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.967638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.967664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.967795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.967884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.967912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.968030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.968121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.968146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.968286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.968423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.968447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.968592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.968675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.968701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.734 qpair failed and we were unable to recover it. 00:28:09.734 [2024-11-29 17:10:20.968795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.968892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.734 [2024-11-29 17:10:20.968919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.969041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.969157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.969183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.969269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.969375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.969400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.969534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.969654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.969681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.969798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.969920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.969947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.970061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.970170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.970195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.970275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.970390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.970414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.970567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.970709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.970738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.970884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.970977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.971021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.971097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.971187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.971210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.971317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.971403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.971429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.971569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.971676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.971702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.971812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.971942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.972014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.972134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.972214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.972240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.972318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.972401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.972425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.972500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.972577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.972602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.972707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.972788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.972812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.972901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.973039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.973069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.973169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.973285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.973309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.973394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.973479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.973504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.973620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.973756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.735 [2024-11-29 17:10:20.973780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.735 qpair failed and we were unable to recover it. 00:28:09.735 [2024-11-29 17:10:20.973855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.973966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.973992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.974069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.974178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.974202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.974312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.974421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.974446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.974534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.974605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.974630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.974739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.974812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.974836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.974944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.975165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.975417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.975598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.975815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.975920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.976088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.976170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.976194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.976330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.976444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.976469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.976551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.976661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.976685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.976765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.976878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.976902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.977017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.977107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.977131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.977224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.977432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.977456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.977594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.977701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.977726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.977823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.977911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.977935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.978027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.978140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.978164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.978277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.978381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.978405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.736 qpair failed and we were unable to recover it. 00:28:09.736 [2024-11-29 17:10:20.978480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.736 [2024-11-29 17:10:20.978624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.978648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.978783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.978867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.978891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.979002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.979113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.979137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.979256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.979366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.979390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.979477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.979584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.979609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.979720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.979888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.979912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.980018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.980109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.980133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.980254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.980330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.980355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.980470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.980546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.980570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.980649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.980743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.980766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.980885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.980977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.981003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.981117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.981208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.981232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.981345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.981427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.981451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.981572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.981681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.981705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.981798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.981940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.981971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.982087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.982169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.982193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.982281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.982368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.982393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.982502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.982592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.982616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.982738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.982848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.982872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.983011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.983089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.983114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.737 [2024-11-29 17:10:20.983227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.983364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.737 [2024-11-29 17:10:20.983388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.737 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.983470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.983550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.983574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.983656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.983769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.983793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.983906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.984157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.984375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.984575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.984787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.984952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.985050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.985240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.985451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.985635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.985883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.985993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.986070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.986178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.986203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.986290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.986402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.986426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.986545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.986680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.986705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.986835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.986954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.987007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.987090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.987173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.987201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.987287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.987367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.987393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.987466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.987576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.987599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.987684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.987818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.987842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.738 qpair failed and we were unable to recover it. 00:28:09.738 [2024-11-29 17:10:20.987917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.738 [2024-11-29 17:10:20.988007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.988034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.988125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.988209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.988233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.988342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.988451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.988475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.988583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.988672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.988697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.988804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.988909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.988934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.989061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.989139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.989163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.989249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.989334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.989358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.989474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.989558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.989583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.989672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.989748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.989772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.989898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.990108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.990350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.990552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.990739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.990905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.990995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.991082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.991106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.991182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.991257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.991281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.991390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.991479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.991502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.991621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.991708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.991731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.991865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.991981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.992006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.992091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.992172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.992199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.739 qpair failed and we were unable to recover it. 00:28:09.739 [2024-11-29 17:10:20.992307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.992415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.739 [2024-11-29 17:10:20.992440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.992523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.992604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.992627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.992738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.992871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.992895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.992972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.993189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.993432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.993648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.993874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.993990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.994075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.994186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.994210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.994325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.994410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.994435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.994541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.994651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.994675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.994783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.994857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.994881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.994989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.995236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.995455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.995675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.995860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.995994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.996079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.996161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.996185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.996321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.996430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.996454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.996533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.996639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.996663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.740 [2024-11-29 17:10:20.996772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.996877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.740 [2024-11-29 17:10:20.996901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.740 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.997022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.997164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.997188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.997298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.997377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.997401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.997490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.997604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.997628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.997722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.997810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.997834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.997949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.998166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.998409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.998632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.998853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.998972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.999053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.999134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.999158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.999272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.999374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.999398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.999481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.999586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.999610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.999699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.999810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:20.999834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:20.999978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:21.000093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:21.000117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:21.000198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:21.000329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:21.000353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:21.000434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:21.000557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.741 [2024-11-29 17:10:21.000581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.741 qpair failed and we were unable to recover it. 00:28:09.741 [2024-11-29 17:10:21.000690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.000775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.000799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.000908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.000983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.001009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.001100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.001210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.001234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.001345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.001453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.001477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.001564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.001676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.001701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.001781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.001865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.001889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.001972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.002161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.002402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.002590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.002792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.002903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.002995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.003103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.003128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.003268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.003351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.003375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.003511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.003594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.003620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.003738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.003817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.003841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.003930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.004136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.004340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.004582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.004800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.004934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.742 qpair failed and we were unable to recover it. 00:28:09.742 [2024-11-29 17:10:21.005076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.742 [2024-11-29 17:10:21.005187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.005212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.005337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.005483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.005537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.005704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.005847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.005879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.005984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.006081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.006108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.006262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.006377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.006414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.006554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.006697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.006722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.006814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.006927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.006951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.007051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.007140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.007164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.007247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.007383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.007407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.007540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.007646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.007672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.007822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.007951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.007982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.008064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.008151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.008175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.008316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.008412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.008437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.008540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.008643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.008667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.008820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.008898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.008923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.009030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.009140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.009164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.009287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.009436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.009461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.009551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.009643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.009672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.009771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.009888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.009915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.010027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.010106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.010131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.010246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.010319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.010344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.743 qpair failed and we were unable to recover it. 00:28:09.743 [2024-11-29 17:10:21.010470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.010554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.743 [2024-11-29 17:10:21.010585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.010685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.010768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.010796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.010914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.011153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.011373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.011610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.011821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.011980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.012089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.012174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.012199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.012293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.012379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.012406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.012526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.012612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.012639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.012741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.012863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.012899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.013021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.013136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.013160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.013245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.013359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.013384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.013477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.013616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.013640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.013756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.013844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.013869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.013989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.014180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.014406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.014621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.014838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.014973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.015058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.015167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.015191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.744 [2024-11-29 17:10:21.015299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.015375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.744 [2024-11-29 17:10:21.015401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.744 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.015494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.015598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.015622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.015714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.015825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.015850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.015934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.016077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.016103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.016216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.016306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.016332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.016475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.016591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.016616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.016756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.016842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.016867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.016951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.017083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.017108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.017221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.017359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.017384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.017502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.017589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.017614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.017737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.017814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.017839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.017965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.018214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.018429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.018659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.018879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.018998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.019081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.019165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.019189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.019326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.019405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.019429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.019544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.019623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.019647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.019758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.019867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.019891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.019979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.020090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.020115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.745 [2024-11-29 17:10:21.020200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.020314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.745 [2024-11-29 17:10:21.020338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.745 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.020480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.020558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.020583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.020688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.020766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.020791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.020904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.021122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.021338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.021557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.021808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.021942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.022057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.022174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.022198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.022287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.022378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.022403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.022512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.022622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.022646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.022732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.022847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.022872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.023012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.023229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.023452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.023684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.023895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.023996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.024112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.024198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.024222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.024304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.024412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.024436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.024525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.024613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.024643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.024738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.024824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.024848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.746 qpair failed and we were unable to recover it. 00:28:09.746 [2024-11-29 17:10:21.024990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.746 [2024-11-29 17:10:21.025103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.025129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.025252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.025361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.025385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.025501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.025588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.025612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.025697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.025782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.025807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.025921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.026179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.026424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.026668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.026871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.026988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.027105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.027185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.027210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.027323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.027412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.027436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.027543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.027632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.027656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.027770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.027880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.027905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.027998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.028082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.028106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.028215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.028299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.028324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.028402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.028532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.028557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.028643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.028727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.028751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.028864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.029031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.029058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.029178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.029264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.029289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.747 qpair failed and we were unable to recover it. 00:28:09.747 [2024-11-29 17:10:21.029378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.747 [2024-11-29 17:10:21.029498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.029523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.029618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.029728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.029752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.029834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.029919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.029943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.030063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.030175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.030198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.030313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.030402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.030426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.030535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.030623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.030647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.030769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.030889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.030916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.031027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.031109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.031134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.031218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.031330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.031355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.031492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.031610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.031635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.031733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.031857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.031889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.032010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.032126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.032156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.032265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.032349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.032374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.032462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.032571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.032597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.032681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.032759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.032784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.032890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.033209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.033397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.033593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.033820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.033955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.034060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.034207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.034231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.034350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.034493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.034518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.034630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.034707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.034732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.034849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.034924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.034949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.035072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.035151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.035176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.035296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.035433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.035458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.035573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.035701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.748 [2024-11-29 17:10:21.035727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.748 qpair failed and we were unable to recover it. 00:28:09.748 [2024-11-29 17:10:21.035865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.035949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.035986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.036110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.036290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.036317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.036501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.036599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.036624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.036710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.036791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.036816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.036902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.036991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.037018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.037123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.037238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.037264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.037381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.037491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.037517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.037658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.037742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.037768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.037912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.037995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.038022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.038140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.038251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.038276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.038366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.038477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.038502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.038583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.038662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.038688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.038794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.038908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.038933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.039047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.039155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.039181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.039298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.039383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.039409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.039547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.039634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.039659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.039768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.039875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.039899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.040013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.040095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.040119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.040211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.040319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.040345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.040485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.040599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.040624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.040708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.040791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.040817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.040926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.041045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.041071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.041215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.041323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.041347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.041425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.041546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.041572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.041684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.041770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.041796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.041887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.041979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.042007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.042146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.042258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.042285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.042371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.042479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.042504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.042588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.042663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.042688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.042784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.042866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.042892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.043038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.043147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.043172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.749 qpair failed and we were unable to recover it. 00:28:09.749 [2024-11-29 17:10:21.043285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.749 [2024-11-29 17:10:21.043395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.043420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.043513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.043592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.043617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.043699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.043807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.043836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.043949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.044039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.044065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.044175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.044316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.044341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.044451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.044528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.044553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.044643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.044756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.044781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.044896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.044981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.045007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.045091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.045172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.045198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.045311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.045390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.045416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.045529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.045639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.045665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.045786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.045891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.045916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.046064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.046255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.046302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.046420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.046502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.046527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.046661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.046769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.046794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.046917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.047037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.047063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.047173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.047309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.047334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.047417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.047558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.047582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.047692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.047802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.047828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.047943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.048070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.048096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.048208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.048321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.048346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.048433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.048541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.048567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.048687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.048797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.048827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.048914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.049042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.049068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.049187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.049308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.049333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.049442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.049549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.049575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.049690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.049780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.049804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.049946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.050062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.050088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.050195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.050299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.050324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.050432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.050544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.050569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.050649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.050733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.050758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.750 qpair failed and we were unable to recover it. 00:28:09.750 [2024-11-29 17:10:21.050849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.750 [2024-11-29 17:10:21.050966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.050992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.051104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.051177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.051206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.051345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.051480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.051504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.051597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.051709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.051734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.051874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.051969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.051996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.052143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.052249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.052275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.052381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.052514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.052541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.052619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.052703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.052728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.052866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.052978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.053004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.053122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.053231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.053256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.053369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.053454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.053479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.053587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.053701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.053726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.053850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.053987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.054014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.054103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.054213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.054238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.054346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.054467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.054492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.054603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.054713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.054738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.054826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.054932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.054964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.055113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.055213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.055238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.055327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.055439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.055463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.055578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.055659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.055683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.055789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.055899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.055924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.056052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.056165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.056191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.056279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.056387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.056413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.056493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.056605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.056631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.056748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.056844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.056869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.056985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.057098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.057123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.057235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.057347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.057371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.057448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.057536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.057561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.057655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.057766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.057792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.751 [2024-11-29 17:10:21.057905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.058021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.751 [2024-11-29 17:10:21.058048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.751 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.058132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.058220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.058245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.058384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.058524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.058549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.058665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.058800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.058826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.058951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.059047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.059072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.059184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.059295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.059322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.059461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.059574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.059599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.059687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.059763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.059788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.059928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.060051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.060077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.060187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.060295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.060319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.060431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.060517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.060542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.060681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.060797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.060823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.060899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.061008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.061035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.061149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.061260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.061285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.061393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.061506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.061531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.061674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.061778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.061804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.061914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.062009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.062035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.062151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.062266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.062291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.062427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.062545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.062570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.062689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.062798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.062823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.062906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.062990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.063018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.063140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.063228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.063253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.063366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.063474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.063500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.063648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.063733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.063759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.063845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.063953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.063986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.064079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.064160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.064185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.064289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.064367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.064394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.064511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.064614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.064639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.064754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.064833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.064858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.752 [2024-11-29 17:10:21.065001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.065117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.752 [2024-11-29 17:10:21.065142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.752 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.065226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.065364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.065389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.065526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.065671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.065696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.065776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.065893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.065918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.066063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.066231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.066257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.066389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.066552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.066578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.066719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.066824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.066850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.066991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.067080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.067105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.067214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.067378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.067422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.067536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.067627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.067653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.067796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.067934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.067966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.068099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.068198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.068224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.068386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.068527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.068556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.068655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.068791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.068816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.068901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.069029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.069056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.069205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.069312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.069338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.069482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.069568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.069592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.069704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.069813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.069837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.069981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.070102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.070126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.070214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.070298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.070322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.070436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.070574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.070599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.070684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.070785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.070809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.070922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.071177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.071376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.071581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.071826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.071939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.072062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.072145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.072169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.072263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.072338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.072363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.072473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.072584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.072609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.072694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.072783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.072808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.072892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.072998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.753 [2024-11-29 17:10:21.073024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.753 qpair failed and we were unable to recover it. 00:28:09.753 [2024-11-29 17:10:21.073167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.073282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.073308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.073401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.073536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.073562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.073642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.073757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.073783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.073897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.074003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.074029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.074173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.074327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.074371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.074464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.074578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.074603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.074711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.074794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.074821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.074932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.075051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.075078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.075200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.075341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.075367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.075480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.075582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.075607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.075748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.075831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.075858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.075944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.076089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.076116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.076261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.076399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.076424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.076543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.076645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.076671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.076813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.076923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.076949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.077070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.077160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.077186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.077273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.077413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.077437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.077559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.077641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.077666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.077752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.077890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.077914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.078078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.078158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.078183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.078319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.078445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.078470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.078581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.078720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.078744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.078837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.078979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.079005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.079100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.079210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.079235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.079347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.079454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.079479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.079557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.079645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.079671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.079791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.079898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.079922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.080020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.080097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.080122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.080227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.080332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.080358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.754 [2024-11-29 17:10:21.080493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.080579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.754 [2024-11-29 17:10:21.080605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.754 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.080741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.080875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.080901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.081029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.081114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.081140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.081258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.081409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.081434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.081516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.081598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.081625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.081748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.081832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.081857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.081987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.082134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.082160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.082306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.082444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.082469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.082558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.082700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.082725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.082861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.082938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.082969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.083133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.083233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.083258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.083399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.083511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.083535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.083615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.083720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.083745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.083851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.083964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.083995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.084129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.084247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.084272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.084386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.084493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.084519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.084625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.084732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.084757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.084839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.084956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.084989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.085112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.085245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.085271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.085414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.085528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.085553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.085674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.085785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.085810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.085893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.086046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.086092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.086235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.086373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.086398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.086516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.086601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.086630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.086779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.086916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.086941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.087061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.087174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.087199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.087310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.087415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.087439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.087556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.087669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.087694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.087795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.087908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.087932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.088051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.088167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.088192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.088302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.088416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.088440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.088555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.088698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.088723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.088845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.088931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.755 [2024-11-29 17:10:21.088963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.755 qpair failed and we were unable to recover it. 00:28:09.755 [2024-11-29 17:10:21.089101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.089244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.089290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.089428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.089513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.089541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.089657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.089796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.089821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.089932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.090063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.090090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.090202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.090314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.090340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.090484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.090628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.090654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.090779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.090890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.090916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.091017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.091128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.091153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.091270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.091408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.091433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.091520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.091626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.091652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.091743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.091825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.091856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.091973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.092091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.092116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.092202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.092339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.092363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.092507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.092590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.092616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.092757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.092869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.092895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.093045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.093223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.093251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.093391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.093502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.093527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.093643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.093758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.093782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.093870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.094010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.094036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.094141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.094277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.094301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.094413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.094521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.094547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.094632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.094741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.094766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.094892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.094975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.095001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.756 qpair failed and we were unable to recover it. 00:28:09.756 [2024-11-29 17:10:21.095085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.095173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.756 [2024-11-29 17:10:21.095200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.095317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.095418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.095443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.095582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.095721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.095747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.095888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.096141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.096361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.096580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.096828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.096966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.097064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.097142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.097166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.097283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.097424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.097449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.097556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.097692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.097716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.097825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.097978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.098005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.098095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.098208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.098232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.098320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.098454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.098480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.098565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.098699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.098725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.098863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.098997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.099023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.099117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.099259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.099284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.099372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.099482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.099506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.099605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.099715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.099739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.099856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.099971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.099997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.100114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.100224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.100249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.100361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.100497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.100522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.100639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.100746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.100773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.100886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.101026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.101052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.101136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.101219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.101243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.757 qpair failed and we were unable to recover it. 00:28:09.757 [2024-11-29 17:10:21.101384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.101469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.757 [2024-11-29 17:10:21.101495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.101614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.101753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.101778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.101921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.102045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.102072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.102190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.102306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.102331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.102418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.102532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.102557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.102696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.102779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.102804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.102886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.102998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.103025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.103143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.103226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.103252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.103337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.103443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.103469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.103572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.103676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.103701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.103782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.103918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.103943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.104068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.104186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.104211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.104289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.104395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.104419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.104516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.104605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.104632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.104750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.104859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.104885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.104973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.105086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.105112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.105249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.105332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.105359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.105498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.105638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.105664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.105752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.105837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.105861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.105981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.106102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.106127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.106265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.106344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.106369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.106481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.106588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.106614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.106726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.106863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.106888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.107037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.107124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.107149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.107237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.107351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.107377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.107466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.107568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.107593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.107682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.107819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.107845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.107953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.108100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.108125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.108209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.108347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.108371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.108485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.108568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.108594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.108715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.108853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.108878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.758 [2024-11-29 17:10:21.108973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.109101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.758 [2024-11-29 17:10:21.109145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.758 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.109248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.109345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.109370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.109517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.109597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.109622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.109739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.109847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.109872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.109981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.110096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.110122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.110205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.110293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.110318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.110436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.110518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.110543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.110626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.110741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.110767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.110881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.110983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.111010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.111152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.111260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.111284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.111401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.111553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.111578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.111695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.111784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.111809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:09.759 [2024-11-29 17:10:21.111899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.112038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:09.759 [2024-11-29 17:10:21.112065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:09.759 qpair failed and we were unable to recover it. 00:28:10.055 [2024-11-29 17:10:21.112181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.055 [2024-11-29 17:10:21.112265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.055 [2024-11-29 17:10:21.112291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.055 qpair failed and we were unable to recover it. 00:28:10.055 [2024-11-29 17:10:21.112385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.055 [2024-11-29 17:10:21.112468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.055 [2024-11-29 17:10:21.112495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.055 qpair failed and we were unable to recover it. 00:28:10.055 [2024-11-29 17:10:21.112612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.055 [2024-11-29 17:10:21.112703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.055 [2024-11-29 17:10:21.112728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.055 qpair failed and we were unable to recover it. 00:28:10.055 [2024-11-29 17:10:21.112808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.055 [2024-11-29 17:10:21.112919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.055 [2024-11-29 17:10:21.112945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.055 qpair failed and we were unable to recover it. 00:28:10.055 [2024-11-29 17:10:21.113041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.113183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.113208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.113288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.113401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.113426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.113548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.113655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.113681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.113796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.113902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.113927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.114030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.114143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.114168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.114318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.114403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.114429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.114544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.114630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.114656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.114771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.114862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.114886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.114972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.115087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.115111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.115200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.115315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.115340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.115490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.115571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.115598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.115735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.115845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.115871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.115955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.116081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.116107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.116193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.116304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.116330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.116449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.116563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.116588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.116672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.116757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.116782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.116870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.116993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.117019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.117098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.117185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.117211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.117362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.117473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.117498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.117608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.117713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.117738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.117829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.117936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.117989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.118074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.118215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.118240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.118326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.118402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.118428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.118567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.118670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.118695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.118812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.118923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.118947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.119052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.119133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.119158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.119274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.119387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.119413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.056 qpair failed and we were unable to recover it. 00:28:10.056 [2024-11-29 17:10:21.119498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.056 [2024-11-29 17:10:21.119615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.119641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.119727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.119809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.119834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.119947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.120041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.120066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.120206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.120318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.120344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.120483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.120569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.120594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.120706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.120820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.120845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.120985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.121100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.121126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.121240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.121328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.121355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.121496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.121606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.121636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.121761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.121873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.121899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.122040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.122129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.122155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.122304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.122443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.122468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.122585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.122693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.122718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.122803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.122884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.122908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.123020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.123162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.123187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.123332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.123469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.123494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.123606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.123719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.123745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.123864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.123979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.124006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.124095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.124179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.124210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.124329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.124467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.124493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.124600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.124739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.124764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.124885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.124967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.124993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.125109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.125249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.125274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.125355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.125465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.125490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.125598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.125717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.125742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.125847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.125979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.126006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.126090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.126201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.126226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.126315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.126421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.126446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.057 [2024-11-29 17:10:21.126555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.126694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.057 [2024-11-29 17:10:21.126724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.057 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.126839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.126955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.126988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.127103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.127214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.127239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.127383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.127491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.127516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.127624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.127736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.127762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.127880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.127967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.127994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.128109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.128228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.128254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.128373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.128489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.128516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.128656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.128742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.128768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.128847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.129005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.129035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.129170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.129286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.129316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.129462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.129577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.129602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.129692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.129810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.129835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.129911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.130023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.130049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.130186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.130297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.130322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.130410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.130549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.130574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.130711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.130823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.130849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.130984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.131103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.131128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.131242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.131384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.131410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.131562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.131702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.131727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.131819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.131938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.131969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.132089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.132186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.132212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.132368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.132476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.132501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.132624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.132739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.132765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.132904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.133033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.133064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.133210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.133357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.133385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.133487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.133580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.133605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.133744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.133851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.133876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.133986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.134066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.134091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.058 qpair failed and we were unable to recover it. 00:28:10.058 [2024-11-29 17:10:21.134231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.058 [2024-11-29 17:10:21.134352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.134377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.134491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.134627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.134652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.134770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.134878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.134904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.135059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.135175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.135203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.135353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.135482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.135508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.135591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.135701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.135729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.135836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.135924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.135949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.136068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.136203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.136228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.136307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.136422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.136447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.136531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.136639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.136665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.136815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.136936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.136968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.137107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.137296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.137322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.137470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.137605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.137630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.137739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.137822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.137849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.137983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.138121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.138165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.138302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.138452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.138477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.138589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.138699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.138726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.138809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.138929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.138954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.139077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.139189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.139215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.139302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.139387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.139412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.139526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.139664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.139689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.139802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.139924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.139951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.140054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.140140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.140165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.140282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.140391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.140416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.140530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.140674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.140699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.140840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.140952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.140987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.141071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.141160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.141186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.141324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.141407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.141432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.141545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.141622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.059 [2024-11-29 17:10:21.141646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.059 qpair failed and we were unable to recover it. 00:28:10.059 [2024-11-29 17:10:21.141731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.141810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.141836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.141947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.142065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.142090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.142205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.142292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.142316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.142458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.142539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.142564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.142648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.142754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.142778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.142931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.143084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.143110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.143216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.143370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.143394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.143485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.143567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.143592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.143729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.143838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.143862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.143949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.144095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.144120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.144233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.144351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.144375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.144502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.144584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.144609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.144696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.144807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.144832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.144964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.145055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.145081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.145190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.145308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.145333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.145445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.145580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.145606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.145717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.145825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.145850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.145980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.146065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.146092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.146206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.146310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.146335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.146443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.146550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.146575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.146721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.146809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.146834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.146919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.147071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.147098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.147216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.147348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.147373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.147517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.147658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.060 [2024-11-29 17:10:21.147683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.060 qpair failed and we were unable to recover it. 00:28:10.060 [2024-11-29 17:10:21.147793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.147875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.147901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.148043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.148170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.148195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.148308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.148416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.148441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.148544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.148656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.148681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.148767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.148902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.148928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.149077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.149239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.149280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.149405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.149566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.149592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.149710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.149796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.149822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.149936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.150024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.150051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.150174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.150315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.150340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.150458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.150598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.150623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.150734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.150845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.150870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.150953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.151074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.151099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.151238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.151348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.151373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.151484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.151564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.151589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.151709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.151795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.151820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.151929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.152019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.152046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.152155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.152265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.152290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.152406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.152521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.152546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.152658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.152769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.152795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.152902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.152988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.153014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.153108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.153218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.153242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.153347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.153426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.153451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.153564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.153697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.153722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.153794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.153904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.153929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.154068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.154208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.154233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.154323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.154405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.154431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.154568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.154688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.154713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.061 [2024-11-29 17:10:21.154791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.154930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.061 [2024-11-29 17:10:21.154954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.061 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.155100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.155251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.155279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.155431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.155553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.155577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.155689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.155794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.155819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.155929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.156073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.156098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.156212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.156350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.156375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.156465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.156574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.156599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.156689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.156793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.156818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.156932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.157053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.157080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.157202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.157309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.157334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.157418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.157530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.157556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.157664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.157779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.157804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.157887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.157993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.158020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.158128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.158237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.158262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.158350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.158457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.158482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.158591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.158712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.158736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.158826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.158979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.159006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.159120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.159259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.159284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.159368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.159482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.159507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.159653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.159791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.159815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.159954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.160097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.160139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.160301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.160408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.160433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.160516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.160672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.160697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.160807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.160943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.160977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.161062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.161169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.161195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.161315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.161404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.161429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.161569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.161677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.161703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.161808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.161919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.161943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.162085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.162189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.162215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.062 [2024-11-29 17:10:21.162353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.162441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.062 [2024-11-29 17:10:21.162465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.062 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.162608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.162690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.162715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.162848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.162956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.162994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.163079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.163161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.163187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.163279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.163394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.163419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.163503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.163588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.163613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.163722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.163802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.163827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.163940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.164048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.164074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.164190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.164299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.164323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.164435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.164547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.164572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.164684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.164770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.164794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.164929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.165055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.165081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.165221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.165330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.165360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.165448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.165562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.165587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.165724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.165859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.165885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.165981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.166059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.166084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.166172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.166311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.166337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.166449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.166565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.166591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.166738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.166823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.166849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.166970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.167083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.167108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.167204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.167288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.167313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.167404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.167508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.167532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.167621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.167766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.167796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.167906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.168043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.168069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.168186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.168297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.168322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.168435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.168549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.168575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.168685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.168766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.168791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.168896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.169007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.169033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.169128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.169230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.169255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.063 qpair failed and we were unable to recover it. 00:28:10.063 [2024-11-29 17:10:21.169369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.063 [2024-11-29 17:10:21.169479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.169504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.169620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.169758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.169784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.169894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.169967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.169993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.170081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.170192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.170222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.170384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.170538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.170563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.170646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.170783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.170808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.170917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.171054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.171097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.171231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.171365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.171389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.171473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.171553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.171578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.171694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.171802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.171828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.171975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.172116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.172141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.172260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.172374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.172399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.172479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.172590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.172615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.172702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.172809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.172834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.172952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.173090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.173136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.173278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.173471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.173496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.173610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.173716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.173742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.173831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.173943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.173985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.174103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.174216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.174241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.174382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.174494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.174519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.174632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.174741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.174766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.174889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.174975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.175001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.175139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.175248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.175274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.175392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.175505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.175530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.175645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.175727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.175751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.175840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.175950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.175984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.176100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.176245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.176271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.064 qpair failed and we were unable to recover it. 00:28:10.064 [2024-11-29 17:10:21.176413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.176548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.064 [2024-11-29 17:10:21.176573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.176685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.176798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.176824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.176939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.177155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.177199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.177335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.177434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.177459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.177576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.177687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.177714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.177829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.177913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.177938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.178053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.178135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.178159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.178277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.178382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.178407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.178525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.178641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.178666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.178803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.178886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.178911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.179046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.179155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.179179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.179286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.179373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.179398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.179486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.179599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.179626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.179738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.179848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.179873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.179985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.180068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.180094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.180254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.180361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.180386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.180533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.180643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.180670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.180789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.180867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.180892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.180975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.181092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.181116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.181199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.181317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.181343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.181489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.181625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.181651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.181762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.181872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.181897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.182004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.182164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.182209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.182340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.182469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.182494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.182616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.182725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.182750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.182838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.182921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.182948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.183059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.183188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.183212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.065 qpair failed and we were unable to recover it. 00:28:10.065 [2024-11-29 17:10:21.183337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.065 [2024-11-29 17:10:21.183448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.183472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.183586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.183699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.183724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.183819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.183928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.183954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.184107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.184217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.184241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.184352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.184467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.184491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.184581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.184667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.184691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.184803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.184906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.184930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.185084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.185167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.185192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.185332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.185447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.185471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.185588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.185672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.185698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.185815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.185929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.185955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.186092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.186180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.186205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.186317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.186417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.186442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.186556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.186641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.186666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.186775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.186890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.186915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.187067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.187152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.187177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.187254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.187365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.187389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.187506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.187613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.187639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.187751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.187855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.187880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.187972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.188084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.188109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.188201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.188343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.188369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.188481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.188592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.188617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.188729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.188811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.188836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.188976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.189090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.189115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.189198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.189309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.189334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.189453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.189599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.189625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.189762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.189842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.189867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.189990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.190127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.190152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.190290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.190370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.066 [2024-11-29 17:10:21.190397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.066 qpair failed and we were unable to recover it. 00:28:10.066 [2024-11-29 17:10:21.190483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.190597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.190622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.190715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.190826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.190852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.190941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.191031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.191056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.191132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.191235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.191259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.191378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.191492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.191517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.191662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.191744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.191768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.191881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.191999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.192025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.192118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.192203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.192227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.192311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.192426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.192452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.192565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.192682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.192707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.192817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.192906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.192933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.193102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.193230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.193258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.193367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.193473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.193499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.193609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.193723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.193749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.193833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.193935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.193976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.194088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.194164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.194188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.194308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.194383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.194408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.194529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.194661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.194686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.194828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.194904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.194928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.195026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.195147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.195171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.195308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.195467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.195492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.195573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.195666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.195691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.195801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.195913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.195938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.196091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.196229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.196254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.196370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.196479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.196504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.196621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.196728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.196752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.196861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.196970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.196996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.197089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.197180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.197205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.067 qpair failed and we were unable to recover it. 00:28:10.067 [2024-11-29 17:10:21.197348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.197430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.067 [2024-11-29 17:10:21.197454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.197536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.197617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.197642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.197750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.197860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.197885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.197969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.198080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.198105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.198225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.198302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.198328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.198464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.198584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.198609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.198692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.198800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.198826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.198943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.199208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.199394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.199577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.199824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.199968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.200086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.200203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.200228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.200340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.200455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.200481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.200576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.200658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.200683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.200824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.200903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.200929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.201087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.201203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.201228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.201312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.201400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.201425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.201529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.201638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.201664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.201756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.201865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.201890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.202013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.202133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.202158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.202272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.202384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.202411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.202518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.202625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.202650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.202787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.202906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.202936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.203064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.203205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.203232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.203312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.203421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.203447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.203558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.203696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.203722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.203829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.203942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.203975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.068 qpair failed and we were unable to recover it. 00:28:10.068 [2024-11-29 17:10:21.204084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.068 [2024-11-29 17:10:21.204314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.204339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.204445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.204537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.204564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.204651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.204750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.204774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.204888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.204971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.204997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.205140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.205279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.205304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.205413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.205525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.205555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.205694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.205810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.205835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.205926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.206060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.206090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.206239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.206392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.206418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.206531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.206670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.206695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.206813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.206953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.206986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.207146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.207332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.207374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.207487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.207624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.207649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.207735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.207850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.207875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.207980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.208117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.208144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.208265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.208392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.208421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.208565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.208676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.208703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.208819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.208897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.208923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.209012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.209136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.209160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.209258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.209399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.209428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.209596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.209687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.209717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.209841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.209988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.210019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.210144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.210263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.210295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.210421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.210542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.210572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.210700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.210817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.210847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.069 qpair failed and we were unable to recover it. 00:28:10.069 [2024-11-29 17:10:21.210999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.069 [2024-11-29 17:10:21.211098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.211132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.211262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.211388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.211418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.211534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.211650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.211678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.211811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.211927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.211967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.212099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.212179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.212209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.212317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.212435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.212465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.212555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.212675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.212704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.212836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.212966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.212995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.213102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.213223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.213250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.213350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.213475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.213505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.213604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.213725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.213755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.213912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.214070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.214102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.214201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.214353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.214384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.214482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.214628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.214658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.214804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.214895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.214925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.215056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.215245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.215293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.215391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.215531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.215562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.215677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.215789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.215821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.215930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.216034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.216065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.216198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.216296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.216325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.216449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.216597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.216632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.216755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.216877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.216905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.217010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.217170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.217200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.217308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.217429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.217465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.217616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.217740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.217768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.217864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.217965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.217999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.218148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.218295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.218325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.218533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.218660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.218690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.218816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.218966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.070 [2024-11-29 17:10:21.218997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.070 qpair failed and we were unable to recover it. 00:28:10.070 [2024-11-29 17:10:21.219093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.219222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.219270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.219388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.219507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.219537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.219657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.219803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.219832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.220038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.220127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.220158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.220284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.220413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.220443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.220567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.220692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.220719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.220819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.220968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.220999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.221122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.221207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.221233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.221351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.221472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.221503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.221595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.221707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.221738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.221839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.221954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.222016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.222141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.222289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.222321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.222430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.222518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.222545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.222636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.222740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.222769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.222923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.223054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.223084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.223230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.223358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.223384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.223549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.223666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.223696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.223821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.223917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.223948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.224084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.224213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.224244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.224367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.224504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.224533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.224662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.224754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.224781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.224874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.224971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.224998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.225109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.225228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.225258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.225382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.225499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.225526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.225651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.225738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.225766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.225886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.225989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.226020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.226125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.226246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.226272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.226401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.226519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.226549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.226677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.226766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.071 [2024-11-29 17:10:21.226794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.071 qpair failed and we were unable to recover it. 00:28:10.071 [2024-11-29 17:10:21.226920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.227016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.227044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.227176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.227314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.227347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.227443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.227561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.227593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.227728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.227846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.227880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.227968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.228059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.228085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.228218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.228335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.228361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.228491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.228584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.228617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.228746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.228869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.228899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.229063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.229200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.229230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.229407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.229497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.229527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.229622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.229766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.229795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.229920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.230075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.230123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.230250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.230397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.230429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.230539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.230705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.230735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.230857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.230981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.231016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.231137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.231255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.231285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.231406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.231501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.231532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.231633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.231754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.231782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.231909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.232035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.232063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.232155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.232272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.232303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.232531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.232657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.232686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.232834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.232953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.232991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.233139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.233271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.233302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.233485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.233622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.233650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.233775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.233891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.233917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.234023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.234136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.234162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.234256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.234399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.234427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.234550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.234659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.234685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.072 [2024-11-29 17:10:21.234822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.234940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.072 [2024-11-29 17:10:21.234979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.072 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.235089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.235226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.235256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.235382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.235481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.235510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.235619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.235769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.235798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.235921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.236038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.236065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.236158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.236330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.236358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.236462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.236581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.236609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.236708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.236805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.236848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.236940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.237035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.237062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.237149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.237261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.237287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.237412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.237502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.237544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.237695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.237852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.237880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.238001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.238119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.238145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.238260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.238371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.238397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.238505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.238623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.238648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.238752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.238877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.238905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.239002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.239117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.239142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.239259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.239372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.239399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.239496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.239605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.239634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.239780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.239898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.239928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.240071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.240182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.240208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.240292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.240420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.240448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.240571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.240706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.240748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.240900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.240992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.241018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.241108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.241205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.241230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.241349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.241466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.241509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.241633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.241763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.241793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.241927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.242016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.242043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.242133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.242243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.242269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.073 [2024-11-29 17:10:21.242364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.242467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.073 [2024-11-29 17:10:21.242493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.073 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.242624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.242749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.242778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.242883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.242975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.243002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.243116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.243232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.243257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.243342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.243453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.243478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.243593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.243687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.243711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.243879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.244036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.244067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.244172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.244258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.244285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.244433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.244517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.244543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.244637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.244766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.244791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.244926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.245068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.245094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.245208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.245321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.245347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.245461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.245547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.245573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.245687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.245797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.245822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.245968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.246086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.246111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.246194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.246336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.246361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.246504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.246591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.246621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.246703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.246787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.246812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.246919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.247004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.247030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.247145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.247228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.247254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.247368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.247484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.247510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.247625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.247770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.247796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.247937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.248060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.248087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.074 qpair failed and we were unable to recover it. 00:28:10.074 [2024-11-29 17:10:21.248166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.074 [2024-11-29 17:10:21.248305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.248331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.248420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.248533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.248560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.248672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.248765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.248792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.248876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.248954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.248990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.249130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.249213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.249238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.249352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.249462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.249488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.249581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.249663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.249688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.249802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.249886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.249911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.250026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.250113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.250138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.250255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.250368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.250397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.250483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.250593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.250617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.250727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.250881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.250909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.251053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.251172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.251197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.251311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.251432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.251461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.251583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.251695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.251720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.251802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.251913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.251937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.252043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.252186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.252210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.252306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.252397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.252422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.252516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.252595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.252620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.252704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.252820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.252846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.252955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.253201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.253420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.253609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.253817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.253950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.254080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.254160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.254185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.254303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.254412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.254437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.254578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.254721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.254746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.254830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.254941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.254974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.075 qpair failed and we were unable to recover it. 00:28:10.075 [2024-11-29 17:10:21.255061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.075 [2024-11-29 17:10:21.255147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.255172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.255283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.255392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.255417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.255503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.255638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.255663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.255776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.255856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.255881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.255988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.256104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.256129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.256229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.256374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.256398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.256506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.256622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.256647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.256729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.256838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.256863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.256984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.257107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.257131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.257246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.257359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.257384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.257472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.257607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.257632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.257726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.257809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.257834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.257948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.258182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.258401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.258656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.258884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.258991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.259131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.259217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.259243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.259320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.259406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.259431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.259542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.259654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.259678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.259798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.259879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.259904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.260007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.260093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.260119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.260234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.260352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.260378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.260462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.260600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.260624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.260712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.260859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.260885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.260979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.261093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.261118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.261206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.261324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.261349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.261431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.261567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.261592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.261691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.261776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.076 [2024-11-29 17:10:21.261801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.076 qpair failed and we were unable to recover it. 00:28:10.076 [2024-11-29 17:10:21.261895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.261979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.262006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.262121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.262202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.262227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.262340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.262425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.262450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.262568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.262653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.262678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.262799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.262909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.262934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.263020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.263157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.263181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.263294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.263435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.263459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.263551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.263664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.263689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.263811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.263903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.263927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.264028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.264141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.264167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.264279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.264392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.264417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.264539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.264684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.264708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.264822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.264935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.264973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.265092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.265176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.265202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.265313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.265430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.265454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.265539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.265650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.265675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.265794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.265934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.265966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.266083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.266197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.266223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.266373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.266459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.266485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.266592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.266731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.266756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.266863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.266974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.267000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.267090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.267180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.267205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.267322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.267401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.267426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.267515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.267652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.267677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.267791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.267870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.267895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.268009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.268125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.268150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.268278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.268431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.268456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.268547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.268629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.268655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.077 [2024-11-29 17:10:21.268767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.268864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.077 [2024-11-29 17:10:21.268889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.077 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.268979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.269096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.269121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.269229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.269341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.269367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.269506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.269585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.269610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.269714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.269794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.269820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.269967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.270099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.270124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.270253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.270396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.270420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.270507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.270584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.270610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.270739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.270860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.270885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.271001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.271116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.271142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.271226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.271330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.271355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.271474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.271587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.271612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.271750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.271866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.271891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.271972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.272066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.272091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.272176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.272281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.272305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.272418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.272531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.272556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.272678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.272765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.272789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.272874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.272993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.273019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.273130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.273219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.273245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.273333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.273446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.273470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.273554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.273640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.273665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.273746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.273889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.273915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.274031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.274152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.274177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.274275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.274390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.274415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.274552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.274657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.274682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.274772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.274854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.274879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.078 qpair failed and we were unable to recover it. 00:28:10.078 [2024-11-29 17:10:21.274968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.078 [2024-11-29 17:10:21.275089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.275114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.275212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.275332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.275357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.275442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.275533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.275558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.275671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.275758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.275783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.275899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.276016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.276042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.276170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.276284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.276308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.276427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.276514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.276540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.276653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.276740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.276766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.276851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.276969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.277007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.277134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.277278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.277303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.277388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.277485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.277510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.277630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.277776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.277802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.277892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.277978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.278016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.278108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.278250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.278276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.278370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.278479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.278503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.278581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.278659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.278683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.278785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.278896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.278921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.279042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.279184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.279209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.279321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.279437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.279462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.279604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.279717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.279742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.279824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.279942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.279975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.280071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.280209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.280234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.280328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.280422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.280447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.280536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.280652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.280684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.280777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.280900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.280926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.281029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.281142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.281167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.281310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.281395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.281419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.281537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.281641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.281667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.079 [2024-11-29 17:10:21.281758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.281842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.079 [2024-11-29 17:10:21.281867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.079 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.281983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.282095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.282121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.282232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.282345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.282370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.282448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.282561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.282586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.282675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.282786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.282815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.282901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.283130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.283358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.283573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.283811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.283949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.284131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.284270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.284295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.284380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.284521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.284546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.284629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.284747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.284771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.284924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.285066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.285091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.285176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.285258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.285289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.285378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.285492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.285516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.285631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.285711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.285736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.285885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.285997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.286022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.286134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.286220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.286246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.286357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.286472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.286498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.286633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.286720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.286745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.286889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.286979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.287004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.287097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.287182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.287208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.287302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.287413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.287438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.287548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.287630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.287660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.287775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.287922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.287947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.288036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.288144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.288170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.288286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.288396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.288422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.288511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.288590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.288614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.080 [2024-11-29 17:10:21.288703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.288781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.080 [2024-11-29 17:10:21.288807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.080 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.288899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.288985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.289011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.289127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.289239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.289265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.289389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.289473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.289497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.289596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.289709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.289735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.289856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.289938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.289976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.290089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.290175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.290201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.290309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.290393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.290418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.290502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.290641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.290666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.290750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.290892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.290916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.291006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.291118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.291144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.291236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.291319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.291346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.291469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.291550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.291575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.291665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.291779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.291816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.291900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.292033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.292059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.292170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.292260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.292286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.292415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.292535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.292560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.292655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.292766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.292791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.292926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.293095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.293122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.293207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.293318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.293343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.293487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.293600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.293626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.293707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.293786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.293811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.293895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.294118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.294375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.294609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.294847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.294953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.295062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.295150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.295177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.295298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.295411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.295438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.081 qpair failed and we were unable to recover it. 00:28:10.081 [2024-11-29 17:10:21.295558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.081 [2024-11-29 17:10:21.295669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.295695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.295809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.295915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.295940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.296059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.296142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.296167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.296262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.296380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.296404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.296517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.296627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.296653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.296803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.296914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.296951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.297060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.297139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.297165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.297310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.297417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.297443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.297530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.297634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.297660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.297774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.297891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.297917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.298015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.298094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.298121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.298207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.298346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.298372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.298488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.298598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.298622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.298727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.298847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.298877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.299024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.299146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.299171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.299290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.299373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.299397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.299540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.299652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.299677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.299778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.299862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.299886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.299980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.300175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.300419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.300645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.300874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.300986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.301084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.301168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.301192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.301332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.301441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.301467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.301549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.301667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.301692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.301782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.301872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.301898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.302012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.302102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.302129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.302229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.302341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.302365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.082 qpair failed and we were unable to recover it. 00:28:10.082 [2024-11-29 17:10:21.302509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.082 [2024-11-29 17:10:21.302621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.302647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.302731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.302811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.302838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.302986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.303094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.303120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.303202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.303316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.303341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.303450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.303559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.303584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.303692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.303805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.303830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.303953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.304044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.304069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.304165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.304284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.304308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.304410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.304522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.304546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.304658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.304754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.304779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.304871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.304953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.305006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.305085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.305176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.305203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.305323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.305408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.305433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.305574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.305699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.305724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.305841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.305922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.305949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.306048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.306159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.306185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.306284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.306395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.306427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.306542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.306655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.306680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.306805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.306923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.306948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.307100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.307183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.307207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.307325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.307437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.307463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.307545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.307659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.307685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.307783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.307901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.307926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.308019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.308138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.083 [2024-11-29 17:10:21.308163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.083 qpair failed and we were unable to recover it. 00:28:10.083 [2024-11-29 17:10:21.308308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.308398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.308423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.308508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.308596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.308622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.308719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.308819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.308845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.308950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.309047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.309072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.309178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.309280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.309312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.309414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.309552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.309601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.309729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.309895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.309926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.310067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.310212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.310239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.310337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.310446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.310472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.310552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.310637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.310664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.310755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.310902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.310929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.311143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.311235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.311261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.311349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.311437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.311461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.311585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.311664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.311692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.311816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.311939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.311983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.312124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.312205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.312230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.312317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.312429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.312455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.312574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.312657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.312683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.312833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.312917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.312942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.313041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.313128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.313153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.313271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.313358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.313384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.313467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.313583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.313609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.313725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.313877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.313902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.314034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.314117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.314144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.314284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.314410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.314436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.314577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.314686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.314712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.314867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.315011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.315038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.315127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.315207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.315232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.084 [2024-11-29 17:10:21.315381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.315472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.084 [2024-11-29 17:10:21.315497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.084 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.315646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.315756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.315782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.315929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.316030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.316057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.316198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.316317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.316342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.316447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.316586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.316612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.316693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.316782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.316808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.316930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.317066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.317093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.317203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.317340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.317366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.317494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.317570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.317595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.317707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.317788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.317814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.317895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.318025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.318052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.318139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.318248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.318273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.318362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.318464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.318491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.318601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.318715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.318741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.318863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.318991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.319018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.319213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.319329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.319355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.319497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.319588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.319615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.319718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.319806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.319831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.319946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.320095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.320121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.320211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.320295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.320322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.320465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.320662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.320686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.320774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.320882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.320910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.321022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.321181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.321226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.321355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.321512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.321537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.321689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.321804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.321830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.321965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.322075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.322101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.322209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.322373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.322403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.322542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.322656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.322682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.322841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.322966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.322992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.085 qpair failed and we were unable to recover it. 00:28:10.085 [2024-11-29 17:10:21.323073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.085 [2024-11-29 17:10:21.323207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.323235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.323466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.323606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.323632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.323736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.323814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.323840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.323967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.324054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.324080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.324222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.324356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.324382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.324513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.324660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.324686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.324776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.324887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.324912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.325025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.325140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.325170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.325294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.325404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.325430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.325545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.325624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.325649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.325778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.325892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.325918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.326053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.326167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.326193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.326281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.326389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.326414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.326568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.326681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.326707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.326794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.326875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.326902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.326991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.327102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.327126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.327263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.327372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.327398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.327515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.327656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.327687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.327772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.327888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.327914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.328042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.328124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.328149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.328289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.328400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.328426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.328579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.328689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.328715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.328822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.329026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.329052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.329188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.329301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.329326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.329413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.329520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.329545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.329662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.329800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.329825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.329911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.330024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.330050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.330144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.330232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.330272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.330392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.330539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.086 [2024-11-29 17:10:21.330564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.086 qpair failed and we were unable to recover it. 00:28:10.086 [2024-11-29 17:10:21.330707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.330842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.330867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.330953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.331047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.331073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.331184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.331284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.331313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.331441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.331534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.331559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.331652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.331766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.331791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.331930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.332103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.332130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.332236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.332360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.332386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.332495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.332577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.332603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.332717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.332852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.332878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.332979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.333062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.333088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.333163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.333356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.333381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.333499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.333618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.333644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.333794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.333909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.333936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.334081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.334266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.334308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.334432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.334626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.334657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.334777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.334883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.334908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.335065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.335176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.335202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.335341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.335419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.335446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.335584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.335697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.335722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.335868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.335988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.336014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.336154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.336235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.336263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.336344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.336453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.336479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.336589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.336698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.336724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.336810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.336920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.336952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.337085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.337201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.337227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.087 qpair failed and we were unable to recover it. 00:28:10.087 [2024-11-29 17:10:21.337370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.087 [2024-11-29 17:10:21.337487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.337513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.337624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.337721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.337746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.337828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.337917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.337953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.338106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.338216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.338242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.338363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.338469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.338494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.338581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.338679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.338706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.338815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.338932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.338970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.339103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.339219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.339244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.339388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.339486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.339512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.339608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.339720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.339746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.339866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.339989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.340016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.340127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.340243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.340269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.340419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.340529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.340555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.340648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.340790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.340816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.340979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.341098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.341141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.341300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.341429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.341455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.341606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.341728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.341753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.341870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.341979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.342005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.342116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.342193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.342218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.342344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.342466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.342491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.342580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.342690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.342716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.342864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.342982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.343009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.343146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.343264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.343290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.343448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.343642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.343667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.343763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.343885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.343910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.344046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.344225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.344253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.344433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.344542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.344567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.344714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.344831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.344856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.344949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.345032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.088 [2024-11-29 17:10:21.345057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.088 qpair failed and we were unable to recover it. 00:28:10.088 [2024-11-29 17:10:21.345168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.345284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.345310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.345429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.345538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.345563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.345690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.345799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.345824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.345907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.346029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.346056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.346159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.346276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.346301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.346420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.346539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.346565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.346716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.346862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.346887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.347081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.347216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.347259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.347399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.347520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.347546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.347628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.347706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.347733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.347872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.348025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.348051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.348182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.348288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.348314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.348430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.348548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.348573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.348654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.348763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.348788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.348906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.349048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.349094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.349224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.349403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.349444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.349567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.349656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.349681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.349798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.349918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.349944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.350087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.350197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.350223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.350348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.350453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.350479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.350591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.350783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.350809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.350971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.351053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.351079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.351170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.351330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.351372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.351489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.351602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.351628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.351737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.351930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.351955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.352128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.352287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.352330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.352491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.352610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.352636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.352727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.352812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.089 [2024-11-29 17:10:21.352839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.089 qpair failed and we were unable to recover it. 00:28:10.089 [2024-11-29 17:10:21.352961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.353081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.353107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.353193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.353331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.353357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.353455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.353604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.353629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.353721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.353832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.353858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.354001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.354109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.354136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.354221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.354366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.354393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.354478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.354677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.354702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.354791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.354987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.355015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.355210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.355341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.355393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.355522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.355623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.355649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.355768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.355903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.355928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.356057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.356134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.356160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.356313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.356457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.356482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.356605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.356716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.356741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.356885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.357002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.357028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.357224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.357364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.357402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.357513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.357629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.357655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.357740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.357850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.357876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.358032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.358137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.358163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.358285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.358370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.358396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.358518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.358631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.358657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.358763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.358907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.358933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.359035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.359146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.359172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.359287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.359402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.359428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.359544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.359625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.359651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.359749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.359856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.359881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.360014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.360178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.360203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.360341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.360432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.360458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.090 qpair failed and we were unable to recover it. 00:28:10.090 [2024-11-29 17:10:21.360587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.090 [2024-11-29 17:10:21.360786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.360811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.360938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.361085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.361130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.361258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.361404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.361446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.361640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.361754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.361780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.361928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.362081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.362107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.362223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.362338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.362363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.362482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.362629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.362655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.362769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.362849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.362875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.363034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.363142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.363168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.363310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.363389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.363428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.363526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.363633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.363659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.363775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.363897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.363923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.364015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.364102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.364127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.364234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.364346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.364373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.364488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.364587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.364613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.364730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.364812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.364839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.365035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.365146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.365172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.365313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.365437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.365464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.365552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.365674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.365704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.365848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.365975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.366006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.366202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.366362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.366388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.366475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.366604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.366631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.366772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.366884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.366911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.367051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.367211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.367236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.367391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.367544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.367570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.367705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.367848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.367873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.367971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.368105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.368147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.368260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.368362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.368394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.368489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.368625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.091 [2024-11-29 17:10:21.368650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.091 qpair failed and we were unable to recover it. 00:28:10.091 [2024-11-29 17:10:21.368763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.368877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.368907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.369042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.369179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.369204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.369339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.369468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.369494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.369620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.369814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.369840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.369996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.370136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.370161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.370284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.370441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.370466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.370564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.370666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.370692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.370783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.370872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.370898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.371018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.371160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.371187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.371345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.371465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.371491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.371613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.371725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.371755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.371840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.371945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.371976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.372120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.372202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.372227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.372378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.372465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.372492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.372583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.372668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.372694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.372888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.373008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.373034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.373141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.373251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.373278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.373411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.373519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.373546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.373693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.373834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.373860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.374053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.374149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.374175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.374282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.374391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.374417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.374574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.374662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.374688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.374779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.374898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.374923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.375019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.375093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.375118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.375258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.375396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.092 [2024-11-29 17:10:21.375431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.092 qpair failed and we were unable to recover it. 00:28:10.092 [2024-11-29 17:10:21.375561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.375656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.375683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.375773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.375881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.375906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.376017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.376154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.376180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.376287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.376407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.376433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.376585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.376735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.376760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.376864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.376971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.376997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.377147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.377323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.377366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.377496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.377618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.377643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.377760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.377889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.377915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.378056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.378187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.378214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.378366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.378476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.378501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.378613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.378752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.378778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.378893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.379043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.379071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.379161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.379246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.379271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.379386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.379490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.379516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.379602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.379712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.379747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.379887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.380010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.380037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.380181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.380279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.380304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.380422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.380580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.380606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.380713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.380841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.380866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.380967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.381056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.381082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.381245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.381433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.381494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.381600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.381704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.381729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.381852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.381964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.381998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.382154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.382272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.382298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.382426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.382549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.382575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.382706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.382820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.382846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.382993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.383126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.383169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.383324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.383438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.093 [2024-11-29 17:10:21.383464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.093 qpair failed and we were unable to recover it. 00:28:10.093 [2024-11-29 17:10:21.383619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.383701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.383727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.383842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.383953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.383985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.384128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.384235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.384270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.384411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.384523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.384549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.384664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.384812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.384838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.384940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.385058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.385084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.385192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.385335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.385361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.385464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.385587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.385614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.385741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.385853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.385878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.385995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.386085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.386112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.386219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.386336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.386361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.386485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.386625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.386662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.386807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.386999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.387025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.387149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.387267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.387292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.387378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.387468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.387494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.387618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.387741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.387767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.387878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.388009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.388036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.388156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.388234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.388272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.388412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.388560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.388585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.388676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.388822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.388847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.388933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.389031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.389057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.389189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.389347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.389376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.389520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.389661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.389687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.389800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.389912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.389938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.390048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.390191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.390217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.390314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.390429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.390454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.390579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.390719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.390744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.390871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.390968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.390995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.094 qpair failed and we were unable to recover it. 00:28:10.094 [2024-11-29 17:10:21.391082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.391195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.094 [2024-11-29 17:10:21.391220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.391361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.391471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.391497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.391608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.391746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.391773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.391920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.392213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.392453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.392674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.392870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.392984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.393107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.393251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.393276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.393406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.393531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.393557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.393682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.393823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.393849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.393973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.394118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.394143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.394223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.394337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.394362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.394453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.394567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.394592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.394684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.394776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.394802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.394920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.395071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.395097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.395213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.395330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.395355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.395479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.395590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.395616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.395724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.395836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.395861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.395988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.396105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.396131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.396240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.396323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.396349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.396466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.396574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.396600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.396729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.396841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.396866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.397014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.397091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.397116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.397229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.397374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.397408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.397524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.397642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.397667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.095 qpair failed and we were unable to recover it. 00:28:10.095 [2024-11-29 17:10:21.397796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.397964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.095 [2024-11-29 17:10:21.397991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.398103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.398187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.398212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.398302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.398412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.398437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.398537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.398650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.398676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.398835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.398945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.398982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.399105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.399216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.399241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.399383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.399497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.399524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.399638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.399741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.399766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.399879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.399998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.400025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.400112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.400225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.400251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.400400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.400507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.400532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.400648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.400784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.400809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.400977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.401081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.401109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.401296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.401427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.401452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.401566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.401646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.401671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.401782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.401864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.401891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.402049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.402203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.402231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.402376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.402488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.402514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.402629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.402706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.402733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.402874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.402968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.402996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.403134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.403257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.403285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.403426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.403567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.403593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.403686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.403796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.096 [2024-11-29 17:10:21.403821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.096 qpair failed and we were unable to recover it. 00:28:10.096 [2024-11-29 17:10:21.403938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.404064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.404091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.404230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.404342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.404368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.404488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.404596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.404622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.404735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.404852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.404878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.404970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.405125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.405151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.405299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.405409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.405435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.405574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.405718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.405743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.405884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.405969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.405995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.406117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.406296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.406323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.406471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.406623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.406649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.406739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.406828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.406858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.407021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.407141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.407166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.407253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.407358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.407384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.407500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.407585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.407611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.407701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.407844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.407869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.407997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.408117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.408142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.408230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.408336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.408360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.408472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.408585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.408610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.408756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.408866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.408892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.409002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.409089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.409114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.409194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.409279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.409310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.409412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.409493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.409518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.409616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.409726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.409752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.409863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.410002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.097 [2024-11-29 17:10:21.410028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.097 qpair failed and we were unable to recover it. 00:28:10.097 [2024-11-29 17:10:21.410134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.410254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.410279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.410420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.410496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.410521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.410601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.410689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.410714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.410827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.410963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.410990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.411128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.411231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.411257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.411342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.411480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.411505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.411628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.411738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.411768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.411885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.412016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.412042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.412156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.412280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.412305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.412413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.412523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.412548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.412641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.412747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.412772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.412881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.412987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.413013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.413128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.413235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.413260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.413373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.413513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.413538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.413654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.413766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.413791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.413910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.414019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.414045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.414187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.414267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.414301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.414428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.414568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.414593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.414676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.414790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.414815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.414955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.415044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.415070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.415213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.415330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.415357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.415441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.415545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.415571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.415678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.415760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.415785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.415922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.416170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.416358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.416610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.416837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.416972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.417123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.417232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.417259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.417336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.417446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.417473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.417593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.417703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.417728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.098 qpair failed and we were unable to recover it. 00:28:10.098 [2024-11-29 17:10:21.417866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.098 [2024-11-29 17:10:21.417995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.418021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.418130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.418271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.418296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.418410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.418491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.418517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.418627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.418764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.418789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.418903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.419052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.419078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.419191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.419343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.419369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.419487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.419593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.419619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.419705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.419815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.419842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.419990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.420102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.420127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.420239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.420366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.420391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.420530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.420639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.420664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.420809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.420944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.420985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.421104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.421213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.421238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.421354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.421491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.421516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.421630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.421749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.421775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.421891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.422010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.422036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.422160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.422242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.422271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.422410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.422528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.422554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.422690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.422830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.422855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.422989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.423154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.423182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.423336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.423438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.423463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.423602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.423715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.423740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.423849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.423965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.423992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.424105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.424216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.424243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.424388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.424475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.424500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.424641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.424726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.424751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.424872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.424956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.424988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.425109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.425249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.425274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.425362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.425476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.425501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.425592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.425722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.425748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.425884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.426005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.426031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.099 qpair failed and we were unable to recover it. 00:28:10.099 [2024-11-29 17:10:21.426119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.099 [2024-11-29 17:10:21.426230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.426255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.426336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.426446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.426472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.426609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.426696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.426721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.426835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.426946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.426977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.427147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.427285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.427313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.427417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.427506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.427532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.427644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.427749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.427774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.427914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.428034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.428060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.428173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.428260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.428286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.428397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.428505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.428531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.428672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.428783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.428809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.428950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.429131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.429157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.429325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.429457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.429482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.429565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.429671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.429697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.429781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.429883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.429908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.430039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.430182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.430208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.430321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.430456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.430482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.430590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.430705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.430732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.430868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.430983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.431010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.431129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.431299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.431345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.431432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.431568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.431593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.431705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.431822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.431847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.431965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.432057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.432083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.432188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.432328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.432354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.432467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.432582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.432607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.432720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.432803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.432829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.432925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.433040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.433067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.433214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.433361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.433386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.433511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.433597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.433623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.433761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.433881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.433906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.433999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.434158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.434201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.434360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.434497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.434523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.434637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.434746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.100 [2024-11-29 17:10:21.434772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.100 qpair failed and we were unable to recover it. 00:28:10.100 [2024-11-29 17:10:21.434884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.435115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.435351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.435599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.435815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.435952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.436053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.436130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.436156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.436297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.436405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.436431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.436576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.436685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.436710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.436821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.436903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.436929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.437046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.437139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.437165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.437307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.437452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.437477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.437616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.437758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.437784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.437867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.437990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.438016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.438129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.438233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.438258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.438338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.438445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.438470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.438578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.438686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.438711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.438848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.438923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.438949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.439078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.439186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.439211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.439333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.439442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.439468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.439614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.439721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.439746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.439860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.439988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.440015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.440102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.440241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.440267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.440388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.440501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.440526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.440617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.440732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.440759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.440843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.440970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.441006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.441137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.441268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.441293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.441384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.441529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.441555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.441650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.441790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.441816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.441927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.442052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.442078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.101 qpair failed and we were unable to recover it. 00:28:10.101 [2024-11-29 17:10:21.442195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.101 [2024-11-29 17:10:21.442303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.442329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.442433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.442548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.442574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.442664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.442805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.442831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.442927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.443053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.443079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.443220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.443329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.443354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.443469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.443578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.443603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.443726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.443810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.443835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.443921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.444043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.444088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.444197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.444293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.444318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.444408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.444494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.444520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.444631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.444767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.444793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.444905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.444992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.445019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.445106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.445184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.445209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.445334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.445480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.445505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.445643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.445753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.445779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.445872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.445965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.445992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.446082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.446171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.446197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.446317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.446411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.446436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.446536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.446620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.446647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.446735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.446819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.446845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.446956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.447113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.447139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.102 qpair failed and we were unable to recover it. 00:28:10.102 [2024-11-29 17:10:21.447252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.447361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.102 [2024-11-29 17:10:21.447386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.103 qpair failed and we were unable to recover it. 00:28:10.103 [2024-11-29 17:10:21.447498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.103 [2024-11-29 17:10:21.447611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.103 [2024-11-29 17:10:21.447636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.103 qpair failed and we were unable to recover it. 00:28:10.103 [2024-11-29 17:10:21.447748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.103 [2024-11-29 17:10:21.447835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.103 [2024-11-29 17:10:21.447864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.103 qpair failed and we were unable to recover it. 00:28:10.103 [2024-11-29 17:10:21.447953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.448239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.448423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.448633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.448853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.448997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.449117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.449207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.449233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.449352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.449463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.449488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.449596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.449681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.449707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.449803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.449885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.449912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.450021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.450105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.450136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.450255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.450380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.450406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b9/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 328317 Killed "${NVMF_APP[@]}" "$@" 00:28:10.399 0 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 [2024-11-29 17:10:21.450526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.450611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.450636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 17:10:21 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:28:10.399 [2024-11-29 17:10:21.450746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.450824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 [2024-11-29 17:10:21.450849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.399 qpair failed and we were unable to recover it. 00:28:10.399 17:10:21 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:28:10.399 [2024-11-29 17:10:21.450968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.399 17:10:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:10.399 [2024-11-29 17:10:21.451057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.451083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 17:10:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:10.400 [2024-11-29 17:10:21.451171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 17:10:21 -- common/autotest_common.sh@10 -- # set +x 00:28:10.400 [2024-11-29 17:10:21.451257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.451282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.451407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.451491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.451517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.451616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.451726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.451752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.451845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.451963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.451990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.452086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.452178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.452209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.452349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.452438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.452464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.452602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.452689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.452715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.452825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.452912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.452937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.453077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.453186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.453213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.453350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.453503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.453528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.453618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.453758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.453783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.453900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.454017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.454062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.454195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.454342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.454385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.454530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.454617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.454643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 17:10:21 -- nvmf/common.sh@469 -- # nvmfpid=329019 00:28:10.400 [2024-11-29 17:10:21.454735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 17:10:21 -- nvmf/common.sh@470 -- # waitforlisten 329019 00:28:10.400 [2024-11-29 17:10:21.454856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.454882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 17:10:21 -- common/autotest_common.sh@829 -- # '[' -z 329019 ']' 00:28:10.400 [2024-11-29 17:10:21.455000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 17:10:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:10.400 [2024-11-29 17:10:21.455091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.455117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 17:10:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:10.400 17:10:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:28:10.400 [2024-11-29 17:10:21.455237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 17:10:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:10.400 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:10.400 [2024-11-29 17:10:21.455384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.455410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 17:10:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:10.400 [2024-11-29 17:10:21.455535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 17:10:21 -- common/autotest_common.sh@10 -- # set +x 00:28:10.400 [2024-11-29 17:10:21.455647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.455672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.455767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.455878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.455903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.455988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.456080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.456105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.456195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.456336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.456361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.456450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.456530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.456556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.456637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.456746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.456779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.456889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.457013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.457040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.457161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.457311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.400 [2024-11-29 17:10:21.457336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.400 qpair failed and we were unable to recover it. 00:28:10.400 [2024-11-29 17:10:21.457441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.457552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.457581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.457719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.457830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.457857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.457946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.458073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.458100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.458179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.458260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.458285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.458397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.458479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.458504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.458616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.458723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.458747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.458864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.458999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.459024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.459112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.459216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.459245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.459386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.459500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.459527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.459654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.459802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.459833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.459992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.460106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.460137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.460278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.460420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.460451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.460604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.460717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.460746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.460850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.460974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.461006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.461128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.461297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.461328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.461429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.461552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.461581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.461688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.461803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.461835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.461933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.462042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.462079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.462172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.462290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.462323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.462431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.462551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.462581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.462710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.462832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.462860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.462986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.463107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.463136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.463264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.463355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.463384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.463483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.463610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.463639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.463738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.463888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.463915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.464052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.464174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.464205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.464328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.464445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.464474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.464607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.464720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.464746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.401 qpair failed and we were unable to recover it. 00:28:10.401 [2024-11-29 17:10:21.464915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.465021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.401 [2024-11-29 17:10:21.465052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.465146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.465234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.465263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.465407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.465524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.465555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.465720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.465819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.465847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.465942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.466081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.466111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.466230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.466332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.466359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.466483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.466632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.466663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.466774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.466860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.466891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.466998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.467126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.467156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.467290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.467384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.467415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.467540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.467629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.467659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.467758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.467900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.467930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.468071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.468185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.468217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.468325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.468475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.468501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.468627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.468746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.468774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.468899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.468987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.469018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.469113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.469230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.469259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.469352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.469475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.469508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.469634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.469730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.469756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.469847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.469970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.470012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.470152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.470243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.470278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.470397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.470485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.470515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.470642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.470731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.470761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.470886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.471004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.471037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.471194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.471316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.471345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.471482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.471572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.471604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.471726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.471810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.471840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.471995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.472112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.472142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.472270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.472387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.402 [2024-11-29 17:10:21.472417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.402 qpair failed and we were unable to recover it. 00:28:10.402 [2024-11-29 17:10:21.472554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.472640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.472669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.472802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.472949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.472989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.473164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.473338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.473366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.473490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.473611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.473643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.473795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.473915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.473948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.474058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.474174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.474221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.474355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.474472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.474503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.474612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.474728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.474759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.474850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.474946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.474984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.475087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.475183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.475213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.475366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.475487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.475516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.475615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.475710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.475744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.475858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.475978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.476011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.476116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.476232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.476271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.476380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.476524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.476554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.476709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.476827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.476856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.476987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.477114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.477141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.477236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.477364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.477394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.477530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.477676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.477706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.477806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.477923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.477969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.478062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.478178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.478209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.478359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.478488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.478515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.478617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.478699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.478723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.478836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.478928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.478965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.479041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.479151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.479176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.479280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.479413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.479438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.479553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.479686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.479714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.479808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.479933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.403 [2024-11-29 17:10:21.479967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.403 qpair failed and we were unable to recover it. 00:28:10.403 [2024-11-29 17:10:21.480099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.480188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.480215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.480325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.480407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.480435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.480530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.480631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.480657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.480779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.480901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.480928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.481047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.481140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.481164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.481305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.481397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.481423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.481545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.481662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.481689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.481781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.481877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.481905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.482058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.482172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.482197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.482301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.482417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.482444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.482593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.482744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.482770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.482889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.483025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.483050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.483137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.483223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.483247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.483341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.483427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.483470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.483626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.483753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.483779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.483918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.484008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.484032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.484135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.484239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.484263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.484398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.484490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.484518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.484675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.484760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.484787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.484886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.485027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.485060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.485142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.485235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.485267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.485393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.485476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.485503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.485654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.485767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.485794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.485926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.486064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.486093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.404 qpair failed and we were unable to recover it. 00:28:10.404 [2024-11-29 17:10:21.486301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.404 [2024-11-29 17:10:21.486420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.486444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.486571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.486669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.486696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.486786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.486882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.486909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.487054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.487141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.487165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.487278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.487385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.487410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.487506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.487628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.487657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.487761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.487851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.487879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.487985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.488090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.488116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.488190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.488271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.488295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.488400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.488551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.488578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.488685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.488769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.488798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.488916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.489030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.489055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.489168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.489255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.489280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.489403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.489489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.489516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.489639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.489765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.489793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.489921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.490028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.490053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.490166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.490286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.490310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.490410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.490495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.490522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.490643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.490741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.490769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.490862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.490984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.491028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.491146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.491231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.491255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.491348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.491484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.491509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.491594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.491700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.491724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.491836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.491927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.491951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.492066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.492142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.492166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.492318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.492437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.492463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.492590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.492785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.492812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.492940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.493034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.493060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.493178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.493267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.493291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.405 qpair failed and we were unable to recover it. 00:28:10.405 [2024-11-29 17:10:21.493396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.405 [2024-11-29 17:10:21.493517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.493543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.493656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.493756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.493803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.493905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.493999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.494026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.494120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.494196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.494222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.494345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.494438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.494466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.494580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.494666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.494694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.494827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.494949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.494983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.495084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.495207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.495248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.495397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.495510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.495537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.495656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.495856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.495884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.495995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.496129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.496154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.496245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.496364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.496390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.496495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.496596] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:10.406 [2024-11-29 17:10:21.496616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.496648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.496668] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:10.406 [2024-11-29 17:10:21.496800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.496903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.496931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.497080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.497220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.497245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.497364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.497445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.497471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.497562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.497700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.497725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.497811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.497924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.497949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.498067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.498150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.498177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.498266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.498345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.498370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.498455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.498570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.498601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.498713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.498826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.498851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.498976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.499091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.499118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.499215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.499327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.499352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.499432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.499550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.499575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.499688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.499770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.499795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.499874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.500011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.500037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.500130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.500214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.500239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.406 qpair failed and we were unable to recover it. 00:28:10.406 [2024-11-29 17:10:21.500317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.406 [2024-11-29 17:10:21.500428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.500455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.500561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.500669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.500693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.500789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.500866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.500896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.501021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.501102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.501128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.501235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.501374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.501399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.501514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.501631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.501657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.501740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.501854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.501880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.502028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.502115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.502141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.502229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.502362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.502387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.502491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.502601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.502628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.502707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.502827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.502853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.502977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.503182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.503402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.503593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.503827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.503940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.504089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.504201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.504226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.504340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.504480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.504505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.504590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.504667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.504692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.504774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.504885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.504910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.505000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.505138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.505163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.505302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.505414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.505438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.505547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.505640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.505670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.505790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.505904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.505930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.506016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.506100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.506125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.506208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.506298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.506323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.506414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.506522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.506547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.506635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.506719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.506745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.506881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.507022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.407 [2024-11-29 17:10:21.507048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.407 qpair failed and we were unable to recover it. 00:28:10.407 [2024-11-29 17:10:21.507139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.507253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.507278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.507388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.507474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.507499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.507590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.507728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.507753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.507865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.507951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.507982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.508099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.508185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.508211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.508317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.508399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.508424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.508519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.508657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.508683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.508794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.508933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.508965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.509061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.509248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.509465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.509659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.509875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.509992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.510075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.510168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.510193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.510313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.510396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.510427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.510542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.510620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.510646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.510786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.510895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.510920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.511013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.511091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.511118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.511234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.511344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.511369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.511473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.511581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.511607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.511695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.511805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.511830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.511944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.512072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.512098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.512183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.512311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.512336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.512450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.512528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.512553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.512639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.512751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.408 [2024-11-29 17:10:21.512776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.408 qpair failed and we were unable to recover it. 00:28:10.408 [2024-11-29 17:10:21.512892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.512974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.513000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.513088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.513192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.513223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.513314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.513425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.513450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.513526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.513606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.513631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.513722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.513808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.513833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.513948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.514037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.514062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.514148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.514262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.514287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.514373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.514479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.514505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.514621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.514730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.514755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.514854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.514976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.515002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.515084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.515194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.515220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.515311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.515424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.515455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.515599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.515709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.515736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.515825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.515909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.515934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.516024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.516135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.516160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.516304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.516424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.516449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.516562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.516675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.516701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.516821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.516908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.516933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.517049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.517159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.517187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.517281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.517387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.517412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.517549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.517634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.517659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.517748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.517834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.517859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.517940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.518062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.518088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.518207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.518314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.518339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.518451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.518532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.518557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.518648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.518732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.518757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.518866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.519007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.519035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.519148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.519267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.519292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.409 [2024-11-29 17:10:21.519377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.519488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.409 [2024-11-29 17:10:21.519515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.409 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.519642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.519754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.519780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.519875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.519964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.519990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.520108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.520216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.520241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.520361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.520458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.520484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.520573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.520688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.520713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.520831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.520912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.520939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.521090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.521217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.521243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.521333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.521413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.521438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.521553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.521654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.521679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.521789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.521868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.521892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.521978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.522088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.522114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.522200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.522295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.522320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.522398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.522509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.522535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.522658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.522743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.522768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.522887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.522976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.523002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.523090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.523205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.523229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.523318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.523406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.523430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.523517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.523630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.523657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.523736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.523843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.523868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.523985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.524097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.524122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.524236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.524355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.524387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.524474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.524585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.524611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.524691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.524791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.524820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.524928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.525054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.525080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.525197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.525279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.525306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.525420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.525507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.525533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.525652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.525790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.525815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.525908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.525998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.526025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.410 qpair failed and we were unable to recover it. 00:28:10.410 [2024-11-29 17:10:21.526141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.410 [2024-11-29 17:10:21.526279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.526304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.526389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.526496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.526528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.526612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.526701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.526726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.526837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.526982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.527010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.527123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.527205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.527230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.527308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.527452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.527476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.527564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.527642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.527667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.527762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.527907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.527934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.528061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.528149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.528174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.528255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.528367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.528393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.528508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.528619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.528643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.528731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.528811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.528836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 EAL: No free 2048 kB hugepages reported on node 1 00:28:10.411 [2024-11-29 17:10:21.528931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.529032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.529058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.529170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.529283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.529308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.529397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.529475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.529500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.529637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.529727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.529752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.529901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.530021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.530047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.530137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.530218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.530242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.530364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.530471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.530496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.530605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.530720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.530761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.530888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.531051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.531084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.531204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.531316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.531341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.531423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.531510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.531535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.531640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.531778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.531802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.531914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.532016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.532042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.532134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.532220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.532247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.532362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.532446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.532470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.532581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.532690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.532715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.411 qpair failed and we were unable to recover it. 00:28:10.411 [2024-11-29 17:10:21.532827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.411 [2024-11-29 17:10:21.532921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.532946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.533030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.533266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.533453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.533661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.533854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.533967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.534083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.534161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.534186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.534279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.534393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.534418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.534503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.534587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.534618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.534696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.534770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.534795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.534884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.535138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.535387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.535580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.535805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.535918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.536036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.536149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.536175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.536298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.536407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.536433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.536542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.536658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.536683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.536777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.536893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.536918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.537051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.537143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.537169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.537261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.537343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.537367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.537453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.537561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.537586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.537670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.537786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.537810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.537893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.537992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.538017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.538155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.538235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.538263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.538351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.538458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.538483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.538563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.538665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.538690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.538775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.538868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.538891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.538990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.539104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.539129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.412 qpair failed and we were unable to recover it. 00:28:10.412 [2024-11-29 17:10:21.539238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.412 [2024-11-29 17:10:21.539318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.539344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.539461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.539550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.539574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.539658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.539750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.539775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.539888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.540154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.540380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.540631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.540859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.540997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.541089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.541173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.541196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.541308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.541391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.541416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.541503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.541585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.541609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.541704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.541783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.541807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.541920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.542174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.542394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.542608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.542827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.542995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.543139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.543218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.543243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.543352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.543426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.543450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.543555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.543660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.543683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.543765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.543838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.543863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.543944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.544197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.544423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.544615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.413 qpair failed and we were unable to recover it. 00:28:10.413 [2024-11-29 17:10:21.544828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.413 [2024-11-29 17:10:21.544965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.545058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.545166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.545191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.545295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.545405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.545429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.545568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.545655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.545678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.545795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.545901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.545925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.546017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.546130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.546154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.546287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.546400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.546425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.546517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.546619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.546643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.546765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.546841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.546866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.546987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.547100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.547124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.547235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.547340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.547363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.547448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.547565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.547592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.547738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.547841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.547865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.547983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.548206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.548431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.548681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.548869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.548991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.549101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.549236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.549260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.549340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.549450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.549474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.549559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.549666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.549692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.549804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.549880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.549909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.549999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.550112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.550136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.550245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.550357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.550381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.550507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.550648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.550672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.550779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.550894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.550918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.551036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.551125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.551150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.551235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.551374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.551398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.551538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.551623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.551648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.414 qpair failed and we were unable to recover it. 00:28:10.414 [2024-11-29 17:10:21.551730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.551840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.414 [2024-11-29 17:10:21.551864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.551946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.552068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.552092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.552229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.552332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.552361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.552475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.552589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.552614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.552692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.552799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.552823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.552912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.552993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.553017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.553111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.553193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.553217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.553367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.553472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.553496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.553578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.553665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.553689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.553808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.553885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.553909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.554049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.554136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.554161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.554279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.554383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.554407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.554519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.554629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.554653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.554765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.554846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.554870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.554953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.555198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.555415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.555619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.555835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.555969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.556078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.556190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.556214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.556349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.556466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.556489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.556572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.556682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.556707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.556797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.556882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.556905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.557036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.557116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.557140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.557214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.557322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.557345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.557456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.557564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.557589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.557672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.557782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.557807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.557922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.558041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.558067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.558177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.558286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.558311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.415 qpair failed and we were unable to recover it. 00:28:10.415 [2024-11-29 17:10:21.558417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.558490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.415 [2024-11-29 17:10:21.558514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.558596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.558682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.558706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.558819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.558956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.558987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.559067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.559204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.559228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.559319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.559465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.559489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.559601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.559705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.559729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.559844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.559950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.559982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.560071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.560155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.560178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.560263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.560344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.560369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.560479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.560587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.560611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.560719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.560796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.560820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.560925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.561015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.561039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.561158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.561294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.561319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.561454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.561564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.561587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.561730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.561815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.561842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.561924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.562190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.562425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.562599] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:10.416 [2024-11-29 17:10:21.562641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.562887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.562996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.563118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.563223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.563247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.563330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.563405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.563429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.563549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.563652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.563677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.563788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.563927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.563951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.564072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.564160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.564184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.564299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.564378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.564402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.564497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.564636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.564660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.564747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.564828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.564853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.564928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.565008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.565033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.416 qpair failed and we were unable to recover it. 00:28:10.416 [2024-11-29 17:10:21.565119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.416 [2024-11-29 17:10:21.565196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.565220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.565299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.565379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.565403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.565522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.565598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.565622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.565734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.565808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.565833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.565945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.566164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.566441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.566630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.566837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.566998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.567101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.567220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.567245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.567330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.567436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.567460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.567541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.567658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.567683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.567799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.567908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.567933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.568057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.568166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.568191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.568272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.568367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.568392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.568500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.568609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.568633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.568716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.568837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.568861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.568944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.569142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.569399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.569593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.569805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.569908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.569995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.570101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.570126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.570245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.570329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.570354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.570438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.570515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.570539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.417 qpair failed and we were unable to recover it. 00:28:10.417 [2024-11-29 17:10:21.570631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.570722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.417 [2024-11-29 17:10:21.570746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.570849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.570963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.570988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.571106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.571242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.571266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.571410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.571519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.571542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.571683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.571794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.571818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.571932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.572061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.572086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.572226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.572334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.572358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.572440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.572548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.572572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.572709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.572820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.572844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.572934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.573054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.573079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.573186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.573323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.573347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.573432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.573524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.573548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.573689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.573762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.573786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.573871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.574007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.574031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.574118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.574256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.574280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.574393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.574476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.574500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.574630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.574711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.574735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.574847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.574987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.575012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.575126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.575204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.575228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.575311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.575386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.575410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.575531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.575611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.575635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.575778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.575893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.575917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.576010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.576125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.576151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.576265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.576346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.576370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.576487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.576573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.576597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.576735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.576822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.576845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.576981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.577088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.577113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.577187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.577298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.577322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.577436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.577549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.577574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.418 qpair failed and we were unable to recover it. 00:28:10.418 [2024-11-29 17:10:21.577682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.418 [2024-11-29 17:10:21.577816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.577840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.577952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.578074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.578098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.578210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.578295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.578325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.578407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.578516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.578541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.578650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.578764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.578787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.578896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.579145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.579366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.579582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.579773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.579900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.580016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.580129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.580153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.580280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.580387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.580411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.580524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.580617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.580641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.580759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.580844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.580867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.580948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.581035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.581060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.581149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.581259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.581284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.581393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.581504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.581528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.581640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.581714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.581738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.581848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.581987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.582013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.582100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.582181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.582206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.582284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.582375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.582400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.582479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.582590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.582614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.582693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.582779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.582803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.582951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.583163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.583361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.583552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.583737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.583877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.583989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.584070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.584093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.419 qpair failed and we were unable to recover it. 00:28:10.419 [2024-11-29 17:10:21.584175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.419 [2024-11-29 17:10:21.584260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.584283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.584364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.584448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.584474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.584565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.584646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.584671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.584788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.584870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.584894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.585000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.585196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.585463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.585646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.585887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.585992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.586070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.586145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.586169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.586247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.586330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.586356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.586494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.586580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.586604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.586711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.586823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.586849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.586933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.587054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.587081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.587192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.587301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.587326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.587437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.587582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.587607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.587725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.587837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.587862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.588003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.588086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.588112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.588226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.588361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.588386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.588497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.588576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.588600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.588701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.588809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.588833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.588907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.589031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.589056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.589174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.589252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.589276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.589362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.589477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.589502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.589582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.589666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.589697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.420 qpair failed and we were unable to recover it. 00:28:10.420 [2024-11-29 17:10:21.589803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.420 [2024-11-29 17:10:21.589882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.589906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.590019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.590124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.590149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.590255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.590339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.590365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.590474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.590587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.590612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.590696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.590835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.590859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.590943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.591036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.591060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.591174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.591254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.591279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.591415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.591526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.591551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.591638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.591745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.591770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.591911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.592149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.592360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.592569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.592783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.592943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.593063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.593174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.593199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.593307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.593387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.593411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.593516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.593591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.593615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.593705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.593784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.593808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.593901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.593991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.594016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.594094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.594183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.594208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.594291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.594375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.594399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.594515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.594592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.594617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.594727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.594829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.594854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.594937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.595214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.595404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.595642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.595853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.595994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.596106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.596210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.596234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.421 qpair failed and we were unable to recover it. 00:28:10.421 [2024-11-29 17:10:21.596348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.421 [2024-11-29 17:10:21.596433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.596457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.596574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.596647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.596671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.596775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.596882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.596906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.597065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.597173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.597199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.597311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.597416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.597441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.597549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.597627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.597651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.597753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.597864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.597888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.598000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.598084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.598110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.598226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.598340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.598365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.598450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.598537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.598562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.598659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.598766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.598792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.598903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.599157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.599372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.599552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.599779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.599907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.599992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.600214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.600399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.600581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.600859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.600965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.422 [2024-11-29 17:10:21.601062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.601156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.422 [2024-11-29 17:10:21.601180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.422 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.601321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.601407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.601431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.601515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.601598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.601622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.601735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.601820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.601845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.601954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.602040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.602064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.602178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.602282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.602307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.602391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.602498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.602522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.602636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.602778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.602802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.602917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.603139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.603383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.603646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.603827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.603926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.604055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.604166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.604190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.604309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.604396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.604420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.604507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.604585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.604610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.604723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.604831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.604855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.604949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.605165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.605387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.605631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.605855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.605970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.606083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.606226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.606251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.606377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.606464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.606489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.606600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.606705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.606730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.606835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.606913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.606936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.607037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.607144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.607169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.607284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.607406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.607430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.607511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.607601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.607626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.423 qpair failed and we were unable to recover it. 00:28:10.423 [2024-11-29 17:10:21.607711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.423 [2024-11-29 17:10:21.607821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.607845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.607955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.608053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.608078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.608198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.608337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.608362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.608448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.608556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.608580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.608673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.608749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.608774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.608911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.609164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.609361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.609638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.609853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.609992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.610138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.610247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.610272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.610352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.610431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.610455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.610615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.610742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.610770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.610891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.610985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.611013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.611102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.611212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.611236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.611351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.611439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.611465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.611605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.611717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.611743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.611827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.611971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.611997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.612141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.612233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.612260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.612399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.612517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.612541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.612657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.612772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.612798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.612905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.612987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.613013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.613129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.613276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.613300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.613419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.613560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.613586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.613708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.613828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.613853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.424 qpair failed and we were unable to recover it. 00:28:10.424 [2024-11-29 17:10:21.613970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.424 [2024-11-29 17:10:21.614077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.614102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.614215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.614324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.614348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.614462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.614566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.614592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.614674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.614758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.614785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.614897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.615148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.615402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.615651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.615848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.615996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.616082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.616186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.616211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.616349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.616432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.616459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.616576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.616689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.616714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.616799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.616913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.616938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.617068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.617174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.617200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.617315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.617392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.617418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.617506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.617593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.617620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.617705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.617801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.617826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.617937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.618085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.618112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.618225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.618334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.618360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.618473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.618550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.618574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.618654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.618768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.618793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.618905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.619142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.619365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.619546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.619808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.425 [2024-11-29 17:10:21.619953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.425 qpair failed and we were unable to recover it. 00:28:10.425 [2024-11-29 17:10:21.620055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.620143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.620169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.620312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.620402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.620431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.620513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.620606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.620631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.620751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.620892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.620916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.621007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.621090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.621114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.621254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.621344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.621370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.621457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.621536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.621560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.621675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.621809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.621834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.621951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.622037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.622061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.622172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.622254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.622280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.622423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.622515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.622542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.622624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.622779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.622811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.622901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.622993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.623019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.623141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.623253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.623279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.623391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.623502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.623527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.623616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.623731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.623757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.623871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.623979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.624006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.624098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.624189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.624215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.624331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.624450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.624476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.624583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.624670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.624694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.624793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.624923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.624950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.625045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.625129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.625158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.625270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.625386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.625412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.625568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.625654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.625679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.625762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.625849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.625873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.625985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.626099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.626126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.626216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.626354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.626379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.626492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.626615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.626641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.426 [2024-11-29 17:10:21.626755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.626869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.426 [2024-11-29 17:10:21.626895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.426 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.626984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.627200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.627399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.627633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.627854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.627987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.628131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.628235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.628260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.628380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.628492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.628516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.628610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.628725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.628750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.628899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.629131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.629356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.629607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.629836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.629946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.630050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.630136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.630161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.630249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.630363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.630388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.630502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.630621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.630645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.630749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.630865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.630889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.630984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.631100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.631125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.631214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.631319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.631345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.631485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.631628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.631653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.631738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.631821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.631848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.631987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.632097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.632122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.632213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.632323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.632349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.632454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.632566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.427 [2024-11-29 17:10:21.632590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.427 qpair failed and we were unable to recover it. 00:28:10.427 [2024-11-29 17:10:21.632679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.632794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.632820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.632934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.633024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.633050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.633193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.633305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.633330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.633414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.633524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.633548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.633662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.633773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.633798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.633880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.633991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.634018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.634139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.634233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.634259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.634356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.634442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.634467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.634585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.634702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.634727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.634874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.634989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.635016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.635115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.635226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.635252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.635337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.635452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.635476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.635563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.635652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.635676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.635789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.635926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.635951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.636081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.636196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.636223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.636331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.636442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.636467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.636549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.636660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.636685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.636773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.636887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.636912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.637067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.637177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.637202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.637297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.637386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.637413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.637527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.637613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.637638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.637750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.637862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.637887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.637978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.638070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.638097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.638188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.638297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.638323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.638431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.638508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.638535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.428 qpair failed and we were unable to recover it. 00:28:10.428 [2024-11-29 17:10:21.638645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.638729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.428 [2024-11-29 17:10:21.638756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.638871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.639010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.639037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.639150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.639271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.639297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.639413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.639553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.639579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.639669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.639751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.639776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.639915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.640140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.640356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.640565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.640840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.640981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.641065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.641176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.641203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.641309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.641398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.641422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.641536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.641642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.641668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.641785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.641920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.641945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.642042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.642125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.642149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.642230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.642314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.642338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.642454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.642536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.642561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.642710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.642858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.642884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.643029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.643169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.643195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.643305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.643387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.643412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.643551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.643630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.643656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.643768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.643845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.643870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.643991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.644101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.644126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.644237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.644321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.644346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.644488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.644617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.644647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.644742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.644849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.644876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.645022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.645139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.645165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.645257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.645338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.645364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.645509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.645598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.645625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.429 qpair failed and we were unable to recover it. 00:28:10.429 [2024-11-29 17:10:21.645720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.429 [2024-11-29 17:10:21.645858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.645885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.645968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.646079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.646105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.646212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.646283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.646308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.646427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.646538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.646563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.646683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.646767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.646793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.646912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.647030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.647055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.647166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.647256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.647281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.647419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.647508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.647534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.647656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.647794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.647820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.647934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.648137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.648342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.648591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.648869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.648987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.649072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.649214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.649240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.649318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.649402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.649428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.649571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.649683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.649708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.649792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.649877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.649904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.650013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.650124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.650150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.650232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.650340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.650365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.650482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.650564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.650588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.650681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.650795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.650822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.650934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.651082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.651108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.651225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.651317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.651343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.651469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.651579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.651605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.651716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.651836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.651862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.651972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.652060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.652087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.652200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.652311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.652336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.652452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.652564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.430 [2024-11-29 17:10:21.652590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.430 qpair failed and we were unable to recover it. 00:28:10.430 [2024-11-29 17:10:21.652675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.652792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.652817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.652963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.653180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.653431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.653654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.653850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.653953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.654047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.654159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.654185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.654273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.654386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.654411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.654520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.654626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.654651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.654741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.654854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.654880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.654973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.655179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.655429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.655650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.655867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.655984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.656069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.656155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.656180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.656258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.656371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.656397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.656536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.656625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.656650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.656794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.656877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.656903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.656992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.657082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.657108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.657189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.657270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.657297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.657413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.657528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.657555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.657665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.657782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.657808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.657954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.658074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.658100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.658240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.658349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.658375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.658460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.658575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.658601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.658692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.658778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.658809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.658953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.659071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.659096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.431 qpair failed and we were unable to recover it. 00:28:10.431 [2024-11-29 17:10:21.659207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.431 [2024-11-29 17:10:21.659293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.659319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.659432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.659567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.659593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.659705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.659848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.659874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.659969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.660080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.660107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.660221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.660302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.660328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.660447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.660561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.660586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.660669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.660759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.660785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.660897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.660991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.661018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.661130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.661240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.661275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.661389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.661474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.661499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.661583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.661699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.661725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.661812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.661926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.661951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.662035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.662146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.662172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.662254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.662362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.662388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.662506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.662590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.662615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.662702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.662786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.662817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.662967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.663077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.663105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.663219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.663312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.663339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.663425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.663532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.663563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.663706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.663818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.663844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.663917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.664177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.664423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.664618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.432 [2024-11-29 17:10:21.664833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.432 [2024-11-29 17:10:21.664976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.432 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.665090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.665207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.665233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.665341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.665482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.665509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.665603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.665690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.665716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.665835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.665952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.665990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.666107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.666244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.666270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.666380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.666521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.666547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.666662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.666773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.666799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.666888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.667111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.667325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.667538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.667765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.667903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.668018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.668103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.668128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.668208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.668320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.668348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.668444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.668547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.668572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.668694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.668805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.668830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.668998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.669113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.669139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.669262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.669379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.669404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.669547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.669624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.669650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.669789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.669871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.669898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.669989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.670101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.670127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.670239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.670320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.670345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.670433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.670543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.670569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.670676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.670793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.670818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.670938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.671027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.671053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.671161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.671269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.671295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.671393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.671478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.671504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.671613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.671751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.671777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.433 qpair failed and we were unable to recover it. 00:28:10.433 [2024-11-29 17:10:21.671892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.672011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.433 [2024-11-29 17:10:21.672038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.672177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.672316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.672342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.672455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.672563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.672588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.672703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.672821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.672847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.672927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.673033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.673060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.673175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.673286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.673312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.673411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.673546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.673572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.673650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.673790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.673816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.673907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.673990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.674098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.674318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.674510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.674691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.674859] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:10.434 [2024-11-29 17:10:21.674876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.674987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 [2024-11-29 17:10:21.674992] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.675011] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:10.434 [2024-11-29 17:10:21.675025] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:10.434 [2024-11-29 17:10:21.675084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.675082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:28:10.434 [2024-11-29 17:10:21.675199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.675143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:28:10.434 [2024-11-29 17:10:21.675146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:28:10.434 [2024-11-29 17:10:21.675229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.675116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:28:10.434 [2024-11-29 17:10:21.675321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.675439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.675464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.675544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.675634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.675660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.675769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.675852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.675877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.675978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.676172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.676403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.676624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.676801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.676929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.677029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.677140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.677166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.677270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.677375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.677401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.677512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.677595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.677620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.677705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.677795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.434 [2024-11-29 17:10:21.677822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.434 qpair failed and we were unable to recover it. 00:28:10.434 [2024-11-29 17:10:21.677912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.678187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.678364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.678559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.678810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.678946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.679037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.679117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.679142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.679222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.679338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.679364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.679468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.679547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.679573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.679683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.679823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.679849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.679934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.680194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.680414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.680655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.680835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.680945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.681072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.681182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.681208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.681302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.681377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.681402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.681514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.681649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.681675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.681770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.681854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.681880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.681988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.682214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.682458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.682638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.682858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.682997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.683076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.683169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.683195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.683280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.683359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.683384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.683472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.683587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.683612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.683696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.683770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.683795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.683917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.684001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.684027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.435 [2024-11-29 17:10:21.684139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.684226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.435 [2024-11-29 17:10:21.684251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.435 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.684337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.684419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.684445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.684586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.684664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.684695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.684838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.684910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.684935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.685037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.685120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.685146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.685263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.685338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.685363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.685461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.685537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.685562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.685677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.685766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.685791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.685917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.686123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.686365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.686580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.686800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.686910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.687020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.687112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.687137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.687246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.687330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.687357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.687474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.687579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.687604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.687683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.687796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.687822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.687927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.688132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.688321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.688512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.688749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.688850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.688993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.689074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.689100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.689241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.689324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.689351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.689463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.689540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.689566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.689643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.689781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.689807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.436 qpair failed and we were unable to recover it. 00:28:10.436 [2024-11-29 17:10:21.689912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.436 [2024-11-29 17:10:21.689998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.690025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.690143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.690224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.690250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.690332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.690420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.690446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.690558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.690651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.690678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.690764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.690881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.690906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.691023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.691218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.691434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.691611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.691814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.691953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.692046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.692225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.692441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.692641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.692849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.692990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.693133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.693215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.693241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.693361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.693472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.693497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.693578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.693658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.693685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.693772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.693852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.693878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.693963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.694055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.694081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.694166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.694254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.694280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.694424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.694532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.694558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.694651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.694792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.694818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.694901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.694998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.695024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.695100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.695179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.695205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.695304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.695386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.695412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.695499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.695627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.695653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.695792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.695873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.695900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.437 qpair failed and we were unable to recover it. 00:28:10.437 [2024-11-29 17:10:21.695981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.696076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.437 [2024-11-29 17:10:21.696101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.696182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.696300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.696325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.696433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.696517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.696542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.696618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.696725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.696750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.696832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.696945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.696976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.697066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.697157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.697183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.697295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.697369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.697394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.697514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.697624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.697649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.697738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.697845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.697870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.697968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.698161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.698377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.698568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.698790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.698924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.699024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.699134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.699159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.699241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.699322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.699352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.699437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.699510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.699535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.699629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.699716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.699742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.699856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.699932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.700005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.700126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.700209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.700235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.700315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.700397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.700422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.700536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.700617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.700642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.700754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.700832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.700857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.700938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.701145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.701425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.701624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.701844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.701950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.702061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.702168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.702194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.438 qpair failed and we were unable to recover it. 00:28:10.438 [2024-11-29 17:10:21.702288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.438 [2024-11-29 17:10:21.702398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.702423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.702511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.702631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.702656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.702738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.702849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.702876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.702994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.703205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.703438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.703653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.703839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.703945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.704057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.704279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.704478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.704689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.704881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.704995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.705104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.705191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.705217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.705324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.705436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.705461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.705550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.705641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.705666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.705810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.705890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.705920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.706025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.706235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.706426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.706647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.706854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.706993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.707076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.707184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.707209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.707308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.707433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.707458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.707540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.707647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.707673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.707748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.707858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.707884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.707968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.708097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.708122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.708218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.708297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.708323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.708412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.708499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.439 [2024-11-29 17:10:21.708524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.439 qpair failed and we were unable to recover it. 00:28:10.439 [2024-11-29 17:10:21.708616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.708727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.708753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.708858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.709018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.709045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.709131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.709237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.709263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.709346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.709472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.709501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.709644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.709730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.709762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.709890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.709979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.710009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.710137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.710246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.710275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.710375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.710492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.710522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.710652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.710752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.710781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.710880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.710973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.711014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.711107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.711197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.711228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.711355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.711475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.711509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.711605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.711701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.711729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.711827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.711908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.711940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.712042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.712137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.712165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.712297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.712378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.712410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.712544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.712631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.712662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.712810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.712919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.712950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.713064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.713158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.713188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.713321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.713411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.713443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.713563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.713684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.713717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.713811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.713897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.713926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.714068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.714150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.714177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.714288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.714373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.714402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.714497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.714618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.714648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.714741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.714819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.714846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.714971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.715073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.715103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.715203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.715299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.715326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.440 qpair failed and we were unable to recover it. 00:28:10.440 [2024-11-29 17:10:21.715455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.715541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.440 [2024-11-29 17:10:21.715567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.715660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.715745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.715770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.715887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.715969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.715997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.716099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.716180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.716206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.716291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.716370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.716396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.716479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.716554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.716580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.716697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.716782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.716809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.716906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.716997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.717024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.717105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.717178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.717206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.717301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.717381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.717409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.717505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.717646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.717672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.717770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.717855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.717881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.718032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.718226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.718446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.718650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.718844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.718989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.719084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.719171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.719198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.719285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.719420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.719447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.719556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.719651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.719680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.719785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.719867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.719894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.719993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.720198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.720407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.720631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.720837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.720948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.721050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.721173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.721199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.441 qpair failed and we were unable to recover it. 00:28:10.441 [2024-11-29 17:10:21.721299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.441 [2024-11-29 17:10:21.721385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.721412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.721529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.721606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.721632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.721737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.721816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.721842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.721952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.722087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.722119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.722229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.722333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.722360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.722451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.722549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.722580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.722672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.722795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.722825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.722927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.723158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.723358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.723606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.723815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.723922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.724048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.724147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.724179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.724312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.724407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.724437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.724539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.724655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.724682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.724781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.724860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.724891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.724998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.725091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.725122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.725214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.725305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.725335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.725458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.725548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.725579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.725670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.725765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.725794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.725883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.725971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.726000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.726100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.726203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.726234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.726333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.726430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.726458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.726574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.726676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.726709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.726818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.726913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.726941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.727038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.727123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.727152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.727246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.727370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.727399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.727485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.727575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.727604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.727731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.727818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.727845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.727941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.728042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.728068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.728167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.728263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.442 [2024-11-29 17:10:21.728294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.442 qpair failed and we were unable to recover it. 00:28:10.442 [2024-11-29 17:10:21.728389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.728474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.728505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.728640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.728735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.728762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.728861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.728954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.728995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.729093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.729183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.729212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.729312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.729432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.729463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.729551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.729654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.729680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.729797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.729877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.729906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.730012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.730100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.730129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.730217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.730314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.730340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.730464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.730546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.730575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.730662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.730752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.730781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.730873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.730978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.731005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.731117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.731206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.731233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.731322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.731402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.731428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.731508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.731618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.731646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.731764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.731851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.731876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.732010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.732232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.732462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.732680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.732877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.732991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.733106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.733184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.733209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.733294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.733391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.733418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.733507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.733590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.733616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.733700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.733781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.733807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.733899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.734152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.734357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.734603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.734796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.734903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.734999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.735087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.735113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.443 qpair failed and we were unable to recover it. 00:28:10.443 [2024-11-29 17:10:21.735195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.443 [2024-11-29 17:10:21.735315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.735341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.735426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.735511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.735548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.735663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.735742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.735769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.735853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.735934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.735966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.736062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.736170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.736199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.736308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.736396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.736425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.736542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.736629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.736655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.736742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.736831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.736856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.736954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.737186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.737391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.737619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.737820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.737932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.738027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.738111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.738138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.738260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.738340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.738367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.738480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.738569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.738595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.738683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.738786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.738811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.738898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.739159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.739379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.739578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.739776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.739886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.739986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.740210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.740417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.740673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.740868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.740985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.741085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.741162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.741189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.741290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.741377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.741403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.741495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.741600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.444 [2024-11-29 17:10:21.741626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.444 qpair failed and we were unable to recover it. 00:28:10.444 [2024-11-29 17:10:21.741715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.741796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.741821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.741905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.741999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.742034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.742118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.742212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.742251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.742362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.742451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.742477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.742570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.742714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.742740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.742817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.742934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.742972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.743095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.743212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.743241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.743322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.743410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.743438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.743522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.743600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.743625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.743717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.743791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.743819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.743907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.744137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.744357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.744577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.744774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.744881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.744970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.745086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.745111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.745192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.745319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.745345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.745458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.745569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.745594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.745679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.745766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.745791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.745901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.745988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.746027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.746115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.746201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.746227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.746305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.746386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.746411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.746501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.746663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.746689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.746803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.746895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.746929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.747056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.747141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.747174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.747260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.747350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.747376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.445 [2024-11-29 17:10:21.747470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.747595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.445 [2024-11-29 17:10:21.747622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.445 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.747711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.747795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.747822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.747929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.748162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.748387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.748588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.748832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.748949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.749130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.749218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.749247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.749354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.749447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.749477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.749573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.749686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.749716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.749844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.749937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.749980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.750084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.750202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.750230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.750327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.750413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.750442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.750540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.750657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.750684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.750814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.750906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.750936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.751051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.751136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.751165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.751257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.751347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.751374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.446 [2024-11-29 17:10:21.751499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.751588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.446 [2024-11-29 17:10:21.751618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.446 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.751743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.751834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.751863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.751964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.752064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.752094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.752209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.752301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.752330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.752426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.752518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.752544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.752667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.752763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.752792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.752914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.753142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.753361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.753578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.753810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.753948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.754056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.754135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.754161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.754255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.754347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.754373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.754457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.754551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.754577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.754685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.754776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.754803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.754884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.754984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.755011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.755093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.755198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.755224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.755315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.755407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.755433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.755514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.755652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.755678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.755784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.755875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.755900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.756019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.756115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.756143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.756224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.756318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.756345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.756462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.756573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.756602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.447 qpair failed and we were unable to recover it. 00:28:10.447 [2024-11-29 17:10:21.756681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.756756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.447 [2024-11-29 17:10:21.756783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.756885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.757118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.757393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.757626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.757814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.757928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.758053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.758169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.758195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.758279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.758384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.758410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.758507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.758589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.758616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.758722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.758835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.758861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.758950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.759172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.759384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.759603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.759799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.759936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.760040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.760124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.760149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.760231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.760326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.760352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.760469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.760549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.760576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.760690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.760775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.760801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.760932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.761022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.761048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.761134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.761261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.761295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.761381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.761495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.761521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.761614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.761697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.448 [2024-11-29 17:10:21.761726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.448 qpair failed and we were unable to recover it. 00:28:10.448 [2024-11-29 17:10:21.761855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.761931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.761964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.762055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.762162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.762189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.762290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.762374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.762400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.762490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.762576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.762603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.762684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.762831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.762857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.762944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.763063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.763089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.763203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.763287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.763314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.763395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.763499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.763523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.763612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.763697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.763723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.763970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.764162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.764473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.764688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.764876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.764997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.765081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.765195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.765219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.765322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.765411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.765437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.765530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.765611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.765635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.765724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.765798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.765823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.765937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.766168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.766362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.766571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.449 [2024-11-29 17:10:21.766802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.449 [2024-11-29 17:10:21.766912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.449 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.767006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.767207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.767406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.767592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.767780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.767916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.768038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.768223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.768406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.768593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.768838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.768953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.769065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.769142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.769171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.769256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.769375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.769401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.769495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.769571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.769596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.769681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.769766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.769791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.769889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.769980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.770014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.770093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.770178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.770204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.770298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.770385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.770412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.770494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.770580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.770605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.770686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.770778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.770805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.770920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.771019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.771045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.771139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.771223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.771253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.450 qpair failed and we were unable to recover it. 00:28:10.450 [2024-11-29 17:10:21.771336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.771441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.450 [2024-11-29 17:10:21.771466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.771548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.771638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.771663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.771748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.771835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.771860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.771949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.772201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.772404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.772624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.772820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.772926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.773016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.773225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.773456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.773635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.773850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.773955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.774052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.774132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.774157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.774292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.774389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.774423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.774529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.774617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.774644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.774748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.774864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.774895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.774987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.775070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.775100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.775180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.775304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.775329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.451 qpair failed and we were unable to recover it. 00:28:10.451 [2024-11-29 17:10:21.775441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.451 [2024-11-29 17:10:21.775537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.775567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.775655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.775761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.775787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.775904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.775992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.776018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.776102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.776209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.776235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.776351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.776431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.776456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.776572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.776660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.776688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.776767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.776841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.776868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.776962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.777192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.777380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.777605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.777803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.777970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.778095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.778181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.778206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.778294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.778375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.778400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.778517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.778596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.778624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.778735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.778844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.778871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.778965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.779171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.779371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.779593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.779790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.779931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.779992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2465600 (9): Bad file descriptor 00:28:10.452 [2024-11-29 17:10:21.780133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.780224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.780252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.452 qpair failed and we were unable to recover it. 00:28:10.452 [2024-11-29 17:10:21.780344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.780461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.452 [2024-11-29 17:10:21.780492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.780620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.780738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.780770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.780861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.780973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.781006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.781099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.781192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.781222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.781357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.781473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.781500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.781623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.781706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.781732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.781819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.781902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.781928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.782019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.782102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.782128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.782266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.782403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.782434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.782529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.782638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.782664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.782753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.782842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.782869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.782987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.783172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.783426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.783614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.783825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.783975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.784067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.784149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.784175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.784290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.784392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.784418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.784497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.784577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.784608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.784697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.784774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.784799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.784909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.784998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.785024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.785133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.785247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.785271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.785413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.785494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.785519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.453 [2024-11-29 17:10:21.785604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.785708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.453 [2024-11-29 17:10:21.785734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.453 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.785846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.785964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.785991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.786086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.786196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.786222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.786315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.786394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.786420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.786498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.786635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.786660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.786746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.786819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.786849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.786945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.787171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.787422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.787621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.787817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.787931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.788032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.788230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.788443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.788638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.788830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.788939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.789045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.789150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.789181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.789286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.789370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.789399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.789492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.789585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.789609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.789722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.789803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.789827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.789914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.790031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.790057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.790150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.790238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.790262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.790344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.790424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.790448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.454 qpair failed and we were unable to recover it. 00:28:10.454 [2024-11-29 17:10:21.790530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.790613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.454 [2024-11-29 17:10:21.790637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.455 qpair failed and we were unable to recover it. 00:28:10.455 [2024-11-29 17:10:21.790720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.790802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.790827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.455 qpair failed and we were unable to recover it. 00:28:10.455 [2024-11-29 17:10:21.790914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.455 qpair failed and we were unable to recover it. 00:28:10.455 [2024-11-29 17:10:21.791151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.455 qpair failed and we were unable to recover it. 00:28:10.455 [2024-11-29 17:10:21.791334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.455 qpair failed and we were unable to recover it. 00:28:10.455 [2024-11-29 17:10:21.791513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.455 qpair failed and we were unable to recover it. 00:28:10.455 [2024-11-29 17:10:21.791728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.791833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.455 qpair failed and we were unable to recover it. 00:28:10.455 [2024-11-29 17:10:21.791917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.792013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.792037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.455 qpair failed and we were unable to recover it. 00:28:10.455 [2024-11-29 17:10:21.792122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.792210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.455 [2024-11-29 17:10:21.792234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.455 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.792315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.792396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.792421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.792504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.792593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.792618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.792707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.792790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.792815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.792903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.792979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.793004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.793096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.793199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.793226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.793318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.793398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.793424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.793524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.793614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.793645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.793734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.793847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.793878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.793981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.794200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.794403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.794603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.794795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.794927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.795018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.795209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.795404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.795590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.726 qpair failed and we were unable to recover it. 00:28:10.726 [2024-11-29 17:10:21.795776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.726 [2024-11-29 17:10:21.795875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.795969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.796158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.796401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.796597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.796769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.796872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.796952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.797188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.797379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.797602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.797844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.797947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.798041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.798231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.798427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.798620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.798803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.798911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.799036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.799224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.799440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.799632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.799844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.799945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.800035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.800226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.800421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.800610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.800795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.800989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.801071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.801157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.801181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.801260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.801337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.801360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.801446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.801528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.801552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.727 qpair failed and we were unable to recover it. 00:28:10.727 [2024-11-29 17:10:21.801670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.727 [2024-11-29 17:10:21.801749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.801773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.801880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.801965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.801990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.802069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.802259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.802434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.802619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.802839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.802979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.803056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.803239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.803428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.803618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.803804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.803909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.804000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.804182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.804360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.804551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.804729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.804837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.804923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.805133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.805356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.805584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.805856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.805984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.806109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.806197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.806231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.806354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.806470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.806501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.806615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.806709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.806740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.806824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.806932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.806962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.807044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.807128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.807152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.807231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.807310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.807333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.807414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.807489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.807514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.728 qpair failed and we were unable to recover it. 00:28:10.728 [2024-11-29 17:10:21.807614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.728 [2024-11-29 17:10:21.807732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.807756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.807840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.807922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.807946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.808037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.808229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.808410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.808630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.808838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.808942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.809029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.809248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.809440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.809624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.809816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.809914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.810020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.810206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.810400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.810579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.810796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.810899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.810988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.811186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.811366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.811558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.811781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.811890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.811976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.812186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.812380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.812587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.812809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.812904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.812995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.813079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.813105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.729 [2024-11-29 17:10:21.813202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.813300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.729 [2024-11-29 17:10:21.813330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.729 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.813417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.813531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.813556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.813650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.813761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.813786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.813875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.813954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.813987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.814072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.814181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.814207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.814326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.814439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.814465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.814558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.814635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.814661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.814771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.814851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.814875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.814997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.815251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.815467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.815646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.815837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.815943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.816058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.816249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.816433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.816635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.816857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.816956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.817049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.817253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.817451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.817633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.817856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.817966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.818065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.818153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.818177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.818253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.818327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.818351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.730 qpair failed and we were unable to recover it. 00:28:10.730 [2024-11-29 17:10:21.818432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.730 [2024-11-29 17:10:21.818510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.818535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.818625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.818697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.818722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.818800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.818891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.818915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.819009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.819229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.819427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.819625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.819833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.819931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.820036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.820222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.820419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.820639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.820819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.820919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.821012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.821186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.821365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.821579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.821762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.821864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.821939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.822135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.822386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.822565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.822750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.822849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.822944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.823205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.823407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.823594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.823816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.823921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.731 [2024-11-29 17:10:21.824014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.824093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.731 [2024-11-29 17:10:21.824125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.731 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.824209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.824318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.824342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.824427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.824511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.824536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.824617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.824691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.824715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.824802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.824880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.824904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.824981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.825191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.825373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.825555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.825740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.825843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.825967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.826248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.826456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.826663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.826868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.826988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.827100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.827286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.827475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.827666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.827882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.827987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.828066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.828145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.828171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.828257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.828332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.828356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.828443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.828522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.828548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.828663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.828765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.828790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.828903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.829142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.829334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.829546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.829759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.829863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.732 qpair failed and we were unable to recover it. 00:28:10.732 [2024-11-29 17:10:21.829938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.732 [2024-11-29 17:10:21.830087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.830114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.830231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.830311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.830336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.830456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.830537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.830563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.830650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.830758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.830783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.830880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.830952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.830985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.831095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.831178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.831204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.831316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.831392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.831417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.831529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.831639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.831664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.831743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.831819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.831844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.831962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.832196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.832380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.832570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.832792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.832900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.832979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.833198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.833406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.833688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.833874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.833994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.834084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.834163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.834188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.834301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.834378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.834404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.834480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.834587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.834611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.834729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.834838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.834863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.834949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.835137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.835382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.835561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.835781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.835887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.733 [2024-11-29 17:10:21.835969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.836073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.733 [2024-11-29 17:10:21.836098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.733 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.836186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.836261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.836288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.836369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.836477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.836501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.836641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.836745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.836769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.836920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.837111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.837360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.837598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.837785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.837917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.838067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.838148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.838173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.838285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.838363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.838387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.838470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.838547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.838572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.838692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.838803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.838828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.838907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.838992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.839106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.839298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.839491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.839675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.839880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.839983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.840122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.840204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.840229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.840338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.840415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.840439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.840550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.840631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.840656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.840732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.840811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.840837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.840935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.841083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.841113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.841200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.841315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.841341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.841451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.841535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.841560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.841648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.841755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.841781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.841868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.841975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.842001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.842082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.842192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.842218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.734 [2024-11-29 17:10:21.842296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.842402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.734 [2024-11-29 17:10:21.842426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.734 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.842515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.842621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.842647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.842741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.842827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.842855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.842969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.843156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.843373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.843600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.843811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.843948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.844041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.844151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.844176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.844265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.844407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.844431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.844548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.844629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.844654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.844734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.844820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.844844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.844980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.845058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.845083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.845193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.845298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.845324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.845433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.845517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.845543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.845661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.845771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.845797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.845917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.845999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.846024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.846107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.846184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.846208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.846302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.846442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.846467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.846551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.846658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.846682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.846765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.846845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.846871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.847052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.847161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.847186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.847269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.847444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.847469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.847560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.847675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.847702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.847824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.847909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.847933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.848028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.848139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.848168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.735 qpair failed and we were unable to recover it. 00:28:10.735 [2024-11-29 17:10:21.848246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.848319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.735 [2024-11-29 17:10:21.848345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.848427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.848529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.848553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.848639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.848780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.848806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.848915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.849135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.849358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.849586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.849813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.849944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.850071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.850161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.850188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.850302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.850384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.850416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.850562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.850641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.850667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.850747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.850829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.850856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.850933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.851127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.851374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.851625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.851823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.851938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.852025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.852214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.852394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.852620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.852805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.852971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.853063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.853145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.853170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.853254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.853349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.853374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.853465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.853550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.853574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.853660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.853778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.853806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.853899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.854013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.854040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.854129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.854238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.854262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.854340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.854448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.736 [2024-11-29 17:10:21.854473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.736 qpair failed and we were unable to recover it. 00:28:10.736 [2024-11-29 17:10:21.854588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.854668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.854699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.854809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.854888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.854912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.855000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.855079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.855105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.855198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.855302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.855328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.855436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.855552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.855577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.855658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.855799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.855824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.855910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.856158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.856374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.856571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.856820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.856924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.857022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.857109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.857134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.857251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.857331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.857357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.857466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.857540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.857565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.857679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.857788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.857814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.857903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.858164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.858353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.858540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.858813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.858909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.859017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.859206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.859394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.859613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.859828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.859938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.860027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.860163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.860188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.860276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.860360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.860387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.860473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.860586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.860611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.737 qpair failed and we were unable to recover it. 00:28:10.737 [2024-11-29 17:10:21.860693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.860806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.737 [2024-11-29 17:10:21.860831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.860911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.860990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.861016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.861099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.861181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.861208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.861324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.861430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.861456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.861534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.861621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.861647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.861729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.861805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.861831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.861939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.862028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.862054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.862158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.862241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.862267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.862351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.862465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.862491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.862680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.862766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.862791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.862902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.863014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.863041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.863132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.863215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.863243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.863364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.863441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.863466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.863553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.863631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.863657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.863852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.863990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.864016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.864154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.864238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.864263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.864348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.864539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.864564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.864678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.864785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.864810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.864891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.864996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.865022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.865134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.865245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.865271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.865362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.865443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.865468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.865545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.865651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.865676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.865814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.865893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.865920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.866023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.866215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.866241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.866348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.866441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.866466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.866543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.866627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.866654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.866739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.866816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.866841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.866953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.867041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.867067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.738 qpair failed and we were unable to recover it. 00:28:10.738 [2024-11-29 17:10:21.867146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.867226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.738 [2024-11-29 17:10:21.867252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.867363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.867499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.867524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.867714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.867825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.867850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.867971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.868168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.868387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.868572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.868829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.868970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.869052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.869164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.869188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.869299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.869379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.869404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.869516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.869624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.869649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.869728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.869808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.869832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.869921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.870133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.870317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.870534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.870736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.870849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.870956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.871170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.871384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.871624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.871812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.871949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.872074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.872153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.872180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.872266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.872381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.872406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.872512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.872592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.872617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.872729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.872812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.872837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.872913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.872997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.873024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.873134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.873214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.873240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.873321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.873406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.873432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.739 qpair failed and we were unable to recover it. 00:28:10.739 [2024-11-29 17:10:21.873513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.873620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.739 [2024-11-29 17:10:21.873645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.873755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.873868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.873893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.874015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.874206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.874397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.874616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.874864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.874982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.875066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.875181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.875206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.875325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.875404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.875429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.875537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.875611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.875636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.875740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.875848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.875873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.875954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.876069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.876096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.876206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.876281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.876306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.876418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.876519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.876544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.876624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.876728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.876753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.876834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.876977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.877085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.877281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.877490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.877674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.877888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.877978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.878004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.878109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.878193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.878218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.878299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.878376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.878401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.878483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.878565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.878590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.878674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.878780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.878805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.878912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.879124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.879340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.879561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.740 [2024-11-29 17:10:21.879787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.740 [2024-11-29 17:10:21.879921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.740 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.880017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.880129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.880155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.880236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.880346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.880371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.880454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.880535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.880560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.880673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.880777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.880801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.880882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.880985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.881096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.881310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.881502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.881688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.881882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.881979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.882006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.882085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.882165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.882189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.882272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.882407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.882432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.882518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.882632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.882657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.882773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.882854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.882879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.882968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.883184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.883398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.883612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.883794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.883907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.883994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.884213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.884402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.884630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.884816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.884947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.885044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.885236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.885481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.885672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.885888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.885998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.886079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.886190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.886214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.886300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.886380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.886406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.886489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.886596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.886621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.741 qpair failed and we were unable to recover it. 00:28:10.741 [2024-11-29 17:10:21.886703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.741 [2024-11-29 17:10:21.886824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.886849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.886929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.887135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.887354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.887624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.887852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.887965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.888057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.888248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.888470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.888681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.888868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.888996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.889082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.889192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.889217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.889303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.889379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.889403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.889514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.889598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.889624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.889737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.889845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.889870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.889952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.890147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.890333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.890574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.890755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.890864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.890944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.891184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.891370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.891594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.891777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.891910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.892006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.892206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.892427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.892610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.892818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.892918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.893021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.893099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.893125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.893205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.893315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.893342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.893427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.893508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.893532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.742 qpair failed and we were unable to recover it. 00:28:10.742 [2024-11-29 17:10:21.893644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.893725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.742 [2024-11-29 17:10:21.893750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.893825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.893902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.893927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.894031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.894116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.894141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.894253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.894361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.894386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.894495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.894568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.894594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.894677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.894786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.894812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.894894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.895122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.895369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.895561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.895814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.895919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.896009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.896223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.896419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.896611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.896792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.896925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.897041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.897264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.897441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.897676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.897862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.897973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.898055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.898196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.898221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.898305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.898390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.898417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.898557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.898664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.898690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.898772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.898910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.898935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.899062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.899148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.899173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.899262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.899371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.899397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.899482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.899570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.899596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.899708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.899791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.899818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.899906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.899996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.900023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.900104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.900184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.900209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.900297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.900408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.900434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.743 qpair failed and we were unable to recover it. 00:28:10.743 [2024-11-29 17:10:21.900521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.900601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.743 [2024-11-29 17:10:21.900626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.900733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.900809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.900833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.900908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.901150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.901329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.901544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.901730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.901907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.901991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.902018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.902092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.902201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.902226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.902306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.902382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.902407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.902550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.902652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.902677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.902759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.902839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.902865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.902972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.903195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.903383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.903574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.903784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.903892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.903972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.904200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.904378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.904563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.904789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.904928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.905017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.905095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.905120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.905225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.905300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.905325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.905418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.905494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.905519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.905604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.905746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.905772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.905881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.905955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.906006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.906117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.906203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.906227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.906336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.906411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.906436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.906545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.906632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.906659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.906750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.906830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.906855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.906968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.907047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.907073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.907157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.907266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.744 [2024-11-29 17:10:21.907293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.744 qpair failed and we were unable to recover it. 00:28:10.744 [2024-11-29 17:10:21.907376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.907462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.907487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.907598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.907677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.907703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.907841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.907922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.907948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.908048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.908125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.908149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.908225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.908337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.908362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.908473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.908557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.908583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.908679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.908752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.908777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.908885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.909117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.909307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.909531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.909722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.909854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.909944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.910165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.910358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.910573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.910796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.910932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.911022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.911225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.911408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.911593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.911813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.911919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.912005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.912197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.912430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.912618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.912806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.912911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.913005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.913116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.913142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.913227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.913335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.913360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.913467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.913573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.913599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.913708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.913814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.913839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.913946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.914051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.914077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.914184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.914265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.914290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.745 qpair failed and we were unable to recover it. 00:28:10.745 [2024-11-29 17:10:21.914374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.745 [2024-11-29 17:10:21.914482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.914507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.914615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.914689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.914713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.914796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.914874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.914901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.915002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.915193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.915424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.915627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.915844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.915989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.916067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.916154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.916179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.916301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.916415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.916440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.916523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.916634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.916658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.916737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.916818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.916843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.916962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.917052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.917078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.917191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.917270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.917294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.917377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.917516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.917546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.917630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.917739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.917764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.917842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.917988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.918015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.918130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.918235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.918261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.918344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.918422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.918448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.918534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.918610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.918634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.918751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.918825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.918850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.918932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.919178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.919365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.919607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.919793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.919928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.920048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.920124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.920149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.920239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.920352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.920379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.920491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.920570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.920596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.920711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.920789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.920814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.920938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.921129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.921324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.921505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.746 [2024-11-29 17:10:21.921747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.746 [2024-11-29 17:10:21.921893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.746 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.921986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.922207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.922440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.922654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.922871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.922976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.923061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.923174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.923200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.923286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.923375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.923399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.923512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.923589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.923614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.923803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.923887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.923913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.924031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.924117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.924143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.924233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.924343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.924369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.924459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.924569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.924595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.924678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.924759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.924783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.924901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.924988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.925014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.925095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.925211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.925237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.925315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.925428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.925454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.925543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.925620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.925645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.925750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.925862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.925887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.925993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.926085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.926110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.926194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.926269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.926294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.926380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.926518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.926544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.926618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.926754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.926779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.926891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.926978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.927089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.927306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.927496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.927682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.747 [2024-11-29 17:10:21.927891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.927999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.747 [2024-11-29 17:10:21.928024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.747 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.928113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.928196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.928221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.928335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.928419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.928446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.928542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.928650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.928675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.928769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.928850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.928875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.928988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.929068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.929094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.929203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.929277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.929301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.929415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.929523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.929549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.929658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.929738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.929764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.929872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.929982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.930008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.930098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.930182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.930207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.930318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.930401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.930428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.930504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.930591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.930616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.930734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.930808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.930833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.930951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.931165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.931363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.931585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.931799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.931937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.932029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.932107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.932132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.932243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.932321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.932347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.932433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.932519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.932543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.932632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.932771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.932796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.932910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.932996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.933022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.933102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.933241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.933267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.748 [2024-11-29 17:10:21.933350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.933427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.748 [2024-11-29 17:10:21.933451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.748 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.933529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.933638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.933664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.933778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.933861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.933888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.933982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.934069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.934094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.934206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.934318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.934343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.934455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.934540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.934567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.934650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.934759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.934785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.934892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.935119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.935339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.935551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.935759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.935887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.935973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.936184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.936387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.936612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.936872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.936983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.937070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.937148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.937173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.937259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.937361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.937387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.937465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.937572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.937597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.937706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.937813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.937838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.937919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.938109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.938359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.938587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.938777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.938909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.939019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.939105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.939130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.749 qpair failed and we were unable to recover it. 00:28:10.749 [2024-11-29 17:10:21.939215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.749 [2024-11-29 17:10:21.939294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.939320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.939416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.939543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.939572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.939686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.939773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.939801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.939891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.939977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.940004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.940119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.940195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.940219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.940304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.940384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.940409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.940549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.940656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.940681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.940761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.940843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.940868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.940978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.941197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.941379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.941627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.941857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.941966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.942079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.942176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.942201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.942314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.942422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.942447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.942536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.942620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.942645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.942732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.942814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.942840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.942953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.943157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.943351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.943558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.943739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.943844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.943918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.944140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.944327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.944548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.750 qpair failed and we were unable to recover it. 00:28:10.750 [2024-11-29 17:10:21.944762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.750 [2024-11-29 17:10:21.944872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.944953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.945176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.945412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.945665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.945876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.945991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.946079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.946159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.946185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.946271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.946381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.946407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.946495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.946572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.946597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.946704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.946780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.946805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.946918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.947113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.947301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.947517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.947739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.947847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.947939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.948174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.948391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.948598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.948804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.948907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.948988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.949173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.949428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.949619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.949798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.949925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.950013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.950103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.950132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.950213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.950287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.950312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.950420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.950500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.950525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.950634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.950712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.950737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.751 qpair failed and we were unable to recover it. 00:28:10.751 [2024-11-29 17:10:21.950843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.751 [2024-11-29 17:10:21.950915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.950940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.951027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.951213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.951392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.951620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.951797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.951900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.951982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.952204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.952413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.952623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.952864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.952976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.953093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.953316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.953500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.953687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.953870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.953984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.954075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.954156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.954181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.954302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.954411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.954436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.954552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.954634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.954658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.954766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.954848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.954875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.954964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.955176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.955355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.955543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.955729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.752 [2024-11-29 17:10:21.955859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.752 qpair failed and we were unable to recover it. 00:28:10.752 [2024-11-29 17:10:21.955941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.956166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.956417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.956603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.956788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.956922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.957009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.957205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.957384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.957577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.957769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.957879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.957967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.958185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.958375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.958601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.958784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.958913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.959031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.959215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.959427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.959632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.959833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.959937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.960021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.960202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.960398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.960620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.960809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.960988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.961079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.961271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.961453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.961644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.961841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.961984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.962080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.962157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.962182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.962271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.962351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.962375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.962454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.962572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.962600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.753 qpair failed and we were unable to recover it. 00:28:10.753 [2024-11-29 17:10:21.962684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.753 [2024-11-29 17:10:21.962767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.962792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.962878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.962956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.962987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.963068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.963314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.963498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.963686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.963862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.963998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.964087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.964268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.964463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.964667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.964879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.964988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.965075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.965263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.965434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.965625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.965816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.965927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.966011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.966191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.966408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.966597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.966789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.966896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.967008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.967199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.967390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.967598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.967825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.967930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.968023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.968239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.968423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.968642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.968853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.968989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.969080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.969302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.969490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.969667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.969863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.969968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.970056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.970146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.970170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.970278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.970357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.754 [2024-11-29 17:10:21.970382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.754 qpair failed and we were unable to recover it. 00:28:10.754 [2024-11-29 17:10:21.970462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.970569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.970593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.970674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.970759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.970784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.970857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.970939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.970989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.971076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.971294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.971476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.971673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.971857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.971965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.972046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.972247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.972428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.972644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.972834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.972937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.973035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.973137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.973169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.973268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.973356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.973387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.973484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.973578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.973611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.973732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.973823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.973855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.973948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.974182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.974378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.974570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.974762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.974880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.974989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.975178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.975373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.975562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.975768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.975870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.975954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.976163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.976349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.976526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.976737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.976842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.976929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.977129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.977339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.977519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.977700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.977877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.977989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.978093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.978314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.978498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.978677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.978868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.978974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.755 qpair failed and we were unable to recover it. 00:28:10.755 [2024-11-29 17:10:21.979054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.979126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.755 [2024-11-29 17:10:21.979150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.979241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.979326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.979350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.979433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.979517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.979543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.979623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.979703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.979727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.979810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.979897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.979922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.980010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.980200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.980388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.980574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.980762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.980879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.981007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.981091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.981123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.981226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.981361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.981391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.981485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.981568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.981596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.981717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.981852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.981883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.982003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.982123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.982153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.982251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.982339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.982369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.982458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.982547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.982577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.982697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.982793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.982824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.982921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.983026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.983051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.983147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.983354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.983384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.983475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.983550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.983576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.983687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.983802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.983829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.983948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.984145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.984333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.984578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.984771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.984872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.984980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.985169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.985384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.985568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.985774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.985877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.985969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.986150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.986364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.986556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.986774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.986884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.986974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.987056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.987080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.987190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.987265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.987289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.987372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.987447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.756 [2024-11-29 17:10:21.987476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.756 qpair failed and we were unable to recover it. 00:28:10.756 [2024-11-29 17:10:21.987561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.987646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.987670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.987754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.987831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.987855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.987933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.988148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.988372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.988549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.988732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.988837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.988920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.989198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.989378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.989571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.989762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.989860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.989949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.990155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.990341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.990526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.990716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.990852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.990933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.991020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.991044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.991138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.991265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.991295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.991498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.991577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.991604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.991698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.991777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.991802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.991887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.991992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.992019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.992102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.992186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.992213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.992298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.992379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.992407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.992484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.992588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.992615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.992736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.992812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.992838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.992920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.993119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.993343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.993538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.993826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.993942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.994033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.994144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.994171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.994365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.994474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.994502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.994587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.994701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.994729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.994928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.995160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.995419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.995639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.995822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.995934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.996025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.996114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.996141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.996265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.996458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.996484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.996598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.996684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.996710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.996800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.996879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.996905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.757 qpair failed and we were unable to recover it. 00:28:10.757 [2024-11-29 17:10:21.997017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.757 [2024-11-29 17:10:21.997125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.997153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.997285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.997375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.997400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.997486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.997570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.997596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.997704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.997787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.997814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.997897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.998122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.998344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.998568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.998756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.998860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.998950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.999175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.999398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.999600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:21.999839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:21.999981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.000065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.000145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.000171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.000285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.000396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.000425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.000528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.000609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.000638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.000730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.000868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.000894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.000982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.001202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.001394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.001618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.001811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.001923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.002037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.002250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.002447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.002630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.002820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.002937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.003048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.003147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.003181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.003287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.003379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.003408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.003524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.003609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.003636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.003717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.003806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.003833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.003940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.004146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.004351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.004529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.004718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.004900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.004989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.005117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.005310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.005493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.005701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.005890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.005994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.758 qpair failed and we were unable to recover it. 00:28:10.758 [2024-11-29 17:10:22.006076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.758 [2024-11-29 17:10:22.006160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.006184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.006262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.006340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.006364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.006447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.006523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.006546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.006623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.006702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.006727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.006802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.006887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.006916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.007018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.007197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.007400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.007599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.007780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.007883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.007975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.008175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.008359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.008552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.008737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.008837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.008963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.009158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.009372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.009579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.009768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.009874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.009953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.010169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.010352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.010536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.010713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.010845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.010928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.011127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.011308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.011493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.011673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.011865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.011972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.012082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.012266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.012453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.012635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.012829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.012928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.013026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.013216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.013416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.013599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.013819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.013949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.014036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.014142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.014167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.759 [2024-11-29 17:10:22.014248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.014335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.759 [2024-11-29 17:10:22.014360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.759 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.014435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.014517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.014542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.014632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.014726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.014752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.014832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.014914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.014939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.015021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.015215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.015397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.015574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.015790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.015919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.016002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.016186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.016371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.016554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.016733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.016866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.016950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.017161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.017415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.017607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.017808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.017916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.017999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.018227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.018404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.018614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.018811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.018921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.019013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.019228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.019420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.019596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.019817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.019918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.020008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.020240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.020429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.020613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.020793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.020897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.020986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.021178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.021360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.021563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.021770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.021919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.022047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.022233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.022453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.022647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.022826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.022928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.023027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.023102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.023127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.023237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.023317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.760 [2024-11-29 17:10:22.023342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.760 qpair failed and we were unable to recover it. 00:28:10.760 [2024-11-29 17:10:22.023423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.023498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.023523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.023609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.023717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.023742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.023854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.023933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.023964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.024082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.024310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.024506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.024688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.024897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.024997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.025081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.025265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.025457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.025642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.025828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.025934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.026035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.026227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.026412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.026590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.026770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.026871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.026979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.027204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.027425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.027608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.027823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.027931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.028017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.028197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.028386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.028577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.028790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.028890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.028982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.029168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.029375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.029571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.029785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.029912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.029999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.030219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.030406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.030585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.030801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.030934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.031020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.031204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.031413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.031595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.031782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.031881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.031963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.032041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.032065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.032145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.032222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.761 [2024-11-29 17:10:22.032247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.761 qpair failed and we were unable to recover it. 00:28:10.761 [2024-11-29 17:10:22.032337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.032417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.032443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.032521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.032602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.032626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.032704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.032806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.032831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.032918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.033151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.033325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.033501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.033680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.033908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.033994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.034018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.034103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.034209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.034233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.034314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.034390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.034414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.034492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.034571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.034597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.034701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.034801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.034825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.034908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.035118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.035315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.035505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.035685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.035872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.035984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.036074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.036251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.036433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.036622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.036840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.036944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.037038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.037260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.037452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.037666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.037883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.037989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.038071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.038255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.038468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.038649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.038864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.038969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.039057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.039256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.039432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.039613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.039823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.039955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.040076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.040158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.040183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.040274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.040362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.040386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.040464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.040545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.040569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.762 qpair failed and we were unable to recover it. 00:28:10.762 [2024-11-29 17:10:22.040678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.040754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.762 [2024-11-29 17:10:22.040778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.040852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.040924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.040948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.041034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.041115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.041140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.041224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.041300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.041324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.041436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.041518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.041543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.041635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.041762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.041791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.041903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.041998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.042026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.042144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.042249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.042275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.042355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.042436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.042462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.042542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.042687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.042713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.042804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.042885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.042912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.043003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.043205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.043432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.043643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.043839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.043979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.044178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.044257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.044284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.044373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.044485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.044512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.044631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.044709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.044735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.044815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.044932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.044966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.045049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.045131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.045158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.045238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.045319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.045344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.045448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.045559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.045584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.045685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.045768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.045793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.045907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.045996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.046026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.046227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.046313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.046338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.046420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.046504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.046530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.046611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.046700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.046726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.046838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.046917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.046943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.047037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.047232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.047448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.047631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.047862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.047979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.048071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.048147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.048173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.048251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.048445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.048470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.048585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.048694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.048720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.048807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.048888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.048915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.048999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.049194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.049377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.049610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.049832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.049982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.050081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.050168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.050193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.050281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.050367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.050394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.050473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.050552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.050578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.050667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.050747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.763 [2024-11-29 17:10:22.050774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.763 qpair failed and we were unable to recover it. 00:28:10.763 [2024-11-29 17:10:22.050880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.050954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.050988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.051075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.051159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.051185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.051265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.051353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.051379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.051461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.051549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.051575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.051688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.051767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.051792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.051906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.051989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.052015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.052127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.052207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.052232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.052325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.052411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.052438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.052525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.052635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.052663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.052740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.052822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.052849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.052925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.053138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.053331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.053555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.053781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.053893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.053977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.054055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.054081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.054175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.054318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.054350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.054485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.054572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.054599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.054696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.054777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.054808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.054908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.054998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.055026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.055120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.055208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.055240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.055344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.055492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.055520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.055612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.055697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.055724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.055838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.055923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.055949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.056088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.056169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.056194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.056303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.056415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.056440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.056524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.056610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.056636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.056765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.056842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.056867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.056950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.057188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.057383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.057608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.057827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.057938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.058029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.058205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.058407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.058598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.058791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.058899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.059016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.059230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.059471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.059683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.059862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.059997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.060110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.060193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.060218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.764 qpair failed and we were unable to recover it. 00:28:10.764 [2024-11-29 17:10:22.060307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.060385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.764 [2024-11-29 17:10:22.060410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.060487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.060589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.060615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.060724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.060801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.060826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.060908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.060988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.061014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.061093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.061191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.061217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.061299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.061378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.061403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.061515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.061604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.061629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.061717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.061791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.061816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.061938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.062154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.062388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.062600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.062795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.062938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.063034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.063218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.063417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.063637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.063837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.063967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.064090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.064181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.064207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.064344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.064454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.064480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.064562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.064638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.064664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.064754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.064838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.064864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.064946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.065181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.065378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.065561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.065758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.065867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.065954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.066150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.066360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.066578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.765 [2024-11-29 17:10:22.066761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.765 [2024-11-29 17:10:22.066893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.765 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.066984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.067188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.067448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.067674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.067865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.067985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.068100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.068185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.068212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.068328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.068412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.068439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.068521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.068632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.068658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.068768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.068851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.068877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.068973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.069201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.069396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.069573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.069821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.069923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.070022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.070105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.070131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.070245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.070382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.070407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.070524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.070602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.070627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.070709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.070847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.070872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.070954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.071187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.071395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.071643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.071843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.071986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.072065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.072278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.072491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.072682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.072892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.072997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.073085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.073202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.073228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.073305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.073413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.073438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.073525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.073628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.073653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.073744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.073823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.073850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.766 [2024-11-29 17:10:22.073925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.074060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.766 [2024-11-29 17:10:22.074086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.766 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.074198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.074276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.074302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.074420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.074531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.074556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.074668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.074761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.074786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.074863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.074976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.075004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.075143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.075225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.075251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.075365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.075448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.075473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.075584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.075669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.075696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.075778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.075885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.075911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.076031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.076120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.076145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.076259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.076372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.076397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.076486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.076563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.076589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.076701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.076782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.076807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.076937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.077158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.077352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.077625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.077816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.077975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.078056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.078138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.078164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.078259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.078340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.078368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.078484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.078565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.078591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.078676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.078761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.078787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.078903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.079156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.079339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.079590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.079779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.079912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.079995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.080100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.080125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.080236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.080310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.080335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.080453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.080531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.080557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.080635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.080747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.080772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.080904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.080989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.081015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.081103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.081193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.081219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.081302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.081376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.081401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.767 qpair failed and we were unable to recover it. 00:28:10.767 [2024-11-29 17:10:22.081484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.081594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.767 [2024-11-29 17:10:22.081620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.081733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.081810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.081835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.081943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.082137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.082356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.082579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.082794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.082900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.083017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.083131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.083157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.083238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.083322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.083348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.083468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.083576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.083601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.083689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.083772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.083799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.083907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.083990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.084016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.084099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.084223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.084249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.084330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.084441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.084466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.084542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.084626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.084653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.084749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.084834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.084861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.084981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.085166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.085407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.085601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.085791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.085901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.086008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.086244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.086422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.086680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.086882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.086995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.087110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.087221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.087246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.087329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.087435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.087460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.087604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.087686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.087712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.768 [2024-11-29 17:10:22.087793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.087869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.768 [2024-11-29 17:10:22.087894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.768 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.087999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.088088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.088114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.088200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.088316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.088341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.088421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.088532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.088558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.088670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.088748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.088772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.088887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.088975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.089005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.089101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.089185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.089212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.089322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.089431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.089457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.089539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.089649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.089675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.089784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.089890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.089916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.090030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.090112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.090137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.090254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.090362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.090387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.090474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.090614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.090639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.090718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.090800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.090825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.090903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.090988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.091015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.091153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.091265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.091290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.091369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.091458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.091484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.091596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.091707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.091732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.091818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.091908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.091934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.092025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.092131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.092156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.092271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.092384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.092410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.092500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.092617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.092643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.092722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.092802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.092826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.092918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.093173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.093357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.093614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.093839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.093946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.094052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.094271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.094486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.094679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.094880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.094990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.095078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.095160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.769 [2024-11-29 17:10:22.095185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.769 qpair failed and we were unable to recover it. 00:28:10.769 [2024-11-29 17:10:22.095264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.095339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.095365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.095480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.095589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.095615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.095699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.095815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.095841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.095940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.096040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.096069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.096159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.096270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.096295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.096375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.096485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.096510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.096592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.096786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.096812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.096953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.097147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.097344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.097534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.097763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.097868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.097948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.098102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.098134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.098226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.098309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.098335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.098417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.098609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.098635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.098744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.098825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.098851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.098972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.099052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.099078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.099154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.099281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.099306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.099388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.099497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.099522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.099637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.099715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.099742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.099934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.100141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.100361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.100582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.100768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.100904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.100986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.101232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.101457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.101654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.101832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.101968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.102053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.102180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.102207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.102322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.102436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.102462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.102543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.102648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.770 [2024-11-29 17:10:22.102681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.770 qpair failed and we were unable to recover it. 00:28:10.770 [2024-11-29 17:10:22.102761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.102870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.102895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.103009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.103192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.103383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.103575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.103803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.103910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.103989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.104239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.104428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.104635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.104861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.104968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.105061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.105145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.105169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.105246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.105322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.105347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.105467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.105545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.105570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.105678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.105758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.105785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.105894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.105992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.106019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.106104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.106187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.106214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.106324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.106408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.106434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.106512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.106594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.106620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.106730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.106806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.106831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.106917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.107140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.107331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.107570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.107807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.107936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.108036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.108252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.108461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.108684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.108865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.108985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.109119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.109204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.109230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.109317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.109439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.109464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.109573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.109647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.109673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.771 qpair failed and we were unable to recover it. 00:28:10.771 [2024-11-29 17:10:22.109748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.771 [2024-11-29 17:10:22.109859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.109884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.109974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.110051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.110076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.110155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.110235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.110260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.110368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.110476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.110502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.110646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.110728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.110754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.110864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.110979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.111005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.111087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.111171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.111197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.111324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.111434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.111459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.111550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.111658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.111684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.111799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.111880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.111907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.112031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.112220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.112473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.112658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.112877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.112987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.113075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.113155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.113181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.113264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.113340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.113365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.113449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.113528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.113554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.113670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.113778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.113804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.113895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.113976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.114109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.114300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.114521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.114700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.114889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.114973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.115000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.115093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.115171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.115196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.115283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.115391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.115417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.115526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.115603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.115629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.115711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.115792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.115817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.772 qpair failed and we were unable to recover it. 00:28:10.772 [2024-11-29 17:10:22.115926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.116010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.772 [2024-11-29 17:10:22.116037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.116145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.116221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.116246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.116360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.116464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.116489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.116573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.116677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.116702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.116815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.116894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.116919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.117004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.117197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.117386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.117611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.117854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.117964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.118047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.118139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.118164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.118273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.118346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.118371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.118460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.118569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.118594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.118733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.118812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.118837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.118950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.119173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.119351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.119591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.119843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.119944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.120053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.120148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.120176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.120292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.120372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.120399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.120520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.120598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.120624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.120704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.120790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.120815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.120926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.121019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.121045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.121241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.121353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.121378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.121488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.121562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.121587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.121700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.121889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.121914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.122038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.122238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.122459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.122673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.122887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.122998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.773 [2024-11-29 17:10:22.123085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.123192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.773 [2024-11-29 17:10:22.123217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.773 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.123294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.123403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.123429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.123509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.123589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.123614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.123729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.123812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.123838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.123950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.124177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.124395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.124584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.124768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.124871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.124963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.125166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.125408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.125626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.125832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.125995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.126085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.126171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.126197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.126282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.126356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.126381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.126460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.126576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.126602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.126687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.126765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.126790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.126871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.126984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.127011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.127130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.127204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.127229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.127319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.127408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.127433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.127542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.127654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.127679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.127763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.127845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.127872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.127953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.128144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.128385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.128659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.128880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.128991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.129102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.129181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.129206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.129285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.129363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.129388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.129533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.129615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.129640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.129750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.129828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.129854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.129945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.130050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.130076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.130195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.130336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.130361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.774 qpair failed and we were unable to recover it. 00:28:10.774 [2024-11-29 17:10:22.130447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.774 [2024-11-29 17:10:22.130565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.130590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.130675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.130777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.130802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.130883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.131131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.131342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.131558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.131778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.131890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.131999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.132212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.132426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.132621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.132808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.132912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.133000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.133076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.133105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.133195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.133304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.133330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.133414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.133527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.133553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.133665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.133744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.133770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.133879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.133986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.134012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.134103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.134186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.134212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.134287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.134364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.134389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.134471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.134556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.134581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.134725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.134831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.134857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.134970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.135185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.135439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.135625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.135863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.135968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.136050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.136125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.136151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.136264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.136369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.136394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.136513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.136591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.136616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.136703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.136813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.136839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.136920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.137173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.137367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.137586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.137799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.137938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.775 qpair failed and we were unable to recover it. 00:28:10.775 [2024-11-29 17:10:22.138072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.775 [2024-11-29 17:10:22.138145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.138170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.138280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.138354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.138379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.138462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.138568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.138593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.138675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.138783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.138808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.138924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.139127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.139354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.139538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.139794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.139905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.139991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.140076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.140103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.140192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.140306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.140331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.140412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.140502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.140527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.140641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.140751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.140777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.140866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.140978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.141004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.141113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.141205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.141230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.141319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.141415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.141441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.141555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.141644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.141669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.141758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.141842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.141867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.141965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.142183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.142409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.142637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.142855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.142966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:10.776 [2024-11-29 17:10:22.143083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.143190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:10.776 [2024-11-29 17:10:22.143215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:10.776 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.143302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.143405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.143430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.143544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.143656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.143682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.143762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.143841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.143867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.143968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.144163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.144362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.144556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.144767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.144877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.144981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.145212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.145423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.145615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.145859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.145966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.146058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.146276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.146481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.146682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.146881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.146989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.147082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.147164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.147189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.147305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.147389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.147415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.147494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.147573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.147599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.147690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.147768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.147794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.059 qpair failed and we were unable to recover it. 00:28:11.059 [2024-11-29 17:10:22.147879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.059 [2024-11-29 17:10:22.147973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.148000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.148110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.148187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.148212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.148333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.148414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.148440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.148517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.148632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.148658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.148742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.148818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.148844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.148966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.149158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.149356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.149554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.149747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.149850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.149968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.150162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.150387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.150584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.150800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.150996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.151086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.151162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.151187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.151273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.151359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.151385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.151475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.151582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.151608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.151690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.151824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.151850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.151969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.152177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.152401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.152616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.152830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.152972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.153086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.153168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.153194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.153317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.153395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.153421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.153504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.153610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.153636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.153747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.153857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.153883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.154000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.154111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.060 [2024-11-29 17:10:22.154137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.060 qpair failed and we were unable to recover it. 00:28:11.060 [2024-11-29 17:10:22.154232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.154344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.154369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.154475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.154582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.154607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.154716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.154822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.154847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.154968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.155081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.155106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.155220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.155330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.155355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.155435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.155540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.155565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.155681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.155793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.155819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.155900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.155984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.156010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.156094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.156234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.156259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.156348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.156485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.156511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.156594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.156706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.156732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.156816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.156901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.156926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.157023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.157159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.157184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.157276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.157385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.157410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.157493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.157603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.157628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.157717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.157827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.157852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.157981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.158060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.158085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.158194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.158299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.158325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.158437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.158544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.158570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.158678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.158756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.158781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.158897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.159121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.159305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.159496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.159701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.159915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.159993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.160020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.160099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.160203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.160229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.160340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.160416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.160442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.061 [2024-11-29 17:10:22.160526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.160643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.061 [2024-11-29 17:10:22.160668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.061 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.160744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.160827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.160852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.160943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.161139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.161331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.161542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.161800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.161901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.162026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.162112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.162138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.162254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.162361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.162386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.162502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.162583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.162608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.162687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.162799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.162825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.162912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.162999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.163025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.163139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.163228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.163253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.163363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.163467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.163492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.163577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.163685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.163710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.163850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.163935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.163968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.164057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.164140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.164166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.164253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.164369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.164394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.164477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.164568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.164593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.164731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.164839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.164864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.164947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.165142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.165358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.165562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.165774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.165914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.166015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.166098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.166129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.166217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.166297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.166323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.166435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.166542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.166568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.166647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.166725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.166751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.062 qpair failed and we were unable to recover it. 00:28:11.062 [2024-11-29 17:10:22.166867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.062 [2024-11-29 17:10:22.167002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.167028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.167111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.167216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.167243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.167354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.167463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.167489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.167567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.167642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.167667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.167748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.167833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.167858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.167935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.168160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.168407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.168632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.168845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.168950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.169048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.169237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.169464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.169690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.169887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.169995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.170078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.170160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.170186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.170299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.170372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.170403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.170484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.170590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.170616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.170740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.170824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.170850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.170938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.171167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.171415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.171660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.171847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.171950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.063 [2024-11-29 17:10:22.172050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.172166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.063 [2024-11-29 17:10:22.172192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.063 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.172270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.172350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.172376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.172491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.172572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.172603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.172687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.172767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.172793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.172866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.172976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.173002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.173085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.173200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.173226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.173309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.173414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.173439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.173520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.173627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.173652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.173732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.173840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.173865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.173948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.174196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.174380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.174598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.174783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.174948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.175069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.175146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.175172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.175261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.175396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.175422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.175502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.175583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.175609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.175691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.175799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.175824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.175914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.175994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.176020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.176132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.176246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.176271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.176353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.176490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.176515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.176594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.176735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.176760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.176839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.176923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.176949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.177056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.177127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.177153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.177270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.177408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.177433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.177514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.177601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.177627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.177740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.177826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.177851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.177984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.178064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.178090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.178235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.178322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.178347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.064 qpair failed and we were unable to recover it. 00:28:11.064 [2024-11-29 17:10:22.178428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.064 [2024-11-29 17:10:22.178504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.178529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.178641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.178779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.178804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.178892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.178972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.178999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.179077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.179156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.179182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.179296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.179371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.179397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.179536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.179618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.179645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.179753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.179828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.179854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.179940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.180131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.180355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.180544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.180789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.180899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.181004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.181081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.181106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.181192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.181300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.181326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.181441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.181548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.181573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.181653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.181728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.181753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.181893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.181975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.182001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.182109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.182186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.182211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.182291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.182391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.182416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.182499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.182578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.182604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.182739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.182851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.182876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.182951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.183067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.183093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.183206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.183315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.183340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.183452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.183569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.183594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.183685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.183791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.183817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.183903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.183987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.184014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.184095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.184198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.184224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.184300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.184377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.184403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.184480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.184598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.184623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.065 qpair failed and we were unable to recover it. 00:28:11.065 [2024-11-29 17:10:22.184705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.065 [2024-11-29 17:10:22.184789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.184814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.184897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.184975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.185001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.185101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.185174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.185199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.185277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.185364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.185390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.185504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.185609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.185634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.185730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.185845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.185871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.185976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.186199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.186386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.186609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.186840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.186953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.187050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.187128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.187154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.187234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.187343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.187369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.187478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.187583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.187609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.187695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.187783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.187809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.187894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.188146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.188367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.188573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.188789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.188918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.189038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.189127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.189153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.189262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.189402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.189427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.189506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.189585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.189611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.189698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.189809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.189834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.189979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.190176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.190366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.190557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.190780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.066 [2024-11-29 17:10:22.190913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.066 qpair failed and we were unable to recover it. 00:28:11.066 [2024-11-29 17:10:22.190999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.191221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.191403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.191656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.191875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.191982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.192089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.192171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.192196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.192287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.192399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.192426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.192514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.192590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.192615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.192690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.192803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.192830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.192915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.193128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.193325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.193514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.193729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.193838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.193918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.194124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.194342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.194559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.194793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.194894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.194981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.195200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.195423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.195630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.195841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.195942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.196057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.196171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.196197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.196282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.196362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.196388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.196466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.196584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.196610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.196693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.196807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.196833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.067 [2024-11-29 17:10:22.196940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.197059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.067 [2024-11-29 17:10:22.197085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.067 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.197171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.197282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.197307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.197389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.197498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.197524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.197636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.197747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.197772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.197858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.197938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.197969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.198091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.198197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.198222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.198310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.198390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.198415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.198499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.198577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.198602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.198715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.198830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.198855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.198981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.199172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.199391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.199583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.199795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.199904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.199992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.200185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.200378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.200630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.200846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.200953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.201041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.201274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.201496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.201691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.201867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.201979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.202116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.202192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.202217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.202298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.202413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.068 [2024-11-29 17:10:22.202439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.068 qpair failed and we were unable to recover it. 00:28:11.068 [2024-11-29 17:10:22.202556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.202668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.202694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.202772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.202846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.202871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.202952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.203190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.203385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.203570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.203765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.203867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.203954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.204198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.204424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.204634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.204826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.204935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.205034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.205133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.205163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.205243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.205356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.205382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.205506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.205622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.205647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.205735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.205843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.205869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.205979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.206168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.206375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.206588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.206836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.206977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.207072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.207261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.207459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.207658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.207875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.207987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.208065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.208146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.208172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.208256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.208359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.208384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.069 [2024-11-29 17:10:22.208501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.208576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.069 [2024-11-29 17:10:22.208602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.069 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.208688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.208763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.208789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.208873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.208985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.209107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.209314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.209512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.209713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.209895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.209975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.210001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.210091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.210171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.210197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.210281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.210392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.210418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.210528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.210704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.210730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.210821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.210936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.210969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.211050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.211133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.211159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.211272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.211349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.211375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.211456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.211564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.211590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.211686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.211761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.211786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.211894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.211985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.212095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.212294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.212478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.212689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.212885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.212993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.213106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.213225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.213251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.213340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.213420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.213445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.213535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.213618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.213645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.213728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.213841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.213867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.213952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.214053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.214079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.214170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.214281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.214307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.214415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.214495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.214521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.070 [2024-11-29 17:10:22.214646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.214728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.070 [2024-11-29 17:10:22.214757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.070 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.214845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.214930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.214955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.215048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.215125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.215151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.215243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.215316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.215341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.215487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.215566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.215595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.215677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.215788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.215814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.215912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.215996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.216022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.216137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.216217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.216245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.216359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.216498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.216523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.216652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.216740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.216766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.216860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.216937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.216970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.217052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.217129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.217154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.217241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.217351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.217377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.217465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.217542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.217568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.217654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.217732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.217758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.217869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.217988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.218014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.218102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.218184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.218211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.218297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.218412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.218441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.218529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.218634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.218659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.218751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.218839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.218867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.218948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.219180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.219397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.219587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.219814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.219954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.220046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.220135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.220159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.220244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.220323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.220351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.220438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.220524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.220550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.220635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.220726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.220753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.071 qpair failed and we were unable to recover it. 00:28:11.071 [2024-11-29 17:10:22.220838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.071 [2024-11-29 17:10:22.220916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.220943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.221036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.221246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.221462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.221653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.221845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.221950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.222051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.222138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.222168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.222263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.222357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.222389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.222476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.222583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.222615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.222705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.222786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.222815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.222907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.222994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.223022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.223107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.223197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.223223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.223337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.223418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.223444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.223532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.223639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.223667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.223753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.223844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.223871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.223947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.224173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.224372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.224606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.224795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.224930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.225021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.225236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.225425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.225637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.225860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.225969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.226056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.226162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.072 [2024-11-29 17:10:22.226187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.072 qpair failed and we were unable to recover it. 00:28:11.072 [2024-11-29 17:10:22.226271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.226378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.226403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.226483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.226595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.226621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.226729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.226809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.226835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.226913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.227144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.227326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.227598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.227786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.227921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.228017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.228203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.228381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.228569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.228825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.228953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.229045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.229253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.229474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.229694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.229884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.229994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.230082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.230297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.230472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.230680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.230868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.230985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.231061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.231170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.231195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.231276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.231380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.231404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.231511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.231597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.231623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.231699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.231781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.231805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.231912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.232057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.232084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.073 [2024-11-29 17:10:22.232167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.232249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.073 [2024-11-29 17:10:22.232276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.073 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.232394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.232467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.232493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.232575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.232687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.232713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.232834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.232919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.232945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.233046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.233150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.233175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.233255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.233337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.233361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.233443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.233557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.233582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.233694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.233770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.233795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.233922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.234143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.234351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.234616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.234809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.234910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.235026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.235134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.235159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.235259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.235351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.235381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.235523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.235604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.235630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.235711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.235820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.235845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.235985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.236071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.236098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.236214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.236320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.236346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.236459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.236539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.236565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.236681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.236786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.236812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.236922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.237004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.237031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.237146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.237252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.237278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.237361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.237466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.237492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.237641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.237739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.237769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.237860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.237976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.238005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.238087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.238169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.238195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.238274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.238348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.238374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.238457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.238537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.238564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.074 qpair failed and we were unable to recover it. 00:28:11.074 [2024-11-29 17:10:22.238691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.238841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.074 [2024-11-29 17:10:22.238867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.238953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.239172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.239355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.239583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.239845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.239998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.240078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.240268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.240486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.240670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.240855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.240970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.241081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.241264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.241463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.241674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.241872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.241987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.242070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.242154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.242180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.242268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.242342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.242368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.242447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.242554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.242581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.242700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.242777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.242803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.242922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.243144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.243354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.243605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.243854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.243998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.244077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.244158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.244184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.244290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.244378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.244405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.244490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.244572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.244599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.075 qpair failed and we were unable to recover it. 00:28:11.075 [2024-11-29 17:10:22.244708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.244787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.075 [2024-11-29 17:10:22.244813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.244930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.245164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.245379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.245566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.245779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.245915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.246003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.246227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.246488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.246702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.246890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.246999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.247080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.247185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.247212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.247321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.247398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.247424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.247534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.247642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.247668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.247779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.247857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.247884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.247967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.248155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.248353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.248551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.248738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.248851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.248928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.249187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.249407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.249594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.249811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.249912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.250022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.250105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.250131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.250224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.250334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.250360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.250437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.250566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.250597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.250677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.250819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.250845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.076 qpair failed and we were unable to recover it. 00:28:11.076 [2024-11-29 17:10:22.250922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.076 [2024-11-29 17:10:22.251022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.251051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.251134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.251216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.251242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.251352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.251463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.251490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.251567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.251673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.251700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.251780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.251858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.251885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.251998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.252195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.252408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.252654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.252845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.252952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.253041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.253122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.253149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.253260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.253337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.253363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.253472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.253566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.253593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.253707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.253784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.253810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.253902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.253988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.254015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.254133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.254244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.254270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.254349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.254429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.254456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.254565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.254651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.254677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.254793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.254882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.254909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.255000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.255083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.255109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.255225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.255303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.255330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.255438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.255517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.255544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.255657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.255782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.255809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.255889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.255980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.256008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.077 qpair failed and we were unable to recover it. 00:28:11.077 [2024-11-29 17:10:22.256085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.077 [2024-11-29 17:10:22.256193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.256219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.256301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.256375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.256401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.256520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.256626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.256653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.256731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.256842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.256869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.256948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.257179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.257365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.257567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.257749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.257852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.257931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.258074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.258101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.258252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.258361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.258388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.258502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.258638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.258664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.258750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.258857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.258884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.258970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.259171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.259418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.259638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.259818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.259922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.260049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.260155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.260183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.260262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.260369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.260396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.260507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.260587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.260614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.260690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.260773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.260800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.260911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.260994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.261023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.261104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.261212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.261238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.261348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.261426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.261452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.261540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.261629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.261655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.261770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.261899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.261925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.262043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.262155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.262183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.262259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.262336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.262363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.078 qpair failed and we were unable to recover it. 00:28:11.078 [2024-11-29 17:10:22.262443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.078 [2024-11-29 17:10:22.262520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.262547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.262632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.262722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.262750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.262871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.262949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.262983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.263063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.263172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.263198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.263276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.263358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.263383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.263497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.263635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.263661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.263773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.263849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.263875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.263954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.264195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.264388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.264605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.264828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.264935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.265059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.265158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.265191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.265314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.265398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.265425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.265517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.265597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.265623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.265709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.265787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.265813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.265930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.266163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.266346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.266571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.266780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.266914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.267001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.267191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.267384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.267575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.267817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.267951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.079 [2024-11-29 17:10:22.268049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.268128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.079 [2024-11-29 17:10:22.268153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.079 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.268231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.268349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.268375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.268454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.268533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.268561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.268653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.268764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.268790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.268867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.268976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.269003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.269085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.269165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.269192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.269291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.269379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.269406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.269517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.269598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.269624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.269704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.269813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.269840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.269929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.270049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.270075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.270182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.270284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.270314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.270431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.270577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.270603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.270686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.270765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.270792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.270933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.271130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.271344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.271577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.271808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.271909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.272033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.272174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.272200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.272285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.272360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.272387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.272469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.272587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.272614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.272726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.272808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.272834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.272945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.273152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.273384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.273599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.273815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.273931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.274060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.274141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.274168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.274282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.274371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.274397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.080 qpair failed and we were unable to recover it. 00:28:11.080 [2024-11-29 17:10:22.274504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.080 [2024-11-29 17:10:22.274595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.274622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.274714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.274836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.274863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.275026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.275111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.275137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.275217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.275309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.275335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.275443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.275549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.275575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.275693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.275768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.275795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.275917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.276179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.276423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.276650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.276865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.276976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.277073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.277159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.277186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.277310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.277448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.277474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.277587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.277702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.277729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.277814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.277951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.277982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.278070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.278154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.278181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.278300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.278447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.278484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.278597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.278673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.278699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.278788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.278874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.278899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.279019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.279102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.279129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1dd8000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.279213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.279374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.279401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.279493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.279640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.279671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.279769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.279843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.279870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.280017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.280134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.280160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.280280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.280367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.280394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.280474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.280613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.280638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.280749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.280832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.280857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.081 [2024-11-29 17:10:22.280978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.281056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.081 [2024-11-29 17:10:22.281082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.081 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.281166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.281290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.281317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.281396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.281473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.281499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.281585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.281705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.281731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.281877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.281969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.282002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.282095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.282208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.282234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.282349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.282462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.282488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.282575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.282681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.282706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.282790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.282866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.282892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.283021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.283211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.283404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.283605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.283783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.283894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.284013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.284205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.284469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.284649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.284835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.284984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.285103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.285183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.082 [2024-11-29 17:10:22.285210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.082 qpair failed and we were unable to recover it. 00:28:11.082 [2024-11-29 17:10:22.285290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.285402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.285428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.285538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.285617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.285644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.285755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.285827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.285854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.285937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.286206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.286410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.286625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.286853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.286971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.287053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.287246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.287469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.287654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.287840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.287982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.288124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.288206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.288233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.288312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.288404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.288434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.288548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.288657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.288683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.288778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.288887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.288913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1ddc000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.289020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.289238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.289461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.289643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.289832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.289974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.290089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.290165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.290190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.290284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.290391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.290417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.290504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.290581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.290607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.290694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.290798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.290824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.290906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.291021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.291048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.083 [2024-11-29 17:10:22.291129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.291206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.083 [2024-11-29 17:10:22.291233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.083 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.291326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.291402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.291427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.291509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.291587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.291613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.291696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.291774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.291800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.291908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.292145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.292364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.292571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.292754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.292867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.292951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.293176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.293375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.293594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.293813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.293955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.294052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.294128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.294154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.294232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.294341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.294366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.294446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.294518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.294543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.294653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.294765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.294792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.294907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.295176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.295445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.295655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.295847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.295964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.296075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.296185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.296210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.296297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.296383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.296410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.296495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.296572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.296597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.296713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.296796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.296821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.296905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.297044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.297071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.297192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.297277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.084 [2024-11-29 17:10:22.297303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.084 qpair failed and we were unable to recover it. 00:28:11.084 [2024-11-29 17:10:22.297410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.297517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.297543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.297624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.297699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.297725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.297807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.297882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.297907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.298020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.298126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.298152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.298237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.298321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.298347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.298459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.298569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.298596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.298690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.298764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.298790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.298902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.298985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.299012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.299097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.299201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.299227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.299385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.299461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.299486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.299569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.299678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.299704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.299812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.299893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.299919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.300016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.300227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.300508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.300695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.300885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.300999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.301085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.301194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.301221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.301317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.301426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.301451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.301541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.301657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.301683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.301761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.301868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.301893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.301985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.302261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.302443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.302669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.302858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.302964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.303083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.303158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.303184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.085 [2024-11-29 17:10:22.303332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.303420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.085 [2024-11-29 17:10:22.303445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.085 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.303529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.303636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.303662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.303768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.303859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.303888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.303996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.304225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.304427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.304627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.304805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.304938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.305032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.305137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.305162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.305269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.305374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.305399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.305508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.305597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.305622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.305711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.305817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.305842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.305972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.306190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.306432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.306612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.306832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.306942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.307045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.307127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.307153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.307265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.307345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.307370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.307484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.307590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.307615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.307697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.307806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.307831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.307947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.308161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.308383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.308562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.308777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.308886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.086 qpair failed and we were unable to recover it. 00:28:11.086 [2024-11-29 17:10:22.308994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.309069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.086 [2024-11-29 17:10:22.309094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.309179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.309250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.309276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.309359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.309442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.309467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.309546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.309624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.309649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.309737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.309811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.309836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.309944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.310190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.310432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.310641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.310821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.310920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.311043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.311258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.311449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.311627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.311845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.311950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.312047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.312229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.312414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.312669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.312879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.312991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.313103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.313183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.313209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.313296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.313372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.313397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.313519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.313625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.313650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.313726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.313800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.313825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.313909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.313986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.314010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.314093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.314175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.314200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.314286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.314370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.314395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.314478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.314558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.087 [2024-11-29 17:10:22.314582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.087 qpair failed and we were unable to recover it. 00:28:11.087 [2024-11-29 17:10:22.314664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.314773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.314799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.314879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.314994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.315020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.315103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.315176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.315201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.315324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.315434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.315460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.315535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.315637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.315662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.315735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.315814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.315839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.315942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.316136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.316328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.316519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.316696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.316878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.316992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.317112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.317313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.317500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.317687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.317865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.317972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.318059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.318238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.318420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.318628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.318838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.318939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.319066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.319255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.319474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.319660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.319866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.319973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.320056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.320140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.320165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.088 [2024-11-29 17:10:22.320244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.320329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.088 [2024-11-29 17:10:22.320354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.088 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.320431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.320570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.320600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.320718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.320817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.320842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.320988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.321191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.321380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.321594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.321811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.321920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.322035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.322127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.322153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.322232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.322312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.322337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.322455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.322570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.322596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.322683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.322761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.322792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.322904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.322982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.323007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.323114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.323203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.323229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.323304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.323436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.323462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.323573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.323655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.323679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.323758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.323840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.323866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.323952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.324153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.324376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.324559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.324769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.324869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.324948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.325137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.325317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.325540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.325788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.325887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.325977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.326059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.326084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.326160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.326272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.326298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.089 [2024-11-29 17:10:22.326403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.326478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.089 [2024-11-29 17:10:22.326503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.089 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.326586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.326656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.326681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.326753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.326824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.326849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.326938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.327169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.327397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.327637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.327812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.327915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.328000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.328247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.328471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.328640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.328826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.328951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.329042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.329220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.329403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.329707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.329888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.329990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.330079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.330147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.330173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.330280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.330378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.330403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.330494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.330604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.330630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.330710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.330783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.330807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.330920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.331120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.331384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.331626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.331834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.331939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.332031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.332147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.332173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.332285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.332369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.090 [2024-11-29 17:10:22.332395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.090 qpair failed and we were unable to recover it. 00:28:11.090 [2024-11-29 17:10:22.332469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.332548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.332573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.332657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.332731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.332756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.332835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.332941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.332972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.333059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.333275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.333462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.333677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.333869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.333978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.334090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.334167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.334192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.334268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.334378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.334404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.334496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.334576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.334600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.334678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.334752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.334777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.334860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.334985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.335011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.335090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.335202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.335226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.335301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.335409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.335435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.335523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.335666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.335692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.335805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.335886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.335912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.336011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.336094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.336121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.336229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.336338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.336363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.336476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.336585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.336610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.336696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.336812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.336837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.336923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.337032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.337057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.337166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.337276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.337301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.091 qpair failed and we were unable to recover it. 00:28:11.091 [2024-11-29 17:10:22.337412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.091 [2024-11-29 17:10:22.337519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.337544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.337638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.337751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.337777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.337869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.337981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.338009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.338096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.338178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.338202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.338315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.338424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.338448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.338530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.338665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.338691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.338766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.338841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.338866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.338972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.339150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.339346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.339560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.339737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.339862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.339951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.340074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.340100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.340211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.340344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.340370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.340448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.340548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.340573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.340690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.340767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.340792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.340878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.340992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.341019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.341104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.341211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.341237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.341353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.341431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.341457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.341543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.341620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.341646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.341721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.341825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.341851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.341925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.342134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.342355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.342567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.342754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.342888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.342976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.343061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.343086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.343179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.343290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.343316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.343404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.343489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.092 [2024-11-29 17:10:22.343514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.092 qpair failed and we were unable to recover it. 00:28:11.092 [2024-11-29 17:10:22.343623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.343698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.343722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.343806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.343879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.343905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.343990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.344167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.344395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.344585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.344760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.344862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.344941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.345199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.345383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.345624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.345842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.345945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.346028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.346235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.346458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.346676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.346868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.346975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.347064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.347149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.347174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.347285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.347373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.347399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.347504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.347609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.347635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.347717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.347792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.347817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.347904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.347988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.348015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.348124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.348238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.348264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.348338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.348446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.348473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.348567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.348648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.348674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.348756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.348831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.348856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.348969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.349049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.349074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.349149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.349224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.349248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.093 [2024-11-29 17:10:22.349322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.349409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.093 [2024-11-29 17:10:22.349434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.093 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.349541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.349614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.349639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.349721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.349824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.349850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.349961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.350152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.350368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.350572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.350785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.350914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.350996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.351215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.351426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.351638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.351834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.351975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.352084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.352160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.352185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.352266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.352345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.352371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.352458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.352538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.352564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.352640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.352759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.352794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.352868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.352976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.353085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.353274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.353516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.353705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.353893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.353984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.354011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.354094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.354171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.354196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.354318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.354425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.354450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.354534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.354611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.354637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.354722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.354831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.354861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.354941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.355054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.355079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.355160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.355236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.355262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.094 [2024-11-29 17:10:22.355374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.355449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.094 [2024-11-29 17:10:22.355475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.094 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.355555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.355635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.355661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.355750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.355855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.355881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.355966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.356182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.356383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.356569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.356793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.356900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.356986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.357213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.357394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.357603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.357793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.357932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.358016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.358259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.358467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.358645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.358820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.358923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.359042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.359257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.359473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.359681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.359861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.359994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.360075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.360186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.360212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.360290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.360370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.360395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.360474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.360609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.360635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.360710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.360818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.360843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.360918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.361038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.361063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.361156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.361235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.361261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.095 qpair failed and we were unable to recover it. 00:28:11.095 [2024-11-29 17:10:22.361340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.095 [2024-11-29 17:10:22.361460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.361486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.361602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.361709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.361735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.361862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.361978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.362085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.362322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.362506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.362693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.362903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.362981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.363087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.363311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.363494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.363702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.363887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.363978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.364004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.364081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.364155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.364180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.364265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.364374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.364399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.364485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.364593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.364619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.364697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.364804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.364830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.364911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.365156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.365348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.365535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.365724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.365909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.365988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.366016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.366098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.366172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.366197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.366307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.366442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.366467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.096 qpair failed and we were unable to recover it. 00:28:11.096 [2024-11-29 17:10:22.366548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.366619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.096 [2024-11-29 17:10:22.366644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.366789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.366879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.366904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.366993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.367202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.367379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.367590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.367775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.367876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.367955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.368172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.368349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.368526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.368733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.368841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.368925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.369128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.369320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.369523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.369707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.369911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.369995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.370021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.370112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.370214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.370241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.370329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.370406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.370432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.370543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.370621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.370646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.370739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.370873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.370898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.370979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.371158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.371352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.371561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.371761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.371864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.371976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.372062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.372087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.372167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.372273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.372299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.097 qpair failed and we were unable to recover it. 00:28:11.097 [2024-11-29 17:10:22.372404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.372512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.097 [2024-11-29 17:10:22.372537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.372613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.372714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.372739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.372816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.372928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.372963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.373086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.373167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.373193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.373285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.373376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.373402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.373508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.373585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.373610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.373709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.373813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.373839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.373922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.374144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.374367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.374557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.374736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.374842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.374919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.375150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.375355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.375643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.375822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.375927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.376046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.376237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.376432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.376652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.376856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.376964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.377046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.377126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.377150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.377226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.377307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.377331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.377415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.377497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.377522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.377639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.377720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.377745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.377861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.377945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.378004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.378118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.378202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.378227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.378318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.378393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.378419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.098 qpair failed and we were unable to recover it. 00:28:11.098 [2024-11-29 17:10:22.378502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.098 [2024-11-29 17:10:22.378606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.378630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.378717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.378829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.378853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.378934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.379194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.379382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.379575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.379790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.379890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.379974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.380199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.380396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.380633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.380877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.380994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.381076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.381253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.381460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.381646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.381832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.381934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.382065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.382276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.382457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.382652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.382862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.382963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.383047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.383237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.383423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.383630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.383836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.383945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.384034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.384115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.384141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.384255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.384340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.099 [2024-11-29 17:10:22.384366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.099 qpair failed and we were unable to recover it. 00:28:11.099 [2024-11-29 17:10:22.384475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.384556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.384582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.384659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.384739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.384764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.384845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.384929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.384954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.385077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.385152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.385177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.385253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.385366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.385391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.385479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.385561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.385587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.385663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.385739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.385764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.385907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.385988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.386013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.386109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.386183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.386209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.386299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.386413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.386439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.386523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.386663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.386689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.386777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.386851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.386876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.386965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.387212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.387431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.387619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.387816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.387950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.388042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.388151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.388176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.388267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.388402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.388427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.388572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.388649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.388679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.388771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.388858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.388883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.388973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.389174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.389352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.389540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.100 [2024-11-29 17:10:22.389750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.100 [2024-11-29 17:10:22.389855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.100 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.389994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.390176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.390366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.390550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.390768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.390871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.390965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.391099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.391124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.391202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.391278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.391303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.391423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.391502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.391528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.391647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.391751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.391777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.391892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.392137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.392347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.392529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.392716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.392850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.392932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.393046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.393072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.393184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.393288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.393313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.393390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.393477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.393503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.393614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.393690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.393715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.393822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.393977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.394004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.394094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.394169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.394193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.394269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.394343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.394368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.394477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.394583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.394608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.394690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.394827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.394853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.394936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.395135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.395348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.395567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.395792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.395888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.101 [2024-11-29 17:10:22.396009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.396086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.101 [2024-11-29 17:10:22.396112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.101 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.396195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.396269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.396294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.396403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.396512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.396537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.396653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.396738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.396764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.396850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.396922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.396946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.397041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.397121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.397146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.397225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.397367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.397392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.397484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.397560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.397585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.397670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.397752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.397777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.397893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.397979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.398005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.398087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.398199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.398225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.398332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.398414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.398438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.398514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.398621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.398646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.398722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.398824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.398850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.398933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.399153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.399398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.399605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.399794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.399930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.400032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.400218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.400402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.400593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.400782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.400889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.400970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.401166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.401384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.401640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.401850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.401996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.102 [2024-11-29 17:10:22.402074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.402153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.102 [2024-11-29 17:10:22.402180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.102 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.402272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.402386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.402412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.402547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.402658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.402683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.402763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.402849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.402874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.403016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.403225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.403452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.403643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.403862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.403975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.404052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.404169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.404194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.404284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.404409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.404434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.404524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.404601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.404636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.404710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.404798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.404824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.404935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.405206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.405421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.405648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.405833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.405983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.406068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.406145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.406170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.406245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.406361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.406385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.406497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.406573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.406599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.406679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.406781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.406806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.406918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.407116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.407327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.407546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.407781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.407933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.408056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.408144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.408170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.408250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.408351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.408389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.103 [2024-11-29 17:10:22.408471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.408554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.103 [2024-11-29 17:10:22.408579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.103 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.408660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.408765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.408790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.408890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.408977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.409004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.409088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.409196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.409220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.409307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.409382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.409406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.409497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.409606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.409630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.409707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.409783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.409809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.409920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.410142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.410373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.410596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.410817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.410934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.411060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.411255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.411473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.411653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.411837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.411933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.412036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.412254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.412447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.412630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.412882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.412994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.413071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.413156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.413181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.413297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.413387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.413413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.413493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.413597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.413623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.413733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.413807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.413832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.413925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.414046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.414073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.414180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.414272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.414298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.414383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.414488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.414513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.104 [2024-11-29 17:10:22.414596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.414710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.104 [2024-11-29 17:10:22.414735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.104 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.414821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.414897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.414921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.415011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.415204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.415405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.415625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.415830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.415973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.416091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.416201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.416227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.416316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.416389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.416416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.416492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.416605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.416631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.416739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.416816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.416840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.416920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.417155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.417381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.417602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.417826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.417998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.418115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.418233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.418258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.418375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.418480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.418506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.418588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.418664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.418690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.418777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.418920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.418946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.419044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.419158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.419184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.419323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.419401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.419426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.419512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.419588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.419624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.419736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.419875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.419900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.419995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.420102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.420127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.420202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.420287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.420311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.105 qpair failed and we were unable to recover it. 00:28:11.105 [2024-11-29 17:10:22.420428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.105 [2024-11-29 17:10:22.420509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.420535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.420628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.420701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.420726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.420805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.420924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.420951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.421045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.421130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.421155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.421242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.421358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.421384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.421478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.421584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.421609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.421733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.421852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.421878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.421989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.422182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.422432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.422626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.422805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.422945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.423040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.423152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.423178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.423297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.423383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.423408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.423511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.423592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.423618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.423708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.423781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.423811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.423918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.424032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.424058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.106 qpair failed and we were unable to recover it. 00:28:11.106 [2024-11-29 17:10:22.424136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.106 [2024-11-29 17:10:22.424237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.424264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.424350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.424455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.424480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.424573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.424663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.424690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.424776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.424850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.424876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.424972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.425058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.425084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.425194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.425284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.425310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.425433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.425540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.425565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.425645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.425749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.425774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.425888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.425979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.426006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.426118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.426241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.426266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.426355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.426459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.426484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.426572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.426647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.426673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.426748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.426862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.426887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.426994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.427181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.427397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.427594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.427781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.427914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.428036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.428266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.428461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.428638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.428826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.428971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.107 qpair failed and we were unable to recover it. 00:28:11.107 [2024-11-29 17:10:22.429061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.429142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.107 [2024-11-29 17:10:22.429167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.429254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.429376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.429406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.429518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.429621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.429647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.429721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.429829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.429854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.429940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.430057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.430082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.430191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.430271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.430296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.430424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.430559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.430583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.430698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.430771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.430796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.430887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.430975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.431001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.431082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.431193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.431219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.431306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.431390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.431416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.431522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.431598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.431623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.431737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.431821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.431846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.431952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.432138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.432370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.432592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.432783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.432920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.433012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.433084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.433109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.433190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.433304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.433328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.433446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.433554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.433580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.433668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.433741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.433767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.433883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.433978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.434004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.434095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.434180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.434205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.434300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.434384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.434408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.108 qpair failed and we were unable to recover it. 00:28:11.108 [2024-11-29 17:10:22.434501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.434611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.108 [2024-11-29 17:10:22.434637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.434724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.434800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.434830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.434937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.435199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.435391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.435613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.435867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.435977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.436066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.436177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.436203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.436292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.436368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.436392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.436484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.436565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.436590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.436674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.436786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.436812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.436922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.437154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.437331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.437523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.437741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.437851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.437936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.438191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.438403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.438593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.438789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.438899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.439020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.439130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.439155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.439245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.439333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.439359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.439457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.439540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.439565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.439647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.439733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.109 [2024-11-29 17:10:22.439759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.109 qpair failed and we were unable to recover it. 00:28:11.109 [2024-11-29 17:10:22.439864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.439934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.439977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.440056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.440167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.440193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.440292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.440374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.440400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.440480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.440624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.440651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.440804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.440885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.440911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.441000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.441109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.441134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.441248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.441328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.441353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.441443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.441519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.441544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.441623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.441700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.441727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.441852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.441944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.442006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.442117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.442220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.442247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.442333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.442435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.442460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.442575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.442666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.442691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.442790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.442906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.442931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.443037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.443145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.443171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.443260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.443394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.443419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.443496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.443601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.443627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.443734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.443843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.443868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.443954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.444068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.444093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.444181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.444290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.444315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.444426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.444521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.444547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.444659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.444766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.110 [2024-11-29 17:10:22.444793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.110 qpair failed and we were unable to recover it. 00:28:11.110 [2024-11-29 17:10:22.444868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.444942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.444975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.445061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.445139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.445164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.445243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.445353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.445379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.445458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.445566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.445591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.445674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.445757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.445782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.445891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.445985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.446011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.446126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.446205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.446230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.446313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.446389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.446414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.446501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.446609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.446634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.446710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.446823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.446848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.446925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.447212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.447392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.447608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.447802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.447909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.447988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.448070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.448101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.448213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.448327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.448353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.448464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.448545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.448569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.448712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.448786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.448821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.111 [2024-11-29 17:10:22.448898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.449002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.111 [2024-11-29 17:10:22.449028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.111 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.449117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.449218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.449254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.449333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.449417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.449442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.449534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.449607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.449632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.449713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.449817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.449842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.449924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.450139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.450401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.450617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.450793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.450886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.450977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.451114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.451139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.451229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.451339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.451365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.451471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.451613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.451639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.451722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.451841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.451867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.451952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.452206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.452404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.452635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.452831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.452933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.453029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.453251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.453441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.453637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.453852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.453976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.112 qpair failed and we were unable to recover it. 00:28:11.112 [2024-11-29 17:10:22.454059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.112 [2024-11-29 17:10:22.454169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.454195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.454305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.454384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.454409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.454494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.454579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.454605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.454702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.454810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.454836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.454949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.455070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.455099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.455212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.455299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.455332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.455423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.455532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.455559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.455638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.455734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.455760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.455900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.455988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.456015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.456094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.456210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.456235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.456327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.456434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.456460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.456535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.456629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.456654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.456749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.456833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.456859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.456940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.457184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.457374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.457601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.457784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.457912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.458021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.458242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.458433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.458634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.458817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.458967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.459079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.459161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.113 [2024-11-29 17:10:22.459187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.113 qpair failed and we were unable to recover it. 00:28:11.113 [2024-11-29 17:10:22.459282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.459355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.459380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.459486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.459558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.459584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.459665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.459737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.459762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.459844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.459988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.460014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.460098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.460178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.460203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.460281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.460356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.460382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.460469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.460584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.460611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.460766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.460880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.460905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.460986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.461180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.461385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.461578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.461755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.461865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.461950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.462238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.462490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.462691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.462879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.462984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.463073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.463164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.463190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.463282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.463361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.463386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.463473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.463544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.463569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.463651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.463746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.463781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.463885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.463982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.464009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.114 [2024-11-29 17:10:22.464089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.464200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.114 [2024-11-29 17:10:22.464226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.114 qpair failed and we were unable to recover it. 00:28:11.115 [2024-11-29 17:10:22.464317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.115 [2024-11-29 17:10:22.464399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.115 [2024-11-29 17:10:22.464424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.115 qpair failed and we were unable to recover it. 00:28:11.115 [2024-11-29 17:10:22.464529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.115 [2024-11-29 17:10:22.464636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.115 [2024-11-29 17:10:22.464661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.115 qpair failed and we were unable to recover it. 00:28:11.115 [2024-11-29 17:10:22.464746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.115 [2024-11-29 17:10:22.464826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.115 [2024-11-29 17:10:22.464850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.115 qpair failed and we were unable to recover it. 00:28:11.115 [2024-11-29 17:10:22.464935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.381 qpair failed and we were unable to recover it. 00:28:11.381 [2024-11-29 17:10:22.465171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.381 qpair failed and we were unable to recover it. 00:28:11.381 [2024-11-29 17:10:22.465376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.381 qpair failed and we were unable to recover it. 00:28:11.381 [2024-11-29 17:10:22.465580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.381 qpair failed and we were unable to recover it. 00:28:11.381 [2024-11-29 17:10:22.465801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.465911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.381 qpair failed and we were unable to recover it. 00:28:11.381 [2024-11-29 17:10:22.466002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.466087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.466114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.381 qpair failed and we were unable to recover it. 00:28:11.381 [2024-11-29 17:10:22.466198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.381 [2024-11-29 17:10:22.466289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.466314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.466400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.466523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.466548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.466645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.466737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.466771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.466885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.466996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.467032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.467136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.467234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.467279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.382 17:10:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.467387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 17:10:22 -- common/autotest_common.sh@862 -- # return 0 00:28:11.382 [2024-11-29 17:10:22.467508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.467542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 17:10:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:11.382 [2024-11-29 17:10:22.467676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.467786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.467820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 17:10:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:11.382 [2024-11-29 17:10:22.467946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 17:10:22 -- common/autotest_common.sh@10 -- # set +x 00:28:11.382 [2024-11-29 17:10:22.468091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.468122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.468222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.468322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.468349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.468427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.468507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.468539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.468621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.468724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.468750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.468842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.468954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.468989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.469072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.469158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.469186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.469268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.469371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.469397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.469516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.469605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.469632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.469722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.469807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.469834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.469914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.469995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.470028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.470110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.470220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.470246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.470326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.470409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.470435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.470517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.470602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.470629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.382 qpair failed and we were unable to recover it. 00:28:11.382 [2024-11-29 17:10:22.470740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.382 [2024-11-29 17:10:22.470818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.470844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.470953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.471043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.471069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.471150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.471229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.471255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.471340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.471502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.471528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.471624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.471716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.471742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f1de4000b90 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.471835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.471945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.472002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.472089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.472227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.472257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.472344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.472474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.472500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.472626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.472707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.472732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.472850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.472930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.472955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.473084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.473171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.473197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.473279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.473356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.473382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.473474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.473584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.473609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.473726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.473803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.473829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.473914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.474664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.474695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.474790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.474897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.474923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.475025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.475222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.475476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.475693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.475890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.475999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.476080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.476154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.476179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.383 [2024-11-29 17:10:22.476268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.476344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.383 [2024-11-29 17:10:22.476369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.383 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.476452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.476560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.476586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.476671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.476742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.476768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.476857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.476967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.476993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.477074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.477260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.477478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.477652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.477831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.477932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.478020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.478198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.478404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.478604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.478849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.478950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.479045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.479236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.479430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.479638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.479858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.479980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.480082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.480159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.480185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.480292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.480429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.480454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.480541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.480644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.480670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.384 qpair failed and we were unable to recover it. 00:28:11.384 [2024-11-29 17:10:22.480755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.480905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.384 [2024-11-29 17:10:22.480930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.481048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.481263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.481482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.481692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.481882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.481995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.482073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.482196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.482222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.482308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.482415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.482440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.482544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.482623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.482648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.482760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.482865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.482892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.482976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.483158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.483390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.483606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.483818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.483932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.484036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.484216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.484391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.484596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.484813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.484922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.485015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.485087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.485112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.485225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.485309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.485333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.385 [2024-11-29 17:10:22.485409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 17:10:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:11.385 [2024-11-29 17:10:22.485518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.385 [2024-11-29 17:10:22.485545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.385 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.485630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 17:10:22 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:11.386 [2024-11-29 17:10:22.485702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.485728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 17:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:11.386 [2024-11-29 17:10:22.485814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 17:10:22 -- common/autotest_common.sh@10 -- # set +x 00:28:11.386 [2024-11-29 17:10:22.485894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.485921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.486612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.486734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.486761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.486891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.486977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.487083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.487266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.487478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.487659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.487879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.487989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.488016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.488095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.488207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.488232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.488348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.488424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.488449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.488524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.488600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.488626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.488763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.488874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.488900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.488990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.489188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.489451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.489638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.489852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.489966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.490048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.490133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.490158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.490258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.490339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.490363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.490510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.490588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.490613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.490688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.490804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.490830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.386 qpair failed and we were unable to recover it. 00:28:11.386 [2024-11-29 17:10:22.490953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.386 [2024-11-29 17:10:22.491101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.491127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.491210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.491316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.491341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.491425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.491514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.491541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.491635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.491710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.491735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.491812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.491892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.491918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.492009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.492187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.492408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.492593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.492822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.492954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.493055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.493132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.493157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.493250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.493367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.493393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.493482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.493565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.493591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.493732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.493850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.493876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.493975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.494057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.494083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.494167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.494282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.494308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.494406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.494508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.387 [2024-11-29 17:10:22.494545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.387 qpair failed and we were unable to recover it. 00:28:11.387 [2024-11-29 17:10:22.494660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.494768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.494794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.494874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.494961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.494992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.495076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.495148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.495174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.495278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.495366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.495403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.495509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.495585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.495610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.495720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.495797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.495830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.495946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.496140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.496338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.496602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.496787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.496949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.497033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.497243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.497437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.497642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.497830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.497972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.498055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.498140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.498166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.498263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.498359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.498385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.498497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.498594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.498619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.498707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.498790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.498816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.498926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.499018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.499045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.499125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.499209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.388 [2024-11-29 17:10:22.499234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.388 qpair failed and we were unable to recover it. 00:28:11.388 [2024-11-29 17:10:22.499327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.499404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.499429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.499522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.499645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.499671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.499765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.499850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.499876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.500009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.500093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.500120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.500209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.500285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.500318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.500440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.500588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.500613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.500704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.500851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.500876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.500952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.501153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.501378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.501568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.501796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.501896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.501990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.502213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.502409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.502613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.502790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.502901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.502999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.503207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.503440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.503657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.503879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.503994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.389 qpair failed and we were unable to recover it. 00:28:11.389 [2024-11-29 17:10:22.504074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.389 [2024-11-29 17:10:22.504147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.504173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.504256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.504375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.504401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.504480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.504568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.504594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.504672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.504749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.504775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.504891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.505153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.505354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.505536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.505717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.505824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.505926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.506186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.506407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.506602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.506812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.506944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.507071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.507153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.507179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.507329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.507438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.507464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.507556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.507654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.507691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.507804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.507886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.507911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.508001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.508085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.508110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.508259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.508388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.508414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.508504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.508613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.508638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.508722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.508800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.508826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.390 qpair failed and we were unable to recover it. 00:28:11.390 [2024-11-29 17:10:22.508905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.508986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.390 [2024-11-29 17:10:22.509012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.509096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.509181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.509206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.509296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.509414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.509442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.509550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.509636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.509661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.509748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.509837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.509862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.509982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.510217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.510423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.510621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.510858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.510982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.511075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 Malloc0 00:28:11.391 [2024-11-29 17:10:22.511148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.511173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.511258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.511372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.511398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.511476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 17:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:11.391 [2024-11-29 17:10:22.511562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.511587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 17:10:22 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:28:11.391 [2024-11-29 17:10:22.511690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 17:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:11.391 [2024-11-29 17:10:22.511828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.511853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 17:10:22 -- common/autotest_common.sh@10 -- # set +x 00:28:11.391 [2024-11-29 17:10:22.511930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.512142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.512340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.512573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.512772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.512873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.512980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.513059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.513085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.513175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.513260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.513286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.391 qpair failed and we were unable to recover it. 00:28:11.391 [2024-11-29 17:10:22.513372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.391 [2024-11-29 17:10:22.513477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.513503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.513589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.513701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.513726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.513808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.513884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.513909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.514033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.514245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.514433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.514657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.514794] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:11.392 [2024-11-29 17:10:22.514877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.514983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.515067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.515249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.515442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.515632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.515825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.515938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.516054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.516162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.516187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.516323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.516401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.516426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.516507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.516582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.516612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.516692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.516799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.516836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.516920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.517133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.517324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.517505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.392 qpair failed and we were unable to recover it. 00:28:11.392 [2024-11-29 17:10:22.517737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.392 [2024-11-29 17:10:22.517864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.517942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.518112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.518139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.518221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.518342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.518368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.518478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.518555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.518581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.518670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.518788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.518814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.518926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.519184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.519367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.519581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.519784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.519919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.520024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.520246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.520440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.520634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.520856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.520980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.521064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.521152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.521178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.521290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.521381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.521407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.393 [2024-11-29 17:10:22.521485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.521571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.393 [2024-11-29 17:10:22.521596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.393 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.521672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.521782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.521808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.521919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.522157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.522401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.522613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.522833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.522934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 17:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:11.394 [2024-11-29 17:10:22.523068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.523150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 17:10:22 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:11.394 [2024-11-29 17:10:22.523177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.523260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 17:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:11.394 [2024-11-29 17:10:22.523370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.523396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 17:10:22 -- common/autotest_common.sh@10 -- # set +x 00:28:11.394 [2024-11-29 17:10:22.523510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.523593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.523619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.523730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.523813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.523838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.523946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.524206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.524437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.524657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.524846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.524988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.525115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.525193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.525218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.525335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.525442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.525473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.525586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.525658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.525683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.525764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.525873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.525898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.525997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.526085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.526111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.394 qpair failed and we were unable to recover it. 00:28:11.394 [2024-11-29 17:10:22.526221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.394 [2024-11-29 17:10:22.526345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.526370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.526459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.526564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.526590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.526676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.526759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.526784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.526875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.526966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.526992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.527078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.527161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.527187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.527279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.527358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.527384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.527523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.527603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.527629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.527742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.527857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.527883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.527992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.528210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.528423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.528637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.528824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.528929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.529053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.529142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.529168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.529317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.529390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.529415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.529523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.529627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.529653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.529741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.529853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.529879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.530004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.530193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.530425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.530625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.530810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.395 [2024-11-29 17:10:22.530915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.395 qpair failed and we were unable to recover it. 00:28:11.395 [2024-11-29 17:10:22.531001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 17:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:11.396 [2024-11-29 17:10:22.531080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.531106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 17:10:22 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:11.396 [2024-11-29 17:10:22.531195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.531299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.531325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 17:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.531408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 17:10:22 -- common/autotest_common.sh@10 -- # set +x 00:28:11.396 [2024-11-29 17:10:22.531491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.531517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.531598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.531703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.531729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.531807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.531887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.531917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.532044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.532232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.532439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.532630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.532849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.532970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.533077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.533155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.533181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.533267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.533379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.533405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.533513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.533590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.533615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.533696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.533842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.533868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.533986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.534221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.534413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.534599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.534822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.534925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.535023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.535137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.535162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.535240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.535336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.396 [2024-11-29 17:10:22.535362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.396 qpair failed and we were unable to recover it. 00:28:11.396 [2024-11-29 17:10:22.535439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.535516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.535542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.535626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.535746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.535772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.535856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.535937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.535969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.536058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.536136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.536162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.536274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.536377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.536402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.536478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.536610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.536635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.536723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.536798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.536823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.536902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.537128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.537332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.537529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.537718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.537861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.537945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.538035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.538061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.538169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.538320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.538346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.538431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.538512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.538538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.538656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.538740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.538765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.538887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.538981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.539007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 17:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:11.397 [2024-11-29 17:10:22.539101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.539191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.539217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 17:10:22 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:11.397 [2024-11-29 17:10:22.539306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 17:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:11.397 [2024-11-29 17:10:22.539384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.539410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 17:10:22 -- common/autotest_common.sh@10 -- # set +x 00:28:11.397 [2024-11-29 17:10:22.539525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.539637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.539662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.539774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.539858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.397 [2024-11-29 17:10:22.539884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.397 qpair failed and we were unable to recover it. 00:28:11.397 [2024-11-29 17:10:22.539984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.540174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.540435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.540628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.540820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.540924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.541071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.541160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.541186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.541297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.541404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.541431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.541510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.541620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.541646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.541729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.541808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.541833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.541948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.542140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.542371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.542553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.542738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:11.398 [2024-11-29 17:10:22.542870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2457cb0 with addr=10.0.0.2, port=4420 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.543362] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:11.398 [2024-11-29 17:10:22.545490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.398 [2024-11-29 17:10:22.545618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.398 [2024-11-29 17:10:22.545646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.398 [2024-11-29 17:10:22.545662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.398 [2024-11-29 17:10:22.545677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.398 [2024-11-29 17:10:22.545712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 17:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:11.398 17:10:22 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:11.398 17:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:11.398 17:10:22 -- common/autotest_common.sh@10 -- # set +x 00:28:11.398 17:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:11.398 [2024-11-29 17:10:22.555337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.398 17:10:22 -- host/target_disconnect.sh@58 -- # wait 328476 00:28:11.398 [2024-11-29 17:10:22.555430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.398 [2024-11-29 17:10:22.555458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.398 [2024-11-29 17:10:22.555473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.398 [2024-11-29 17:10:22.555487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.398 [2024-11-29 17:10:22.555517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.398 qpair failed and we were unable to recover it. 00:28:11.398 [2024-11-29 17:10:22.565384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.398 [2024-11-29 17:10:22.565483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.398 [2024-11-29 17:10:22.565509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.398 [2024-11-29 17:10:22.565525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.398 [2024-11-29 17:10:22.565539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.399 [2024-11-29 17:10:22.565568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.399 qpair failed and we were unable to recover it. 00:28:11.399 [2024-11-29 17:10:22.575382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.399 [2024-11-29 17:10:22.575486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.399 [2024-11-29 17:10:22.575518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.399 [2024-11-29 17:10:22.575534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.399 [2024-11-29 17:10:22.575548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.399 [2024-11-29 17:10:22.575577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.399 qpair failed and we were unable to recover it. 00:28:11.399 [2024-11-29 17:10:22.585405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.399 [2024-11-29 17:10:22.585499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.399 [2024-11-29 17:10:22.585526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.399 [2024-11-29 17:10:22.585542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.399 [2024-11-29 17:10:22.585555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.399 [2024-11-29 17:10:22.585585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.399 qpair failed and we were unable to recover it. 00:28:11.399 [2024-11-29 17:10:22.595376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.399 [2024-11-29 17:10:22.595467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.399 [2024-11-29 17:10:22.595492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.399 [2024-11-29 17:10:22.595508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.399 [2024-11-29 17:10:22.595522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.399 [2024-11-29 17:10:22.595550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.399 qpair failed and we were unable to recover it. 00:28:11.399 [2024-11-29 17:10:22.605396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.399 [2024-11-29 17:10:22.605491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.399 [2024-11-29 17:10:22.605517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.399 [2024-11-29 17:10:22.605532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.399 [2024-11-29 17:10:22.605546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.399 [2024-11-29 17:10:22.605576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.399 qpair failed and we were unable to recover it. 00:28:11.399 [2024-11-29 17:10:22.615399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.399 [2024-11-29 17:10:22.615499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.399 [2024-11-29 17:10:22.615525] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.399 [2024-11-29 17:10:22.615541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.399 [2024-11-29 17:10:22.615555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.399 [2024-11-29 17:10:22.615591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.399 qpair failed and we were unable to recover it. 00:28:11.399 [2024-11-29 17:10:22.625501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.399 [2024-11-29 17:10:22.625595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.399 [2024-11-29 17:10:22.625621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.399 [2024-11-29 17:10:22.625637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.399 [2024-11-29 17:10:22.625651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.399 [2024-11-29 17:10:22.625680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.399 qpair failed and we were unable to recover it. 00:28:11.399 [2024-11-29 17:10:22.635463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.399 [2024-11-29 17:10:22.635555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.399 [2024-11-29 17:10:22.635581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.399 [2024-11-29 17:10:22.635596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.399 [2024-11-29 17:10:22.635610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.399 [2024-11-29 17:10:22.635639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.399 qpair failed and we were unable to recover it. 00:28:11.399 [2024-11-29 17:10:22.645540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.399 [2024-11-29 17:10:22.645648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.399 [2024-11-29 17:10:22.645674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.399 [2024-11-29 17:10:22.645688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.399 [2024-11-29 17:10:22.645702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.399 [2024-11-29 17:10:22.645731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.399 qpair failed and we were unable to recover it. 00:28:11.399 [2024-11-29 17:10:22.655550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.399 [2024-11-29 17:10:22.655652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.399 [2024-11-29 17:10:22.655682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.399 [2024-11-29 17:10:22.655698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.655712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.655741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.665544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.665634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.665666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.665682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.665696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.665725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.675569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.675661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.675687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.675702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.675717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.675746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.685634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.685726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.685752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.685767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.685781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.685811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.695805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.695923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.695950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.695974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.695988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.696019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.705720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.705810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.705836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.705851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.705865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.705903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.715750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.715845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.715871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.715886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.715901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.715930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.725791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.725888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.725914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.725929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.725943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.725981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.735776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.735871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.735897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.735912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.735925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.735954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.745798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.745893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.745922] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.745938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.745969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.746001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.400 [2024-11-29 17:10:22.755838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.400 [2024-11-29 17:10:22.755931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.400 [2024-11-29 17:10:22.755973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.400 [2024-11-29 17:10:22.755991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.400 [2024-11-29 17:10:22.756005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.400 [2024-11-29 17:10:22.756034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.400 qpair failed and we were unable to recover it. 00:28:11.401 [2024-11-29 17:10:22.765901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.401 [2024-11-29 17:10:22.765997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.401 [2024-11-29 17:10:22.766022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.401 [2024-11-29 17:10:22.766036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.401 [2024-11-29 17:10:22.766049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.401 [2024-11-29 17:10:22.766078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.401 qpair failed and we were unable to recover it. 00:28:11.401 [2024-11-29 17:10:22.775880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.401 [2024-11-29 17:10:22.775985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.401 [2024-11-29 17:10:22.776012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.401 [2024-11-29 17:10:22.776027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.401 [2024-11-29 17:10:22.776041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.401 [2024-11-29 17:10:22.776070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.401 qpair failed and we were unable to recover it. 00:28:11.401 [2024-11-29 17:10:22.785924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.401 [2024-11-29 17:10:22.786033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.401 [2024-11-29 17:10:22.786058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.401 [2024-11-29 17:10:22.786073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.401 [2024-11-29 17:10:22.786088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.401 [2024-11-29 17:10:22.786117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.401 qpair failed and we were unable to recover it. 00:28:11.401 [2024-11-29 17:10:22.795954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.401 [2024-11-29 17:10:22.796058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.401 [2024-11-29 17:10:22.796084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.401 [2024-11-29 17:10:22.796100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.401 [2024-11-29 17:10:22.796119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.401 [2024-11-29 17:10:22.796149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.401 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.805987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.806090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.806116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.806131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.806146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.806175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.661 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.816029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.816137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.816162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.816177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.816191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.816220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.661 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.826051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.826161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.826191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.826206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.826220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.826249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.661 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.836086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.836176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.836202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.836217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.836231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.836260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.661 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.846097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.846198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.846225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.846240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.846254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.846283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.661 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.856186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.856281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.856306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.856322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.856336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.856364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.661 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.866197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.866293] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.866319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.866334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.866348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.866377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.661 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.876187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.876287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.876314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.876329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.876343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.876372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.661 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.886297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.886390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.886415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.886430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.886449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.886479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.661 qpair failed and we were unable to recover it. 00:28:11.661 [2024-11-29 17:10:22.896230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.661 [2024-11-29 17:10:22.896337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.661 [2024-11-29 17:10:22.896367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.661 [2024-11-29 17:10:22.896386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.661 [2024-11-29 17:10:22.896401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.661 [2024-11-29 17:10:22.896431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.906270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.906353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.906380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.906395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.906409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.906438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.916273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.916365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.916390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.916406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.916420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.916449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.926293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.926394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.926419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.926434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.926448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.926477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.936362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.936465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.936491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.936507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.936521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.936549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.946363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.946456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.946482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.946497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.946511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.946540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.956439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.956542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.956568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.956583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.956597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.956626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.966451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.966540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.966566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.966581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.966595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.966624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.976445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.976538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.976564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.976579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.976598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.976628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.986520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.986618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.986643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.986658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.986672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.986701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:22.996528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:22.996624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.662 [2024-11-29 17:10:22.996650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.662 [2024-11-29 17:10:22.996665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.662 [2024-11-29 17:10:22.996679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.662 [2024-11-29 17:10:22.996708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.662 qpair failed and we were unable to recover it. 00:28:11.662 [2024-11-29 17:10:23.006576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.662 [2024-11-29 17:10:23.006668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.663 [2024-11-29 17:10:23.006694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.663 [2024-11-29 17:10:23.006710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.663 [2024-11-29 17:10:23.006723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.663 [2024-11-29 17:10:23.006752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.663 qpair failed and we were unable to recover it. 00:28:11.663 [2024-11-29 17:10:23.016617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.663 [2024-11-29 17:10:23.016727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.663 [2024-11-29 17:10:23.016754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.663 [2024-11-29 17:10:23.016770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.663 [2024-11-29 17:10:23.016785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.663 [2024-11-29 17:10:23.016814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.663 qpair failed and we were unable to recover it. 00:28:11.663 [2024-11-29 17:10:23.026624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.663 [2024-11-29 17:10:23.026728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.663 [2024-11-29 17:10:23.026758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.663 [2024-11-29 17:10:23.026776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.663 [2024-11-29 17:10:23.026790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.663 [2024-11-29 17:10:23.026821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.663 qpair failed and we were unable to recover it. 00:28:11.663 [2024-11-29 17:10:23.036635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.663 [2024-11-29 17:10:23.036727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.663 [2024-11-29 17:10:23.036753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.663 [2024-11-29 17:10:23.036768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.663 [2024-11-29 17:10:23.036782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.663 [2024-11-29 17:10:23.036812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.663 qpair failed and we were unable to recover it. 00:28:11.663 [2024-11-29 17:10:23.046690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.663 [2024-11-29 17:10:23.046784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.663 [2024-11-29 17:10:23.046810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.663 [2024-11-29 17:10:23.046826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.663 [2024-11-29 17:10:23.046840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.663 [2024-11-29 17:10:23.046870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.663 qpair failed and we were unable to recover it. 00:28:11.663 [2024-11-29 17:10:23.056725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.663 [2024-11-29 17:10:23.056855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.663 [2024-11-29 17:10:23.056882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.663 [2024-11-29 17:10:23.056898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.663 [2024-11-29 17:10:23.056911] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.663 [2024-11-29 17:10:23.056941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.663 qpair failed and we were unable to recover it. 00:28:11.663 [2024-11-29 17:10:23.066783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.663 [2024-11-29 17:10:23.066901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.663 [2024-11-29 17:10:23.066929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.663 [2024-11-29 17:10:23.066945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.663 [2024-11-29 17:10:23.066973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.663 [2024-11-29 17:10:23.067004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.663 qpair failed and we were unable to recover it. 00:28:11.663 [2024-11-29 17:10:23.076752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.663 [2024-11-29 17:10:23.076833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.663 [2024-11-29 17:10:23.076859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.663 [2024-11-29 17:10:23.076874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.663 [2024-11-29 17:10:23.076887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.663 [2024-11-29 17:10:23.076916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.663 qpair failed and we were unable to recover it. 00:28:11.663 [2024-11-29 17:10:23.086806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.663 [2024-11-29 17:10:23.086889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.663 [2024-11-29 17:10:23.086916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.663 [2024-11-29 17:10:23.086935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.663 [2024-11-29 17:10:23.086948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.663 [2024-11-29 17:10:23.086986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.663 qpair failed and we were unable to recover it. 00:28:11.923 [2024-11-29 17:10:23.096858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.923 [2024-11-29 17:10:23.096948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.923 [2024-11-29 17:10:23.096979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.923 [2024-11-29 17:10:23.096995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.923 [2024-11-29 17:10:23.097008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.923 [2024-11-29 17:10:23.097037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.923 qpair failed and we were unable to recover it. 00:28:11.923 [2024-11-29 17:10:23.106847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.923 [2024-11-29 17:10:23.106940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.923 [2024-11-29 17:10:23.106977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.923 [2024-11-29 17:10:23.106993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.923 [2024-11-29 17:10:23.107006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.923 [2024-11-29 17:10:23.107037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.923 qpair failed and we were unable to recover it. 00:28:11.923 [2024-11-29 17:10:23.116875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.923 [2024-11-29 17:10:23.116983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.923 [2024-11-29 17:10:23.117010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.923 [2024-11-29 17:10:23.117025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.923 [2024-11-29 17:10:23.117037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.923 [2024-11-29 17:10:23.117067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.923 qpair failed and we were unable to recover it. 00:28:11.923 [2024-11-29 17:10:23.126935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.923 [2024-11-29 17:10:23.127046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.923 [2024-11-29 17:10:23.127071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.923 [2024-11-29 17:10:23.127086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.923 [2024-11-29 17:10:23.127099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.923 [2024-11-29 17:10:23.127129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.923 qpair failed and we were unable to recover it. 00:28:11.923 [2024-11-29 17:10:23.136965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.923 [2024-11-29 17:10:23.137055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.923 [2024-11-29 17:10:23.137080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.923 [2024-11-29 17:10:23.137095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.923 [2024-11-29 17:10:23.137108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.923 [2024-11-29 17:10:23.137137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.923 qpair failed and we were unable to recover it. 00:28:11.923 [2024-11-29 17:10:23.146984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.923 [2024-11-29 17:10:23.147077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.923 [2024-11-29 17:10:23.147102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.923 [2024-11-29 17:10:23.147117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.923 [2024-11-29 17:10:23.147129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.923 [2024-11-29 17:10:23.147159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.923 qpair failed and we were unable to recover it. 00:28:11.923 [2024-11-29 17:10:23.157005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.923 [2024-11-29 17:10:23.157091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.923 [2024-11-29 17:10:23.157116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.923 [2024-11-29 17:10:23.157137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.923 [2024-11-29 17:10:23.157150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.923 [2024-11-29 17:10:23.157179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.923 qpair failed and we were unable to recover it. 00:28:11.923 [2024-11-29 17:10:23.167032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.923 [2024-11-29 17:10:23.167119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.923 [2024-11-29 17:10:23.167144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.923 [2024-11-29 17:10:23.167159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.923 [2024-11-29 17:10:23.167171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.923 [2024-11-29 17:10:23.167200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.177085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.177174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.177199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.177215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.177227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.177256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.187117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.187206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.187231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.187246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.187258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.187287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.197136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.197222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.197247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.197262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.197275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.197303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.207158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.207243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.207268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.207284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.207296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.207325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.217177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.217269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.217293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.217308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.217321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.217349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.227283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.227369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.227394] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.227409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.227422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.227450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.237213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.237346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.237373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.237389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.237402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.237430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.247232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.247325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.247350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.247371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.247385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.247414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.257274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.257396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.257435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.257452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.257466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.257496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.267315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.267402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.267427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.267442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.924 [2024-11-29 17:10:23.267455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.924 [2024-11-29 17:10:23.267484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.924 qpair failed and we were unable to recover it. 00:28:11.924 [2024-11-29 17:10:23.277319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.924 [2024-11-29 17:10:23.277407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.924 [2024-11-29 17:10:23.277433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.924 [2024-11-29 17:10:23.277448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.925 [2024-11-29 17:10:23.277461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.925 [2024-11-29 17:10:23.277491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.925 qpair failed and we were unable to recover it. 00:28:11.925 [2024-11-29 17:10:23.287383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.925 [2024-11-29 17:10:23.287467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.925 [2024-11-29 17:10:23.287491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.925 [2024-11-29 17:10:23.287506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.925 [2024-11-29 17:10:23.287520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.925 [2024-11-29 17:10:23.287549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.925 qpair failed and we were unable to recover it. 00:28:11.925 [2024-11-29 17:10:23.297395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.925 [2024-11-29 17:10:23.297486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.925 [2024-11-29 17:10:23.297511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.925 [2024-11-29 17:10:23.297526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.925 [2024-11-29 17:10:23.297537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.925 [2024-11-29 17:10:23.297566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.925 qpair failed and we were unable to recover it. 00:28:11.925 [2024-11-29 17:10:23.307460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.925 [2024-11-29 17:10:23.307574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.925 [2024-11-29 17:10:23.307598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.925 [2024-11-29 17:10:23.307615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.925 [2024-11-29 17:10:23.307629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.925 [2024-11-29 17:10:23.307658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.925 qpair failed and we were unable to recover it. 00:28:11.925 [2024-11-29 17:10:23.317469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.925 [2024-11-29 17:10:23.317556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.925 [2024-11-29 17:10:23.317580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.925 [2024-11-29 17:10:23.317596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.925 [2024-11-29 17:10:23.317609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.925 [2024-11-29 17:10:23.317637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.925 qpair failed and we were unable to recover it. 00:28:11.925 [2024-11-29 17:10:23.327537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.925 [2024-11-29 17:10:23.327642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.925 [2024-11-29 17:10:23.327667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.925 [2024-11-29 17:10:23.327682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.925 [2024-11-29 17:10:23.327695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.925 [2024-11-29 17:10:23.327723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.925 qpair failed and we were unable to recover it. 00:28:11.925 [2024-11-29 17:10:23.337547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.925 [2024-11-29 17:10:23.337663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.925 [2024-11-29 17:10:23.337688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.925 [2024-11-29 17:10:23.337708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.925 [2024-11-29 17:10:23.337723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.925 [2024-11-29 17:10:23.337752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.925 qpair failed and we were unable to recover it. 00:28:11.925 [2024-11-29 17:10:23.347544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:11.925 [2024-11-29 17:10:23.347630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:11.925 [2024-11-29 17:10:23.347655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:11.925 [2024-11-29 17:10:23.347671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:11.925 [2024-11-29 17:10:23.347684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:11.925 [2024-11-29 17:10:23.347712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:11.925 qpair failed and we were unable to recover it. 00:28:12.184 [2024-11-29 17:10:23.357610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.184 [2024-11-29 17:10:23.357723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.184 [2024-11-29 17:10:23.357748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.184 [2024-11-29 17:10:23.357764] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.184 [2024-11-29 17:10:23.357777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.184 [2024-11-29 17:10:23.357806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.184 qpair failed and we were unable to recover it. 00:28:12.184 [2024-11-29 17:10:23.367591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.184 [2024-11-29 17:10:23.367676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.184 [2024-11-29 17:10:23.367700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.184 [2024-11-29 17:10:23.367715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.184 [2024-11-29 17:10:23.367728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.184 [2024-11-29 17:10:23.367756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.184 qpair failed and we were unable to recover it. 00:28:12.184 [2024-11-29 17:10:23.377679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.184 [2024-11-29 17:10:23.377811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.377837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.377853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.377866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.377895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.387750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.387830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.387855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.387870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.387883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.387911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.397782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.397868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.397893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.397908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.397921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.397950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.407707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.407797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.407822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.407836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.407849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.407878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.417755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.417846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.417872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.417886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.417898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.417927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.427804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.427901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.427926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.427947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.427967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.427997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.437802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.437888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.437912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.437928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.437940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.437977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.447923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.448014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.448039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.448054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.448067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.448096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.457902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.458004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.458030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.458045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.458062] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.458092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.467987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.468087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.468111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.468126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.468139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.468169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.185 [2024-11-29 17:10:23.477974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.185 [2024-11-29 17:10:23.478058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.185 [2024-11-29 17:10:23.478083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.185 [2024-11-29 17:10:23.478099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.185 [2024-11-29 17:10:23.478113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.185 [2024-11-29 17:10:23.478142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.185 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.487965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.488050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.488079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.488094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.488107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.488137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.186 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.498007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.498095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.498120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.498135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.498148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.498177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.186 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.508039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.508132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.508156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.508171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.508184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.508215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.186 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.518063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.518152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.518183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.518211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.518224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.518252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.186 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.528076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.528163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.528191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.528206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.528229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.528258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.186 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.538123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.538238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.538264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.538279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.538292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.538321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.186 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.548152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.548238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.548264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.548280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.548293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.548321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.186 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.558172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.558259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.558283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.558299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.558312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.558342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.186 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.568208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.568293] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.568319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.568335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.568348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.568376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.186 qpair failed and we were unable to recover it. 00:28:12.186 [2024-11-29 17:10:23.578282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.186 [2024-11-29 17:10:23.578373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.186 [2024-11-29 17:10:23.578399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.186 [2024-11-29 17:10:23.578414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.186 [2024-11-29 17:10:23.578427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.186 [2024-11-29 17:10:23.578456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.187 qpair failed and we were unable to recover it. 00:28:12.187 [2024-11-29 17:10:23.588268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.187 [2024-11-29 17:10:23.588350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.187 [2024-11-29 17:10:23.588376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.187 [2024-11-29 17:10:23.588392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.187 [2024-11-29 17:10:23.588405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.187 [2024-11-29 17:10:23.588433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.187 qpair failed and we were unable to recover it. 00:28:12.187 [2024-11-29 17:10:23.598298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.187 [2024-11-29 17:10:23.598389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.187 [2024-11-29 17:10:23.598418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.187 [2024-11-29 17:10:23.598434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.187 [2024-11-29 17:10:23.598447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.187 [2024-11-29 17:10:23.598478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.187 qpair failed and we were unable to recover it. 00:28:12.187 [2024-11-29 17:10:23.608314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.187 [2024-11-29 17:10:23.608406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.187 [2024-11-29 17:10:23.608438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.187 [2024-11-29 17:10:23.608454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.187 [2024-11-29 17:10:23.608468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.187 [2024-11-29 17:10:23.608497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.187 qpair failed and we were unable to recover it. 00:28:12.446 [2024-11-29 17:10:23.618390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.446 [2024-11-29 17:10:23.618482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.446 [2024-11-29 17:10:23.618508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.446 [2024-11-29 17:10:23.618524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.446 [2024-11-29 17:10:23.618538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.446 [2024-11-29 17:10:23.618567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.446 qpair failed and we were unable to recover it. 00:28:12.446 [2024-11-29 17:10:23.628432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.446 [2024-11-29 17:10:23.628520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.446 [2024-11-29 17:10:23.628546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.446 [2024-11-29 17:10:23.628561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.446 [2024-11-29 17:10:23.628583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.446 [2024-11-29 17:10:23.628612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.446 qpair failed and we were unable to recover it. 00:28:12.446 [2024-11-29 17:10:23.638415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.446 [2024-11-29 17:10:23.638500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.446 [2024-11-29 17:10:23.638526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.446 [2024-11-29 17:10:23.638541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.446 [2024-11-29 17:10:23.638554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.446 [2024-11-29 17:10:23.638583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.446 qpair failed and we were unable to recover it. 00:28:12.446 [2024-11-29 17:10:23.648466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.446 [2024-11-29 17:10:23.648552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.446 [2024-11-29 17:10:23.648579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.446 [2024-11-29 17:10:23.648595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.446 [2024-11-29 17:10:23.648608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.446 [2024-11-29 17:10:23.648644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.446 qpair failed and we were unable to recover it. 00:28:12.446 [2024-11-29 17:10:23.658501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.446 [2024-11-29 17:10:23.658593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.446 [2024-11-29 17:10:23.658620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.446 [2024-11-29 17:10:23.658635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.658649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.658680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.668526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.668621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.668647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.668662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.668677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.668707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.678538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.678622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.678648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.678663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.678677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.678706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.688559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.688672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.688701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.688719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.688733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.688764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.698625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.698717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.698747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.698763] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.698777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.698806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.708621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.708714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.708744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.708760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.708774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.708803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.718635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.718723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.718748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.718763] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.718775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.718805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.728662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.728754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.728778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.728793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.728806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.728835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.738699] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.738787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.738811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.738826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.738839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.738874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.748722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.748844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.748868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.748884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.748897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.748926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.758763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.758850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.758877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.447 [2024-11-29 17:10:23.758893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.447 [2024-11-29 17:10:23.758906] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.447 [2024-11-29 17:10:23.758937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.447 qpair failed and we were unable to recover it. 00:28:12.447 [2024-11-29 17:10:23.768789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.447 [2024-11-29 17:10:23.768876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.447 [2024-11-29 17:10:23.768903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.768919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.768933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.768969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.778866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.778999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.779028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.779046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.779060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.779102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.788859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.788978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.789019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.789035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.789048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.789077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.798872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.798963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.798996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.799011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.799023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.799052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.808898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.808987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.809016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.809031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.809044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.809073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.818936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.819037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.819062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.819077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.819089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.819119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.828951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.829047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.829071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.829086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.829099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.829133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.839002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.839086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.839111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.839126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.839138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.839167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.849071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.849180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.849205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.849220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.849233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.849262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.859051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.859143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.859168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.859183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.448 [2024-11-29 17:10:23.859195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.448 [2024-11-29 17:10:23.859224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.448 qpair failed and we were unable to recover it. 00:28:12.448 [2024-11-29 17:10:23.869080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.448 [2024-11-29 17:10:23.869174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.448 [2024-11-29 17:10:23.869199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.448 [2024-11-29 17:10:23.869214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.449 [2024-11-29 17:10:23.869226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.449 [2024-11-29 17:10:23.869254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.449 qpair failed and we were unable to recover it. 00:28:12.708 [2024-11-29 17:10:23.879166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.708 [2024-11-29 17:10:23.879272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.708 [2024-11-29 17:10:23.879303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.708 [2024-11-29 17:10:23.879318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.708 [2024-11-29 17:10:23.879332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.708 [2024-11-29 17:10:23.879361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.708 qpair failed and we were unable to recover it. 00:28:12.708 [2024-11-29 17:10:23.889149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.708 [2024-11-29 17:10:23.889233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.708 [2024-11-29 17:10:23.889257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.708 [2024-11-29 17:10:23.889272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.708 [2024-11-29 17:10:23.889285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.708 [2024-11-29 17:10:23.889314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.708 qpair failed and we were unable to recover it. 00:28:12.708 [2024-11-29 17:10:23.899161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.708 [2024-11-29 17:10:23.899262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.708 [2024-11-29 17:10:23.899287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.708 [2024-11-29 17:10:23.899302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.708 [2024-11-29 17:10:23.899314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.708 [2024-11-29 17:10:23.899343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.708 qpair failed and we were unable to recover it. 00:28:12.708 [2024-11-29 17:10:23.909200] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.708 [2024-11-29 17:10:23.909296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.708 [2024-11-29 17:10:23.909321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.708 [2024-11-29 17:10:23.909336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.708 [2024-11-29 17:10:23.909349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.708 [2024-11-29 17:10:23.909377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.708 qpair failed and we were unable to recover it. 00:28:12.708 [2024-11-29 17:10:23.919214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.708 [2024-11-29 17:10:23.919296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.708 [2024-11-29 17:10:23.919320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.708 [2024-11-29 17:10:23.919335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.708 [2024-11-29 17:10:23.919348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.708 [2024-11-29 17:10:23.919382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.708 qpair failed and we were unable to recover it. 00:28:12.708 [2024-11-29 17:10:23.929226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.708 [2024-11-29 17:10:23.929305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.708 [2024-11-29 17:10:23.929332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.708 [2024-11-29 17:10:23.929347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.708 [2024-11-29 17:10:23.929359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.708 [2024-11-29 17:10:23.929387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.708 qpair failed and we were unable to recover it. 00:28:12.708 [2024-11-29 17:10:23.939312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.708 [2024-11-29 17:10:23.939402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.708 [2024-11-29 17:10:23.939426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.708 [2024-11-29 17:10:23.939441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.708 [2024-11-29 17:10:23.939454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.708 [2024-11-29 17:10:23.939482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.708 qpair failed and we were unable to recover it. 00:28:12.708 [2024-11-29 17:10:23.949292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.708 [2024-11-29 17:10:23.949405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.708 [2024-11-29 17:10:23.949430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.708 [2024-11-29 17:10:23.949446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.708 [2024-11-29 17:10:23.949458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.708 [2024-11-29 17:10:23.949487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.708 qpair failed and we were unable to recover it. 00:28:12.708 [2024-11-29 17:10:23.959394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.708 [2024-11-29 17:10:23.959487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.708 [2024-11-29 17:10:23.959511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:23.959525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:23.959539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:23.959567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:23.969386] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:23.969488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:23.969518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:23.969534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:23.969547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:23.969576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:23.979433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:23.979523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:23.979548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:23.979563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:23.979576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:23.979605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:23.989453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:23.989543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:23.989567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:23.989583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:23.989595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:23.989624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:23.999431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:23.999523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:23.999548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:23.999563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:23.999576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:23.999605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:24.009528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:24.009613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:24.009640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:24.009655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:24.009677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:24.009709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:24.019571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:24.019675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:24.019700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:24.019715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:24.019728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:24.019758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:24.029518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:24.029609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:24.029634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:24.029649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:24.029661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:24.029691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:24.039553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:24.039640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:24.039665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:24.039681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:24.039694] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:24.039722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:24.049625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:24.049740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:24.049765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:24.049780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:24.049793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.709 [2024-11-29 17:10:24.049821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.709 qpair failed and we were unable to recover it. 00:28:12.709 [2024-11-29 17:10:24.059621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.709 [2024-11-29 17:10:24.059719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.709 [2024-11-29 17:10:24.059744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.709 [2024-11-29 17:10:24.059760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.709 [2024-11-29 17:10:24.059774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.710 [2024-11-29 17:10:24.059803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.710 qpair failed and we were unable to recover it. 00:28:12.710 [2024-11-29 17:10:24.069657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.710 [2024-11-29 17:10:24.069764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.710 [2024-11-29 17:10:24.069790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.710 [2024-11-29 17:10:24.069807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.710 [2024-11-29 17:10:24.069821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.710 [2024-11-29 17:10:24.069849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.710 qpair failed and we were unable to recover it. 00:28:12.710 [2024-11-29 17:10:24.079671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.710 [2024-11-29 17:10:24.079752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.710 [2024-11-29 17:10:24.079779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.710 [2024-11-29 17:10:24.079794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.710 [2024-11-29 17:10:24.079808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.710 [2024-11-29 17:10:24.079838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.710 qpair failed and we were unable to recover it. 00:28:12.710 [2024-11-29 17:10:24.089688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.710 [2024-11-29 17:10:24.089784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.710 [2024-11-29 17:10:24.089810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.710 [2024-11-29 17:10:24.089825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.710 [2024-11-29 17:10:24.089838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.710 [2024-11-29 17:10:24.089868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.710 qpair failed and we were unable to recover it. 00:28:12.710 [2024-11-29 17:10:24.099711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.710 [2024-11-29 17:10:24.099801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.710 [2024-11-29 17:10:24.099827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.710 [2024-11-29 17:10:24.099842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.710 [2024-11-29 17:10:24.099862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.710 [2024-11-29 17:10:24.099892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.710 qpair failed and we were unable to recover it. 00:28:12.710 [2024-11-29 17:10:24.109780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.710 [2024-11-29 17:10:24.109868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.710 [2024-11-29 17:10:24.109894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.710 [2024-11-29 17:10:24.109909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.710 [2024-11-29 17:10:24.109923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.710 [2024-11-29 17:10:24.109952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.710 qpair failed and we were unable to recover it. 00:28:12.710 [2024-11-29 17:10:24.119768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.710 [2024-11-29 17:10:24.119852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.710 [2024-11-29 17:10:24.119877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.710 [2024-11-29 17:10:24.119892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.710 [2024-11-29 17:10:24.119905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.710 [2024-11-29 17:10:24.119935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.710 qpair failed and we were unable to recover it. 00:28:12.710 [2024-11-29 17:10:24.129849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.710 [2024-11-29 17:10:24.129978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.710 [2024-11-29 17:10:24.130004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.710 [2024-11-29 17:10:24.130019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.710 [2024-11-29 17:10:24.130032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.710 [2024-11-29 17:10:24.130062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.710 qpair failed and we were unable to recover it. 00:28:12.972 [2024-11-29 17:10:24.139843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.972 [2024-11-29 17:10:24.139934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.972 [2024-11-29 17:10:24.139969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.972 [2024-11-29 17:10:24.139987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.972 [2024-11-29 17:10:24.140001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.972 [2024-11-29 17:10:24.140031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.972 qpair failed and we were unable to recover it. 00:28:12.972 [2024-11-29 17:10:24.149892] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.972 [2024-11-29 17:10:24.149995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.972 [2024-11-29 17:10:24.150021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.972 [2024-11-29 17:10:24.150037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.972 [2024-11-29 17:10:24.150050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.972 [2024-11-29 17:10:24.150080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.972 qpair failed and we were unable to recover it. 00:28:12.972 [2024-11-29 17:10:24.159908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.972 [2024-11-29 17:10:24.160037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.972 [2024-11-29 17:10:24.160063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.972 [2024-11-29 17:10:24.160078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.972 [2024-11-29 17:10:24.160091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.972 [2024-11-29 17:10:24.160121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.972 qpair failed and we were unable to recover it. 00:28:12.972 [2024-11-29 17:10:24.169919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.972 [2024-11-29 17:10:24.170005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.972 [2024-11-29 17:10:24.170032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.972 [2024-11-29 17:10:24.170047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.972 [2024-11-29 17:10:24.170060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.972 [2024-11-29 17:10:24.170091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.972 qpair failed and we were unable to recover it. 00:28:12.972 [2024-11-29 17:10:24.179986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.972 [2024-11-29 17:10:24.180084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.972 [2024-11-29 17:10:24.180110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.180125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.180137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.180168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.189997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.190120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.190146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.190161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.190180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.190210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.200005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.200093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.200118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.200133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.200145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.200176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.210067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.210160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.210191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.210208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.210223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.210253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.220070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.220202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.220229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.220244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.220257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.220288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.230163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.230299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.230325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.230340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.230355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.230384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.240166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.240265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.240291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.240306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.240319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.240349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.250183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.250309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.250337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.250352] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.250365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.250395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.260243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.260351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.260377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.260392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.260407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.260436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.270212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.270317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.270342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.270358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.270370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.973 [2024-11-29 17:10:24.270400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.973 qpair failed and we were unable to recover it. 00:28:12.973 [2024-11-29 17:10:24.280240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.973 [2024-11-29 17:10:24.280330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.973 [2024-11-29 17:10:24.280359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.973 [2024-11-29 17:10:24.280375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.973 [2024-11-29 17:10:24.280394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.280424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.290270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.290357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.290384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.290399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.290412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.290442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.300311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.300402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.300427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.300443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.300457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.300486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.310341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.310428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.310454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.310470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.310483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.310513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.320352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.320436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.320465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.320481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.320495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.320525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.330429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.330547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.330572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.330588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.330601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.330630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.340417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.340502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.340528] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.340543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.340556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.340585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.350525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.350609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.350635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.350650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.350663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.350692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.360521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.360611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.360636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.360652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.360666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.360695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.370536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.370622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.370648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.370670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.370685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.370714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.380560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.974 [2024-11-29 17:10:24.380650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.974 [2024-11-29 17:10:24.380675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.974 [2024-11-29 17:10:24.380690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.974 [2024-11-29 17:10:24.380704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.974 [2024-11-29 17:10:24.380733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.974 qpair failed and we were unable to recover it. 00:28:12.974 [2024-11-29 17:10:24.390577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:12.975 [2024-11-29 17:10:24.390695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:12.975 [2024-11-29 17:10:24.390721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:12.975 [2024-11-29 17:10:24.390737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:12.975 [2024-11-29 17:10:24.390751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:12.975 [2024-11-29 17:10:24.390780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:12.975 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.400598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.400689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.400717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.400733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.400746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.400776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.410667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.410793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.410820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.410835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.410848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.410878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.420648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.420740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.420767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.420783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.420795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.420825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.430726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.430816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.430843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.430858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.430870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.430899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.440726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.440813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.440839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.440854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.440867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.440896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.450735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.450816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.450841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.450856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.450869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.450899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.460768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.460889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.460915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.460936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.460951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.460988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.470789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.470871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.470897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.470912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.470925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.470953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.480859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.480943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.480976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.480993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.481006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.481036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.490849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.490945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.490980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.490996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.491009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.491039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.500912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.501053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.501079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.501095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.501110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.501139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.510931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.511049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.263 [2024-11-29 17:10:24.511076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.263 [2024-11-29 17:10:24.511091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.263 [2024-11-29 17:10:24.511104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.263 [2024-11-29 17:10:24.511134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.263 qpair failed and we were unable to recover it. 00:28:13.263 [2024-11-29 17:10:24.520942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.263 [2024-11-29 17:10:24.521060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.521084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.521099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.521112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.521140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.531006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.531093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.531119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.531134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.531147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.531176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.541023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.541124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.541150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.541165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.541178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.541208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.551038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.551126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.551152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.551173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.551187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.551217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.561116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.561240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.561266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.561281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.561295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.561325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.571077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.571165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.571191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.571206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.571219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.571248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.581133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.581221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.581247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.581263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.581276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.581307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.591193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.591284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.591313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.591331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.591345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.591375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.601178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.601297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.601324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.601339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.601352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.601381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.611257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.611347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.611373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.611388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.611401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.611431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.621246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.621339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.621364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.621380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.621392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.621422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.631248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.631335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.631361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.631376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.631390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.631419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.641365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.641453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.641479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.641499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.641514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.641543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.264 qpair failed and we were unable to recover it. 00:28:13.264 [2024-11-29 17:10:24.651302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.264 [2024-11-29 17:10:24.651389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.264 [2024-11-29 17:10:24.651416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.264 [2024-11-29 17:10:24.651431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.264 [2024-11-29 17:10:24.651444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.264 [2024-11-29 17:10:24.651473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.265 qpair failed and we were unable to recover it. 00:28:13.265 [2024-11-29 17:10:24.661343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.265 [2024-11-29 17:10:24.661436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.265 [2024-11-29 17:10:24.661462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.265 [2024-11-29 17:10:24.661479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.265 [2024-11-29 17:10:24.661494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.265 [2024-11-29 17:10:24.661523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.265 qpair failed and we were unable to recover it. 00:28:13.265 [2024-11-29 17:10:24.671368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.265 [2024-11-29 17:10:24.671447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.265 [2024-11-29 17:10:24.671473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.265 [2024-11-29 17:10:24.671488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.265 [2024-11-29 17:10:24.671503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.265 [2024-11-29 17:10:24.671532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.265 qpair failed and we were unable to recover it. 00:28:13.540 [2024-11-29 17:10:24.681442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.540 [2024-11-29 17:10:24.681548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.540 [2024-11-29 17:10:24.681580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.540 [2024-11-29 17:10:24.681597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.540 [2024-11-29 17:10:24.681611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.540 [2024-11-29 17:10:24.681641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.691455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.691541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.691567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.691583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.691597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.691627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.701454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.701548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.701573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.701588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.701600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.701629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.711540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.711629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.711655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.711669] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.711683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.711711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.721560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.721665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.721691] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.721705] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.721718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.721747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.731561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.731642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.731681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.731697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.731711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.731739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.741718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.741806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.741832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.741847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.741860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.741889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.751611] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.751732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.751759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.751776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.751789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.751820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.761637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.761727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.761752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.761767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.761780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.761808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.771690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.771774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.771802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.771821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.771834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.771865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.781725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.781839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.781866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.781881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.781894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.541 [2024-11-29 17:10:24.781922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.541 qpair failed and we were unable to recover it. 00:28:13.541 [2024-11-29 17:10:24.791708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.541 [2024-11-29 17:10:24.791797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.541 [2024-11-29 17:10:24.791823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.541 [2024-11-29 17:10:24.791837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.541 [2024-11-29 17:10:24.791850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.791879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.801740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.801830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.801856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.801871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.801883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.801911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.811790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.811902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.811927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.811942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.811973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.812003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.821837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.821927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.821969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.821994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.822008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.822036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.831841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.831928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.831972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.831992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.832006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.832036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.841900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.842054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.842080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.842094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.842107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.842137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.851896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.851985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.852011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.852026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.852038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.852067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.861944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.862047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.862073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.862087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.862100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.862135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.872043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.872130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.872155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.872170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.872183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.872212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.882017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.882102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.882128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.882142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.882155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.882184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.892017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.542 [2024-11-29 17:10:24.892102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.542 [2024-11-29 17:10:24.892127] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.542 [2024-11-29 17:10:24.892142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.542 [2024-11-29 17:10:24.892155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.542 [2024-11-29 17:10:24.892183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.542 qpair failed and we were unable to recover it. 00:28:13.542 [2024-11-29 17:10:24.902047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.543 [2024-11-29 17:10:24.902169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.543 [2024-11-29 17:10:24.902194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.543 [2024-11-29 17:10:24.902208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.543 [2024-11-29 17:10:24.902221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.543 [2024-11-29 17:10:24.902249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.543 qpair failed and we were unable to recover it. 00:28:13.543 [2024-11-29 17:10:24.912101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.543 [2024-11-29 17:10:24.912225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.543 [2024-11-29 17:10:24.912255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.543 [2024-11-29 17:10:24.912271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.543 [2024-11-29 17:10:24.912284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.543 [2024-11-29 17:10:24.912312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.543 qpair failed and we were unable to recover it. 00:28:13.543 [2024-11-29 17:10:24.922116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.543 [2024-11-29 17:10:24.922218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.543 [2024-11-29 17:10:24.922243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.543 [2024-11-29 17:10:24.922257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.543 [2024-11-29 17:10:24.922270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.543 [2024-11-29 17:10:24.922298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.543 qpair failed and we were unable to recover it. 00:28:13.543 [2024-11-29 17:10:24.932136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.543 [2024-11-29 17:10:24.932224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.543 [2024-11-29 17:10:24.932252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.543 [2024-11-29 17:10:24.932268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.543 [2024-11-29 17:10:24.932282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.543 [2024-11-29 17:10:24.932311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.543 qpair failed and we were unable to recover it. 00:28:13.543 [2024-11-29 17:10:24.942190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.543 [2024-11-29 17:10:24.942303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.543 [2024-11-29 17:10:24.942328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.543 [2024-11-29 17:10:24.942342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.543 [2024-11-29 17:10:24.942356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.543 [2024-11-29 17:10:24.942384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.543 qpair failed and we were unable to recover it. 00:28:13.543 [2024-11-29 17:10:24.952226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.543 [2024-11-29 17:10:24.952327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.543 [2024-11-29 17:10:24.952352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.543 [2024-11-29 17:10:24.952366] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.543 [2024-11-29 17:10:24.952379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.543 [2024-11-29 17:10:24.952413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.543 qpair failed and we were unable to recover it. 00:28:13.824 [2024-11-29 17:10:24.962227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.824 [2024-11-29 17:10:24.962314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.824 [2024-11-29 17:10:24.962340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.824 [2024-11-29 17:10:24.962355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.824 [2024-11-29 17:10:24.962367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.824 [2024-11-29 17:10:24.962395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.824 qpair failed and we were unable to recover it. 00:28:13.824 [2024-11-29 17:10:24.972274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.824 [2024-11-29 17:10:24.972401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.824 [2024-11-29 17:10:24.972426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.824 [2024-11-29 17:10:24.972440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.824 [2024-11-29 17:10:24.972453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.824 [2024-11-29 17:10:24.972483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.824 qpair failed and we were unable to recover it. 00:28:13.824 [2024-11-29 17:10:24.982290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.824 [2024-11-29 17:10:24.982379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.824 [2024-11-29 17:10:24.982405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.824 [2024-11-29 17:10:24.982419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.824 [2024-11-29 17:10:24.982432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.824 [2024-11-29 17:10:24.982460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.824 qpair failed and we were unable to recover it. 00:28:13.824 [2024-11-29 17:10:24.992329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.824 [2024-11-29 17:10:24.992423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.824 [2024-11-29 17:10:24.992451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.824 [2024-11-29 17:10:24.992468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.824 [2024-11-29 17:10:24.992481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.824 [2024-11-29 17:10:24.992511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.824 qpair failed and we were unable to recover it. 00:28:13.824 [2024-11-29 17:10:25.002374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.824 [2024-11-29 17:10:25.002468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.824 [2024-11-29 17:10:25.002503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.824 [2024-11-29 17:10:25.002519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.824 [2024-11-29 17:10:25.002532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.824 [2024-11-29 17:10:25.002562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.824 qpair failed and we were unable to recover it. 00:28:13.824 [2024-11-29 17:10:25.012362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.824 [2024-11-29 17:10:25.012443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.824 [2024-11-29 17:10:25.012469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.824 [2024-11-29 17:10:25.012484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.012497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.012525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.022457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.825 [2024-11-29 17:10:25.022550] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.825 [2024-11-29 17:10:25.022576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.825 [2024-11-29 17:10:25.022591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.022604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.022632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.032473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.825 [2024-11-29 17:10:25.032594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.825 [2024-11-29 17:10:25.032619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.825 [2024-11-29 17:10:25.032634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.032647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.032675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.042467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.825 [2024-11-29 17:10:25.042578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.825 [2024-11-29 17:10:25.042602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.825 [2024-11-29 17:10:25.042616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.042629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.042664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.052508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.825 [2024-11-29 17:10:25.052617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.825 [2024-11-29 17:10:25.052642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.825 [2024-11-29 17:10:25.052657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.052670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.052698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.062579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.825 [2024-11-29 17:10:25.062672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.825 [2024-11-29 17:10:25.062697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.825 [2024-11-29 17:10:25.062712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.062725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.062753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.072547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.825 [2024-11-29 17:10:25.072634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.825 [2024-11-29 17:10:25.072660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.825 [2024-11-29 17:10:25.072674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.072688] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.072716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.082573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.825 [2024-11-29 17:10:25.082680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.825 [2024-11-29 17:10:25.082705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.825 [2024-11-29 17:10:25.082719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.082732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.082761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.092615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.825 [2024-11-29 17:10:25.092702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.825 [2024-11-29 17:10:25.092736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.825 [2024-11-29 17:10:25.092753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.092767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.092796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.102668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.825 [2024-11-29 17:10:25.102757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.825 [2024-11-29 17:10:25.102782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.825 [2024-11-29 17:10:25.102797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.825 [2024-11-29 17:10:25.102810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.825 [2024-11-29 17:10:25.102838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.825 qpair failed and we were unable to recover it. 00:28:13.825 [2024-11-29 17:10:25.112684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.112772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.112797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.826 [2024-11-29 17:10:25.112811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.826 [2024-11-29 17:10:25.112824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.826 [2024-11-29 17:10:25.112852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.826 qpair failed and we were unable to recover it. 00:28:13.826 [2024-11-29 17:10:25.122753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.122867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.122891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.826 [2024-11-29 17:10:25.122905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.826 [2024-11-29 17:10:25.122918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.826 [2024-11-29 17:10:25.122947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.826 qpair failed and we were unable to recover it. 00:28:13.826 [2024-11-29 17:10:25.132746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.132835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.132861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.826 [2024-11-29 17:10:25.132876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.826 [2024-11-29 17:10:25.132888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.826 [2024-11-29 17:10:25.132923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.826 qpair failed and we were unable to recover it. 00:28:13.826 [2024-11-29 17:10:25.142795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.142926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.142950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.826 [2024-11-29 17:10:25.142973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.826 [2024-11-29 17:10:25.142988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.826 [2024-11-29 17:10:25.143016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.826 qpair failed and we were unable to recover it. 00:28:13.826 [2024-11-29 17:10:25.152825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.152919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.152944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.826 [2024-11-29 17:10:25.152967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.826 [2024-11-29 17:10:25.152983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.826 [2024-11-29 17:10:25.153011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.826 qpair failed and we were unable to recover it. 00:28:13.826 [2024-11-29 17:10:25.162825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.162907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.162932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.826 [2024-11-29 17:10:25.162947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.826 [2024-11-29 17:10:25.162966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.826 [2024-11-29 17:10:25.162996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.826 qpair failed and we were unable to recover it. 00:28:13.826 [2024-11-29 17:10:25.172887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.173005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.173031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.826 [2024-11-29 17:10:25.173046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.826 [2024-11-29 17:10:25.173059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.826 [2024-11-29 17:10:25.173087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.826 qpair failed and we were unable to recover it. 00:28:13.826 [2024-11-29 17:10:25.182880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.182975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.183006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.826 [2024-11-29 17:10:25.183021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.826 [2024-11-29 17:10:25.183034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.826 [2024-11-29 17:10:25.183062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.826 qpair failed and we were unable to recover it. 00:28:13.826 [2024-11-29 17:10:25.192943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.193038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.193063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.826 [2024-11-29 17:10:25.193078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.826 [2024-11-29 17:10:25.193090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.826 [2024-11-29 17:10:25.193119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.826 qpair failed and we were unable to recover it. 00:28:13.826 [2024-11-29 17:10:25.202967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.826 [2024-11-29 17:10:25.203055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.826 [2024-11-29 17:10:25.203081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.827 [2024-11-29 17:10:25.203095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.827 [2024-11-29 17:10:25.203108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.827 [2024-11-29 17:10:25.203136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.827 qpair failed and we were unable to recover it. 00:28:13.827 [2024-11-29 17:10:25.212973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.827 [2024-11-29 17:10:25.213058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.827 [2024-11-29 17:10:25.213086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.827 [2024-11-29 17:10:25.213101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.827 [2024-11-29 17:10:25.213115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.827 [2024-11-29 17:10:25.213143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.827 qpair failed and we were unable to recover it. 00:28:13.827 [2024-11-29 17:10:25.223013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.827 [2024-11-29 17:10:25.223106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.827 [2024-11-29 17:10:25.223131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.827 [2024-11-29 17:10:25.223145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.827 [2024-11-29 17:10:25.223164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.827 [2024-11-29 17:10:25.223193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.827 qpair failed and we were unable to recover it. 00:28:13.827 [2024-11-29 17:10:25.233155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:13.827 [2024-11-29 17:10:25.233292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:13.827 [2024-11-29 17:10:25.233317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:13.827 [2024-11-29 17:10:25.233331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:13.827 [2024-11-29 17:10:25.233344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:13.827 [2024-11-29 17:10:25.233372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:13.827 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.243095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.243220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.243246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.243260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.243273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.243301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.253088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.253173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.253198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.253213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.253226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.253254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.263125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.263213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.263241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.263257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.263269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.263298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.273210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.273332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.273357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.273371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.273384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.273414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.283196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.283316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.283342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.283356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.283369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.283397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.293251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.293334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.293360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.293375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.293388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.293416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.303345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.303450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.303476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.303491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.303504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.303531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.313308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.313430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.313455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.313470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.313488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.313517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.323341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.323472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.323497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.323514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.323527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.323555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.333342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.333434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.333462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.333478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.333491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.333519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.343414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.343506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.343531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.343546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.343559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.343587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.129 [2024-11-29 17:10:25.353423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.129 [2024-11-29 17:10:25.353517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.129 [2024-11-29 17:10:25.353542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.129 [2024-11-29 17:10:25.353557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.129 [2024-11-29 17:10:25.353570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.129 [2024-11-29 17:10:25.353598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.129 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.363477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.363584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.363612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.363628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.363642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.363670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.373471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.373554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.373579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.373593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.373606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.373634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.383534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.383655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.383680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.383695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.383708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.383736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.393500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.393587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.393612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.393626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.393639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.393666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.403564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.403658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.403684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.403699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.403717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.403746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.413562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.413690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.413716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.413730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.413743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.413771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.423595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.423698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.423723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.423738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.423750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.423778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.433625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.433711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.433736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.433751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.433764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.433792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.443681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.443766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.443791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.443806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.443819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.443847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.453694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.453787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.453812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.453826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.453838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.453867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.463715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.463803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.463827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.463842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.463855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.463883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.473772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.473894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.473919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.473934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.473946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.130 [2024-11-29 17:10:25.473980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.130 qpair failed and we were unable to recover it. 00:28:14.130 [2024-11-29 17:10:25.483824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.130 [2024-11-29 17:10:25.483932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.130 [2024-11-29 17:10:25.483969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.130 [2024-11-29 17:10:25.483988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.130 [2024-11-29 17:10:25.484001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.131 [2024-11-29 17:10:25.484030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.131 qpair failed and we were unable to recover it. 00:28:14.131 [2024-11-29 17:10:25.493779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.131 [2024-11-29 17:10:25.493910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.131 [2024-11-29 17:10:25.493936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.131 [2024-11-29 17:10:25.493950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.131 [2024-11-29 17:10:25.493981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.131 [2024-11-29 17:10:25.494011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.131 qpair failed and we were unable to recover it. 00:28:14.131 [2024-11-29 17:10:25.503849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.131 [2024-11-29 17:10:25.503963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.131 [2024-11-29 17:10:25.503990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.131 [2024-11-29 17:10:25.504005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.131 [2024-11-29 17:10:25.504018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.131 [2024-11-29 17:10:25.504047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.131 qpair failed and we were unable to recover it. 00:28:14.131 [2024-11-29 17:10:25.513887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.131 [2024-11-29 17:10:25.514005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.131 [2024-11-29 17:10:25.514031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.131 [2024-11-29 17:10:25.514046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.131 [2024-11-29 17:10:25.514058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.131 [2024-11-29 17:10:25.514087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.131 qpair failed and we were unable to recover it. 00:28:14.131 [2024-11-29 17:10:25.523889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.131 [2024-11-29 17:10:25.523983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.131 [2024-11-29 17:10:25.524007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.131 [2024-11-29 17:10:25.524021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.131 [2024-11-29 17:10:25.524033] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.131 [2024-11-29 17:10:25.524062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.131 qpair failed and we were unable to recover it. 00:28:14.131 [2024-11-29 17:10:25.533904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.131 [2024-11-29 17:10:25.533994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.131 [2024-11-29 17:10:25.534021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.131 [2024-11-29 17:10:25.534035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.131 [2024-11-29 17:10:25.534048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.131 [2024-11-29 17:10:25.534077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.131 qpair failed and we were unable to recover it. 00:28:14.131 [2024-11-29 17:10:25.543933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.131 [2024-11-29 17:10:25.544028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.131 [2024-11-29 17:10:25.544054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.131 [2024-11-29 17:10:25.544068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.131 [2024-11-29 17:10:25.544081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.131 [2024-11-29 17:10:25.544109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.131 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.554018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.554172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.554197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.554212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.554224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.554253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.400 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.564127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.564237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.564262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.564276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.564288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.564316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.400 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.574022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.574110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.574136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.574150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.574163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.574190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.400 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.584104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.584215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.584240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.584262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.584276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.584305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.400 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.594134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.594222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.594248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.594262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.594275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.594303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.400 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.604106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.604191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.604217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.604232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.604244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.604273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.400 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.614188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.614308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.614333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.614348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.614361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.614389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.400 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.624180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.624271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.624297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.624312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.624324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.624352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.400 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.634225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.634355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.634381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.634396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.634409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.634437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.400 qpair failed and we were unable to recover it. 00:28:14.400 [2024-11-29 17:10:25.644253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.400 [2024-11-29 17:10:25.644339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.400 [2024-11-29 17:10:25.644364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.400 [2024-11-29 17:10:25.644379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.400 [2024-11-29 17:10:25.644391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.400 [2024-11-29 17:10:25.644419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.654302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.654384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.654413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.654427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.654440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.654468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.664316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.664401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.664426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.664440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.664453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.664482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.674363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.674485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.674510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.674531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.674545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.674573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.684366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.684462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.684488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.684503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.684516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.684544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.694430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.694550] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.694575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.694589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.694603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.694631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.704500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.704589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.704614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.704628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.704641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.704668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.714658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.714783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.714809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.714824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.714837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.714864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.724542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.724630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.724656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.724670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.724683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.724711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.734601] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.734717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.734743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.734757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.734770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.734798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.744614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.744733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.744759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.744773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.744786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.744814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.754597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.754687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.754713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.754728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.754741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.754768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.764641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.764759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.764784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.764804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.764817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.764846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.774629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.774754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.774780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.774794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.774807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.774835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.784664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.784754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.784780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.784794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.784807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.784835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.794692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.794777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.794803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.794817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.794830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.794858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.804741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.804849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.804874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.804889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.804902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.804930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.814748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.814857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.814885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.814901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.814914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.814943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.401 [2024-11-29 17:10:25.824809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.401 [2024-11-29 17:10:25.824910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.401 [2024-11-29 17:10:25.824936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.401 [2024-11-29 17:10:25.824950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.401 [2024-11-29 17:10:25.824971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.401 [2024-11-29 17:10:25.825001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.401 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.834802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.834907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.834933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.834947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.834968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.834998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.844879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.844972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.844997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.845012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.845025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.845053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.854985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.855105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.855130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.855151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.855165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.855193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.864935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.865035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.865060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.865075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.865088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.865116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.874947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.875039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.875064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.875079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.875093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.875120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.884989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.885077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.885103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.885118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.885131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.885159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.895043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.895134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.895159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.895174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.895187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.895215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.905057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.905180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.905205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.905219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.905232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.905261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.915046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.915133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.915158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.915173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.915185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.915214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.925097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.925219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.925244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.925258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.925271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.925300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.935092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.935179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.935205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.935219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.659 [2024-11-29 17:10:25.935232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.659 [2024-11-29 17:10:25.935260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.659 qpair failed and we were unable to recover it. 00:28:14.659 [2024-11-29 17:10:25.945150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.659 [2024-11-29 17:10:25.945248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.659 [2024-11-29 17:10:25.945278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.659 [2024-11-29 17:10:25.945293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:25.945306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:25.945335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:25.955178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:25.955302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:25.955328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:25.955343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:25.955356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:25.955385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:25.965222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:25.965317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:25.965343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:25.965358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:25.965371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:25.965401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:25.975236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:25.975334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:25.975359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:25.975374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:25.975388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:25.975417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:25.985257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:25.985373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:25.985398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:25.985413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:25.985426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:25.985454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:25.995318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:25.995407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:25.995433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:25.995447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:25.995460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:25.995489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:26.005325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:26.005452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:26.005477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:26.005492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:26.005505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:26.005534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:26.015388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:26.015479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:26.015504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:26.015519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:26.015532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:26.015562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:26.025426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:26.025532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:26.025557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:26.025572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:26.025585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:26.025613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:26.035456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:26.035556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:26.035586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:26.035602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:26.035615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:26.035643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:26.045461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:26.045545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:26.045570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:26.045584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:26.045598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:26.045626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:26.055492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:26.055582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:26.055607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:26.055622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:26.055635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:26.055663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:26.065543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:26.065663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:26.065688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:26.065702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:26.065715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:26.065743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:26.075580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.660 [2024-11-29 17:10:26.075671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.660 [2024-11-29 17:10:26.075695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.660 [2024-11-29 17:10:26.075710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.660 [2024-11-29 17:10:26.075723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.660 [2024-11-29 17:10:26.075757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.660 qpair failed and we were unable to recover it. 00:28:14.660 [2024-11-29 17:10:26.085539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.661 [2024-11-29 17:10:26.085627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.661 [2024-11-29 17:10:26.085652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.661 [2024-11-29 17:10:26.085666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.661 [2024-11-29 17:10:26.085679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.661 [2024-11-29 17:10:26.085707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.661 qpair failed and we were unable to recover it. 00:28:14.919 [2024-11-29 17:10:26.095617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.919 [2024-11-29 17:10:26.095700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.919 [2024-11-29 17:10:26.095725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.919 [2024-11-29 17:10:26.095739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.919 [2024-11-29 17:10:26.095752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.919 [2024-11-29 17:10:26.095780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.919 qpair failed and we were unable to recover it. 00:28:14.919 [2024-11-29 17:10:26.105620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.919 [2024-11-29 17:10:26.105703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.919 [2024-11-29 17:10:26.105729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.919 [2024-11-29 17:10:26.105743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.919 [2024-11-29 17:10:26.105756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.919 [2024-11-29 17:10:26.105784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.919 qpair failed and we were unable to recover it. 00:28:14.919 [2024-11-29 17:10:26.115664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.919 [2024-11-29 17:10:26.115755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.919 [2024-11-29 17:10:26.115780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.919 [2024-11-29 17:10:26.115795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.919 [2024-11-29 17:10:26.115808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.919 [2024-11-29 17:10:26.115836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.919 qpair failed and we were unable to recover it. 00:28:14.919 [2024-11-29 17:10:26.125653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.919 [2024-11-29 17:10:26.125750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.919 [2024-11-29 17:10:26.125780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.919 [2024-11-29 17:10:26.125795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.919 [2024-11-29 17:10:26.125808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.919 [2024-11-29 17:10:26.125836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.919 qpair failed and we were unable to recover it. 00:28:14.919 [2024-11-29 17:10:26.135693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.919 [2024-11-29 17:10:26.135817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.919 [2024-11-29 17:10:26.135842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.919 [2024-11-29 17:10:26.135857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.919 [2024-11-29 17:10:26.135870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.919 [2024-11-29 17:10:26.135898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.919 qpair failed and we were unable to recover it. 00:28:14.919 [2024-11-29 17:10:26.145710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.919 [2024-11-29 17:10:26.145799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.919 [2024-11-29 17:10:26.145824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.145838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.145851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.145879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.155735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.155819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.155844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.155859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.155872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.155900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.165785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.165904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.165929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.165943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.165956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.166003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.175888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.175981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.176007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.176023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.176035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.176064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.185829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.185964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.185990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.186004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.186017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.186045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.195858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.195944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.195978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.195993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.196007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.196035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.205914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.206007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.206033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.206047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.206060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.206088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.215941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.216032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.216063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.216078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.216091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.216120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.226031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.226124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.226149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.226164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.226176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.226204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.236017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.236138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.236163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.236178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.236191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.236220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.246009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.246097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.246123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.246137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.246150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.246178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.256123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.256207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.256232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.256246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.256259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.256293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.266190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.266310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.266335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.266350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.266363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.266390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.920 [2024-11-29 17:10:26.276151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.920 [2024-11-29 17:10:26.276241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.920 [2024-11-29 17:10:26.276266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.920 [2024-11-29 17:10:26.276280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.920 [2024-11-29 17:10:26.276293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.920 [2024-11-29 17:10:26.276322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.920 qpair failed and we were unable to recover it. 00:28:14.921 [2024-11-29 17:10:26.286144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.921 [2024-11-29 17:10:26.286228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.921 [2024-11-29 17:10:26.286253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.921 [2024-11-29 17:10:26.286268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.921 [2024-11-29 17:10:26.286281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.921 [2024-11-29 17:10:26.286308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.921 qpair failed and we were unable to recover it. 00:28:14.921 [2024-11-29 17:10:26.296188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.921 [2024-11-29 17:10:26.296280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.921 [2024-11-29 17:10:26.296305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.921 [2024-11-29 17:10:26.296320] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.921 [2024-11-29 17:10:26.296332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.921 [2024-11-29 17:10:26.296360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.921 qpair failed and we were unable to recover it. 00:28:14.921 [2024-11-29 17:10:26.306219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.921 [2024-11-29 17:10:26.306306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.921 [2024-11-29 17:10:26.306337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.921 [2024-11-29 17:10:26.306353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.921 [2024-11-29 17:10:26.306366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.921 [2024-11-29 17:10:26.306394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.921 qpair failed and we were unable to recover it. 00:28:14.921 [2024-11-29 17:10:26.316247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.921 [2024-11-29 17:10:26.316334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.921 [2024-11-29 17:10:26.316359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.921 [2024-11-29 17:10:26.316373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.921 [2024-11-29 17:10:26.316386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.921 [2024-11-29 17:10:26.316414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.921 qpair failed and we were unable to recover it. 00:28:14.921 [2024-11-29 17:10:26.326253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.921 [2024-11-29 17:10:26.326332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.921 [2024-11-29 17:10:26.326357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.921 [2024-11-29 17:10:26.326372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.921 [2024-11-29 17:10:26.326385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.921 [2024-11-29 17:10:26.326413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.921 qpair failed and we were unable to recover it. 00:28:14.921 [2024-11-29 17:10:26.336299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.921 [2024-11-29 17:10:26.336391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.921 [2024-11-29 17:10:26.336417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.921 [2024-11-29 17:10:26.336431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.921 [2024-11-29 17:10:26.336444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.921 [2024-11-29 17:10:26.336472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.921 qpair failed and we were unable to recover it. 00:28:14.921 [2024-11-29 17:10:26.346416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:14.921 [2024-11-29 17:10:26.346503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:14.921 [2024-11-29 17:10:26.346529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:14.921 [2024-11-29 17:10:26.346543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:14.921 [2024-11-29 17:10:26.346556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:14.921 [2024-11-29 17:10:26.346591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:14.921 qpair failed and we were unable to recover it. 00:28:15.179 [2024-11-29 17:10:26.356357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.179 [2024-11-29 17:10:26.356480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.179 [2024-11-29 17:10:26.356506] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.356520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.356533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.356561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.366414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.366499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.366524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.366538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.366552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.366580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.376464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.376579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.376604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.376618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.376631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.376659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.386477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.386600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.386625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.386639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.386652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.386680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.396471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.396551] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.396583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.396598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.396610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.396638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.406497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.406591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.406616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.406631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.406643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.406671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.416543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.416626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.416652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.416667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.416680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.416708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.426643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.426732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.426758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.426772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.426785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.426813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.436590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.436683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.436707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.436722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.436740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.436769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.446609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.446691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.446716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.446730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.446744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.446772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.456659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.456752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.456781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.456797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.456810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.456840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.466706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.466802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.466827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.466841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.466854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.466883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.476700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.476786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.476811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.476825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.476837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.180 [2024-11-29 17:10:26.476865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.180 qpair failed and we were unable to recover it. 00:28:15.180 [2024-11-29 17:10:26.486748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.180 [2024-11-29 17:10:26.486841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.180 [2024-11-29 17:10:26.486867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.180 [2024-11-29 17:10:26.486881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.180 [2024-11-29 17:10:26.486894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.486922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.496810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.496896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.496923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.496938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.496951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.496988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.506837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.506924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.506950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.506981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.506996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.507025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.516852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.516989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.517015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.517030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.517042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.517070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.526875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.526968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.526992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.527006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.527027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.527056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.536956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.537056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.537086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.537102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.537116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.537147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.546939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.547040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.547067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.547082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.547095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.547125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.556963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.557058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.557083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.557098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.557112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.557141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.566977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.567065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.567090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.567105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.567118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.567148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.577014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.577102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.577128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.577143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.577156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.577185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.587058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.587152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.587178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.587193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.587206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.587235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.597102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.597232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.597257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.597272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.597287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.597315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.181 [2024-11-29 17:10:26.607111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.181 [2024-11-29 17:10:26.607198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.181 [2024-11-29 17:10:26.607223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.181 [2024-11-29 17:10:26.607238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.181 [2024-11-29 17:10:26.607252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.181 [2024-11-29 17:10:26.607280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.181 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.617143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.617230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.617256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.617271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.617290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.617320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.627171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.627270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.627296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.627310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.627324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.627353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.637194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.637287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.637315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.637330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.637344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.637373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.647316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.647401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.647426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.647442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.647455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.647484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.657250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.657340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.657366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.657381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.657395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.657423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.667285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.667426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.667456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.667471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.667485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.667514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.677415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.677508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.677534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.677549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.677563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.677592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.687384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.687496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.687522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.687537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.687551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.687579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.697421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.697513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.697539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.697555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.697569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.697597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.707437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.707537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.707563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.707578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.440 [2024-11-29 17:10:26.707598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.440 [2024-11-29 17:10:26.707628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.440 qpair failed and we were unable to recover it. 00:28:15.440 [2024-11-29 17:10:26.717441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.440 [2024-11-29 17:10:26.717530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.440 [2024-11-29 17:10:26.717556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.440 [2024-11-29 17:10:26.717571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.717584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.717613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.727511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.727623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.727652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.727667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.727681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.727710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.737481] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.737570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.737594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.737609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.737621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.737650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.747619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.747709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.747734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.747749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.747761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.747790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.757563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.757647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.757672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.757687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.757699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.757729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.767598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.767692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.767716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.767731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.767743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.767772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.777685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.777769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.777793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.777808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.777821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.777849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.787638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.787736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.787760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.787775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.787788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.787816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.797748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.797835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.797861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.797882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.797896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.797926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.807676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.807756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.807781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.807796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.807809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.807843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.817715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.817806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.817831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.817846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.817859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.817888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.827808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.827905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.827930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.827944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.827963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.827994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.837858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.837950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.837982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.838004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.838016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.838045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.441 [2024-11-29 17:10:26.847819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.441 [2024-11-29 17:10:26.847928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.441 [2024-11-29 17:10:26.847953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.441 [2024-11-29 17:10:26.847976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.441 [2024-11-29 17:10:26.847989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.441 [2024-11-29 17:10:26.848023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.441 qpair failed and we were unable to recover it. 00:28:15.442 [2024-11-29 17:10:26.857829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.442 [2024-11-29 17:10:26.857921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.442 [2024-11-29 17:10:26.857950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.442 [2024-11-29 17:10:26.857976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.442 [2024-11-29 17:10:26.857991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.442 [2024-11-29 17:10:26.858022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.442 qpair failed and we were unable to recover it. 00:28:15.442 [2024-11-29 17:10:26.867873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.442 [2024-11-29 17:10:26.867973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.442 [2024-11-29 17:10:26.868002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.442 [2024-11-29 17:10:26.868018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.442 [2024-11-29 17:10:26.868030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.442 [2024-11-29 17:10:26.868061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.442 qpair failed and we were unable to recover it. 00:28:15.701 [2024-11-29 17:10:26.877921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.701 [2024-11-29 17:10:26.878017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.701 [2024-11-29 17:10:26.878043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.701 [2024-11-29 17:10:26.878057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.701 [2024-11-29 17:10:26.878071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.701 [2024-11-29 17:10:26.878100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.701 qpair failed and we were unable to recover it. 00:28:15.701 [2024-11-29 17:10:26.887905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.701 [2024-11-29 17:10:26.887993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.701 [2024-11-29 17:10:26.888018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.701 [2024-11-29 17:10:26.888038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.701 [2024-11-29 17:10:26.888052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.701 [2024-11-29 17:10:26.888081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.701 qpair failed and we were unable to recover it. 00:28:15.701 [2024-11-29 17:10:26.897930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.701 [2024-11-29 17:10:26.898025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.701 [2024-11-29 17:10:26.898050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.701 [2024-11-29 17:10:26.898065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.701 [2024-11-29 17:10:26.898077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.701 [2024-11-29 17:10:26.898107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.701 qpair failed and we were unable to recover it. 00:28:15.701 [2024-11-29 17:10:26.908006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.701 [2024-11-29 17:10:26.908109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.701 [2024-11-29 17:10:26.908134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.701 [2024-11-29 17:10:26.908149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.701 [2024-11-29 17:10:26.908162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.701 [2024-11-29 17:10:26.908191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.701 qpair failed and we were unable to recover it. 00:28:15.701 [2024-11-29 17:10:26.918022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.701 [2024-11-29 17:10:26.918109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.701 [2024-11-29 17:10:26.918134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.701 [2024-11-29 17:10:26.918149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.701 [2024-11-29 17:10:26.918162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.701 [2024-11-29 17:10:26.918191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.701 qpair failed and we were unable to recover it. 00:28:15.701 [2024-11-29 17:10:26.928019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.701 [2024-11-29 17:10:26.928107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.701 [2024-11-29 17:10:26.928133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.701 [2024-11-29 17:10:26.928148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.701 [2024-11-29 17:10:26.928161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.701 [2024-11-29 17:10:26.928190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.701 qpair failed and we were unable to recover it. 00:28:15.701 [2024-11-29 17:10:26.938046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.701 [2024-11-29 17:10:26.938132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.701 [2024-11-29 17:10:26.938158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.701 [2024-11-29 17:10:26.938173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.701 [2024-11-29 17:10:26.938187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.701 [2024-11-29 17:10:26.938219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.701 qpair failed and we were unable to recover it. 00:28:15.701 [2024-11-29 17:10:26.948091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.701 [2024-11-29 17:10:26.948182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.701 [2024-11-29 17:10:26.948208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.701 [2024-11-29 17:10:26.948223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.701 [2024-11-29 17:10:26.948236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:26.948265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:26.958124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:26.958214] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:26.958239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:26.958255] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:26.958268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:26.958297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:26.968128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:26.968208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:26.968234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:26.968249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:26.968262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:26.968291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:26.978277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:26.978363] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:26.978390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:26.978410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:26.978425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:26.978454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:26.988229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:26.988318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:26.988345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:26.988361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:26.988374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:26.988402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:26.998220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:26.998312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:26.998339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:26.998355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:26.998368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:26.998397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:27.008258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:27.008346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:27.008373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:27.008388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:27.008401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:27.008430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:27.018300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:27.018389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:27.018416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:27.018432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:27.018445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:27.018474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:27.028328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:27.028417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:27.028443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:27.028458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:27.028471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:27.028500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:27.038330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:27.038432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:27.038458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:27.038473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:27.038487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:27.038518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:27.048356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:27.048445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:27.048471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:27.048487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:27.048501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:27.048530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:27.058384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:27.058468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:27.058495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:27.058511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:27.058525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:27.058554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:27.068429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:27.068515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:27.068541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:27.068563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:27.068579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:27.068608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:27.078460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.702 [2024-11-29 17:10:27.078586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.702 [2024-11-29 17:10:27.078612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.702 [2024-11-29 17:10:27.078627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.702 [2024-11-29 17:10:27.078640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.702 [2024-11-29 17:10:27.078669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.702 qpair failed and we were unable to recover it. 00:28:15.702 [2024-11-29 17:10:27.088530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.703 [2024-11-29 17:10:27.088614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.703 [2024-11-29 17:10:27.088640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.703 [2024-11-29 17:10:27.088654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.703 [2024-11-29 17:10:27.088667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.703 [2024-11-29 17:10:27.088697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.703 qpair failed and we were unable to recover it. 00:28:15.703 [2024-11-29 17:10:27.098546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.703 [2024-11-29 17:10:27.098631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.703 [2024-11-29 17:10:27.098655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.703 [2024-11-29 17:10:27.098670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.703 [2024-11-29 17:10:27.098683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.703 [2024-11-29 17:10:27.098711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.703 qpair failed and we were unable to recover it. 00:28:15.703 [2024-11-29 17:10:27.108550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.703 [2024-11-29 17:10:27.108640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.703 [2024-11-29 17:10:27.108666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.703 [2024-11-29 17:10:27.108682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.703 [2024-11-29 17:10:27.108695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.703 [2024-11-29 17:10:27.108724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.703 qpair failed and we were unable to recover it. 00:28:15.703 [2024-11-29 17:10:27.118592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.703 [2024-11-29 17:10:27.118699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.703 [2024-11-29 17:10:27.118729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.703 [2024-11-29 17:10:27.118747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.703 [2024-11-29 17:10:27.118761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.703 [2024-11-29 17:10:27.118794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.703 qpair failed and we were unable to recover it. 00:28:15.703 [2024-11-29 17:10:27.128627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.703 [2024-11-29 17:10:27.128724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.703 [2024-11-29 17:10:27.128752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.703 [2024-11-29 17:10:27.128768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.703 [2024-11-29 17:10:27.128781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.703 [2024-11-29 17:10:27.128811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.703 qpair failed and we were unable to recover it. 00:28:15.962 [2024-11-29 17:10:27.138613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.962 [2024-11-29 17:10:27.138694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.962 [2024-11-29 17:10:27.138721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.962 [2024-11-29 17:10:27.138736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.962 [2024-11-29 17:10:27.138749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.962 [2024-11-29 17:10:27.138780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.962 qpair failed and we were unable to recover it. 00:28:15.962 [2024-11-29 17:10:27.148668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.962 [2024-11-29 17:10:27.148755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.962 [2024-11-29 17:10:27.148780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.962 [2024-11-29 17:10:27.148794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.962 [2024-11-29 17:10:27.148808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.962 [2024-11-29 17:10:27.148836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.962 qpair failed and we were unable to recover it. 00:28:15.962 [2024-11-29 17:10:27.158718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.962 [2024-11-29 17:10:27.158847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.962 [2024-11-29 17:10:27.158879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.962 [2024-11-29 17:10:27.158896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.962 [2024-11-29 17:10:27.158909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.962 [2024-11-29 17:10:27.158937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.962 qpair failed and we were unable to recover it. 00:28:15.962 [2024-11-29 17:10:27.168754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.962 [2024-11-29 17:10:27.168864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.962 [2024-11-29 17:10:27.168889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.962 [2024-11-29 17:10:27.168903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.962 [2024-11-29 17:10:27.168916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.962 [2024-11-29 17:10:27.168946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.962 qpair failed and we were unable to recover it. 00:28:15.962 [2024-11-29 17:10:27.178788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.962 [2024-11-29 17:10:27.178888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.962 [2024-11-29 17:10:27.178917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.962 [2024-11-29 17:10:27.178933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.962 [2024-11-29 17:10:27.178945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.962 [2024-11-29 17:10:27.178981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.962 qpair failed and we were unable to recover it. 00:28:15.962 [2024-11-29 17:10:27.188806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.962 [2024-11-29 17:10:27.188917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.962 [2024-11-29 17:10:27.188945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.962 [2024-11-29 17:10:27.188970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.962 [2024-11-29 17:10:27.188985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.962 [2024-11-29 17:10:27.189022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.962 qpair failed and we were unable to recover it. 00:28:15.962 [2024-11-29 17:10:27.198824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.962 [2024-11-29 17:10:27.198942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.962 [2024-11-29 17:10:27.198976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.962 [2024-11-29 17:10:27.198992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.962 [2024-11-29 17:10:27.199008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.962 [2024-11-29 17:10:27.199037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.962 qpair failed and we were unable to recover it. 00:28:15.962 [2024-11-29 17:10:27.208839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.962 [2024-11-29 17:10:27.208926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.962 [2024-11-29 17:10:27.208951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.962 [2024-11-29 17:10:27.208974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.962 [2024-11-29 17:10:27.208988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.962 [2024-11-29 17:10:27.209028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.962 qpair failed and we were unable to recover it. 00:28:15.962 [2024-11-29 17:10:27.218846] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.962 [2024-11-29 17:10:27.218933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.218964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.218981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.218994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.219023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.229009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.229126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.229151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.229166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.229180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.229209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.238942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.239045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.239070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.239085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.239097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.239126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.248945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.249039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.249069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.249085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.249098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.249128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.258975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.259058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.259082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.259097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.259110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.259138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.269014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.269105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.269129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.269145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.269157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.269187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.279064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.279154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.279181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.279197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.279211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.279240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.289087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.289205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.289230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.289245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.289260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.289297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.299202] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.299291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.299316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.299331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.299344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.299374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.309169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.309274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.309300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.309315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.309328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.309358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.319138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.319227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.319251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.319266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.319279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.319308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.329194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.329278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.329304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.329319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.329331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.329359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.339210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.339295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.339325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.339341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.339354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.339383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.963 [2024-11-29 17:10:27.349264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.963 [2024-11-29 17:10:27.349350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.963 [2024-11-29 17:10:27.349375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.963 [2024-11-29 17:10:27.349389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.963 [2024-11-29 17:10:27.349402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.963 [2024-11-29 17:10:27.349430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.963 qpair failed and we were unable to recover it. 00:28:15.964 [2024-11-29 17:10:27.359296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.964 [2024-11-29 17:10:27.359381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.964 [2024-11-29 17:10:27.359405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.964 [2024-11-29 17:10:27.359421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.964 [2024-11-29 17:10:27.359434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.964 [2024-11-29 17:10:27.359463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.964 qpair failed and we were unable to recover it. 00:28:15.964 [2024-11-29 17:10:27.369336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.964 [2024-11-29 17:10:27.369423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.964 [2024-11-29 17:10:27.369448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.964 [2024-11-29 17:10:27.369463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.964 [2024-11-29 17:10:27.369475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.964 [2024-11-29 17:10:27.369503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.964 qpair failed and we were unable to recover it. 00:28:15.964 [2024-11-29 17:10:27.379402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.964 [2024-11-29 17:10:27.379493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.964 [2024-11-29 17:10:27.379518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.964 [2024-11-29 17:10:27.379534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.964 [2024-11-29 17:10:27.379547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.964 [2024-11-29 17:10:27.379581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.964 qpair failed and we were unable to recover it. 00:28:15.964 [2024-11-29 17:10:27.389356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:15.964 [2024-11-29 17:10:27.389445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:15.964 [2024-11-29 17:10:27.389471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:15.964 [2024-11-29 17:10:27.389486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:15.964 [2024-11-29 17:10:27.389499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:15.964 [2024-11-29 17:10:27.389527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:15.964 qpair failed and we were unable to recover it. 00:28:16.223 [2024-11-29 17:10:27.399400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.223 [2024-11-29 17:10:27.399489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.223 [2024-11-29 17:10:27.399514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.223 [2024-11-29 17:10:27.399529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.223 [2024-11-29 17:10:27.399543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.223 [2024-11-29 17:10:27.399571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.223 qpair failed and we were unable to recover it. 00:28:16.223 [2024-11-29 17:10:27.409447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.223 [2024-11-29 17:10:27.409533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.223 [2024-11-29 17:10:27.409559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.223 [2024-11-29 17:10:27.409574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.223 [2024-11-29 17:10:27.409587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.223 [2024-11-29 17:10:27.409616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.223 qpair failed and we were unable to recover it. 00:28:16.223 [2024-11-29 17:10:27.419460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.223 [2024-11-29 17:10:27.419545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.223 [2024-11-29 17:10:27.419569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.223 [2024-11-29 17:10:27.419584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.223 [2024-11-29 17:10:27.419597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.223 [2024-11-29 17:10:27.419625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.223 qpair failed and we were unable to recover it. 00:28:16.223 [2024-11-29 17:10:27.429502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.429590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.429623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.429639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.429651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.429681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.439495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.439582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.439607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.439622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.439635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.439665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.449538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.449623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.449648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.449663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.449675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.449703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.459543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.459637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.459662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.459677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.459689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.459718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.469578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.469711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.469737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.469753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.469767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.469801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.479604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.479687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.479712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.479726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.479739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.479767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.489672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.489791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.489824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.489843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.489856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.489887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.499703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.499788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.499814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.499830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.499842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.499871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.509713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.509846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.509873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.509889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.509902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.509931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.519834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.519920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.519950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.519974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.519989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.520018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.529757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.529839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.529864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.529879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.529892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.529919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.539789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.539872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.539897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.539913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.539925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.539954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.549855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.224 [2024-11-29 17:10:27.549945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.224 [2024-11-29 17:10:27.549978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.224 [2024-11-29 17:10:27.549994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.224 [2024-11-29 17:10:27.550007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.224 [2024-11-29 17:10:27.550036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.224 qpair failed and we were unable to recover it. 00:28:16.224 [2024-11-29 17:10:27.559860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.559989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.560014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.560029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.560042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.225 [2024-11-29 17:10:27.560076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.569872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.570000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.570025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.570040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.570054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.225 [2024-11-29 17:10:27.570083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.579926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.580027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.580052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.580067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.580080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.225 [2024-11-29 17:10:27.580109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.589981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.590072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.590097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.590112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.590125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.225 [2024-11-29 17:10:27.590154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.599969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.600059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.600084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.600099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.600112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.225 [2024-11-29 17:10:27.600141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.610019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.610111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.610145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.610161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.610175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2457cb0 00:28:16.225 [2024-11-29 17:10:27.610206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.620025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.620110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.620142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.620158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.620171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f1de4000b90 00:28:16.225 [2024-11-29 17:10:27.620203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.630055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.630146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.630172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.630187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.630199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f1de4000b90 00:28:16.225 [2024-11-29 17:10:27.630230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.640094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.640182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.640213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.640229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.640242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f1dd8000b90 00:28:16.225 [2024-11-29 17:10:27.640275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.650137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.225 [2024-11-29 17:10:27.650224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.225 [2024-11-29 17:10:27.650251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.225 [2024-11-29 17:10:27.650266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.225 [2024-11-29 17:10:27.650290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f1dd8000b90 00:28:16.225 [2024-11-29 17:10:27.650323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:16.225 qpair failed and we were unable to recover it. 00:28:16.225 [2024-11-29 17:10:27.650433] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:28:16.225 A controller has encountered a failure and is being reset. 00:28:16.483 [2024-11-29 17:10:27.660158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.483 [2024-11-29 17:10:27.660241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.483 [2024-11-29 17:10:27.660272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.483 [2024-11-29 17:10:27.660289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.483 [2024-11-29 17:10:27.660301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f1ddc000b90 00:28:16.483 [2024-11-29 17:10:27.660345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:16.483 qpair failed and we were unable to recover it. 00:28:16.483 [2024-11-29 17:10:27.670200] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:16.483 [2024-11-29 17:10:27.670291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:16.483 [2024-11-29 17:10:27.670317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:16.483 [2024-11-29 17:10:27.670333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:16.483 [2024-11-29 17:10:27.670346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f1ddc000b90 00:28:16.483 [2024-11-29 17:10:27.670377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:16.483 qpair failed and we were unable to recover it. 00:28:16.483 Controller properly reset. 00:28:16.483 Initializing NVMe Controllers 00:28:16.483 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:16.483 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:16.483 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:28:16.483 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:28:16.483 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:28:16.483 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:28:16.483 Initialization complete. Launching workers. 00:28:16.483 Starting thread on core 1 00:28:16.483 Starting thread on core 2 00:28:16.483 Starting thread on core 3 00:28:16.483 Starting thread on core 0 00:28:16.483 17:10:27 -- host/target_disconnect.sh@59 -- # sync 00:28:16.483 00:28:16.483 real 0m11.514s 00:28:16.483 user 0m21.782s 00:28:16.483 sys 0m5.370s 00:28:16.483 17:10:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:16.483 17:10:27 -- common/autotest_common.sh@10 -- # set +x 00:28:16.483 ************************************ 00:28:16.483 END TEST nvmf_target_disconnect_tc2 00:28:16.483 ************************************ 00:28:16.483 17:10:27 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:28:16.483 17:10:27 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:28:16.483 17:10:27 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:28:16.483 17:10:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:16.483 17:10:27 -- nvmf/common.sh@116 -- # sync 00:28:16.483 17:10:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:16.483 17:10:27 -- nvmf/common.sh@119 -- # set +e 00:28:16.483 17:10:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:16.483 17:10:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:16.483 rmmod nvme_tcp 00:28:16.483 rmmod nvme_fabrics 00:28:16.483 rmmod nvme_keyring 00:28:16.742 17:10:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:16.742 17:10:27 -- nvmf/common.sh@123 -- # set -e 00:28:16.742 17:10:27 -- nvmf/common.sh@124 -- # return 0 00:28:16.742 17:10:27 -- nvmf/common.sh@477 -- # '[' -n 329019 ']' 00:28:16.742 17:10:27 -- nvmf/common.sh@478 -- # killprocess 329019 00:28:16.742 17:10:27 -- common/autotest_common.sh@936 -- # '[' -z 329019 ']' 00:28:16.742 17:10:27 -- common/autotest_common.sh@940 -- # kill -0 329019 00:28:16.742 17:10:27 -- common/autotest_common.sh@941 -- # uname 00:28:16.742 17:10:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:16.742 17:10:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 329019 00:28:16.742 17:10:27 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:28:16.742 17:10:27 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:28:16.742 17:10:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 329019' 00:28:16.742 killing process with pid 329019 00:28:16.742 17:10:27 -- common/autotest_common.sh@955 -- # kill 329019 00:28:16.742 17:10:27 -- common/autotest_common.sh@960 -- # wait 329019 00:28:17.002 17:10:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:17.002 17:10:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:17.002 17:10:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:17.002 17:10:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:17.002 17:10:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:17.002 17:10:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:17.002 17:10:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:17.002 17:10:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:18.906 17:10:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:18.906 00:28:18.906 real 0m16.545s 00:28:18.906 user 0m48.350s 00:28:18.906 sys 0m7.442s 00:28:18.906 17:10:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:18.906 17:10:30 -- common/autotest_common.sh@10 -- # set +x 00:28:18.907 ************************************ 00:28:18.907 END TEST nvmf_target_disconnect 00:28:18.907 ************************************ 00:28:18.907 17:10:30 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:18.907 17:10:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:18.907 17:10:30 -- common/autotest_common.sh@10 -- # set +x 00:28:18.907 17:10:30 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:18.907 00:28:18.907 real 21m31.828s 00:28:18.907 user 62m35.092s 00:28:18.907 sys 4m52.953s 00:28:18.907 17:10:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:18.907 17:10:30 -- common/autotest_common.sh@10 -- # set +x 00:28:18.907 ************************************ 00:28:18.907 END TEST nvmf_tcp 00:28:18.907 ************************************ 00:28:19.165 17:10:30 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:28:19.165 17:10:30 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:19.165 17:10:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:19.165 17:10:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:19.165 17:10:30 -- common/autotest_common.sh@10 -- # set +x 00:28:19.165 ************************************ 00:28:19.165 START TEST spdkcli_nvmf_tcp 00:28:19.165 ************************************ 00:28:19.165 17:10:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:19.165 * Looking for test storage... 00:28:19.165 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:19.165 17:10:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:19.165 17:10:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:19.165 17:10:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:19.165 17:10:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:19.165 17:10:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:19.165 17:10:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:19.165 17:10:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:19.165 17:10:30 -- scripts/common.sh@335 -- # IFS=.-: 00:28:19.165 17:10:30 -- scripts/common.sh@335 -- # read -ra ver1 00:28:19.165 17:10:30 -- scripts/common.sh@336 -- # IFS=.-: 00:28:19.165 17:10:30 -- scripts/common.sh@336 -- # read -ra ver2 00:28:19.165 17:10:30 -- scripts/common.sh@337 -- # local 'op=<' 00:28:19.165 17:10:30 -- scripts/common.sh@339 -- # ver1_l=2 00:28:19.165 17:10:30 -- scripts/common.sh@340 -- # ver2_l=1 00:28:19.165 17:10:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:19.165 17:10:30 -- scripts/common.sh@343 -- # case "$op" in 00:28:19.165 17:10:30 -- scripts/common.sh@344 -- # : 1 00:28:19.165 17:10:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:19.165 17:10:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:19.165 17:10:30 -- scripts/common.sh@364 -- # decimal 1 00:28:19.165 17:10:30 -- scripts/common.sh@352 -- # local d=1 00:28:19.165 17:10:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:19.165 17:10:30 -- scripts/common.sh@354 -- # echo 1 00:28:19.165 17:10:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:19.165 17:10:30 -- scripts/common.sh@365 -- # decimal 2 00:28:19.165 17:10:30 -- scripts/common.sh@352 -- # local d=2 00:28:19.165 17:10:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:19.165 17:10:30 -- scripts/common.sh@354 -- # echo 2 00:28:19.165 17:10:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:19.165 17:10:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:19.165 17:10:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:19.165 17:10:30 -- scripts/common.sh@367 -- # return 0 00:28:19.165 17:10:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:19.165 17:10:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:19.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.165 --rc genhtml_branch_coverage=1 00:28:19.165 --rc genhtml_function_coverage=1 00:28:19.165 --rc genhtml_legend=1 00:28:19.165 --rc geninfo_all_blocks=1 00:28:19.165 --rc geninfo_unexecuted_blocks=1 00:28:19.165 00:28:19.165 ' 00:28:19.165 17:10:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:19.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.165 --rc genhtml_branch_coverage=1 00:28:19.165 --rc genhtml_function_coverage=1 00:28:19.165 --rc genhtml_legend=1 00:28:19.165 --rc geninfo_all_blocks=1 00:28:19.165 --rc geninfo_unexecuted_blocks=1 00:28:19.165 00:28:19.165 ' 00:28:19.165 17:10:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:19.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.165 --rc genhtml_branch_coverage=1 00:28:19.165 --rc genhtml_function_coverage=1 00:28:19.165 --rc genhtml_legend=1 00:28:19.165 --rc geninfo_all_blocks=1 00:28:19.165 --rc geninfo_unexecuted_blocks=1 00:28:19.165 00:28:19.165 ' 00:28:19.165 17:10:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:19.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.165 --rc genhtml_branch_coverage=1 00:28:19.165 --rc genhtml_function_coverage=1 00:28:19.165 --rc genhtml_legend=1 00:28:19.165 --rc geninfo_all_blocks=1 00:28:19.165 --rc geninfo_unexecuted_blocks=1 00:28:19.165 00:28:19.165 ' 00:28:19.165 17:10:30 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:19.165 17:10:30 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:19.165 17:10:30 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:19.165 17:10:30 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:19.165 17:10:30 -- nvmf/common.sh@7 -- # uname -s 00:28:19.165 17:10:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:19.165 17:10:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:19.166 17:10:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:19.166 17:10:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:19.166 17:10:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:19.166 17:10:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:19.166 17:10:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:19.166 17:10:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:19.166 17:10:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:19.166 17:10:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:19.166 17:10:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:19.166 17:10:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:19.166 17:10:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:19.166 17:10:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:19.166 17:10:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:19.166 17:10:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:19.166 17:10:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:19.166 17:10:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:19.166 17:10:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:19.166 17:10:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.166 17:10:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.166 17:10:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.166 17:10:30 -- paths/export.sh@5 -- # export PATH 00:28:19.166 17:10:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.166 17:10:30 -- nvmf/common.sh@46 -- # : 0 00:28:19.166 17:10:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:19.166 17:10:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:19.166 17:10:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:19.166 17:10:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:19.166 17:10:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:19.166 17:10:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:19.166 17:10:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:19.166 17:10:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:19.166 17:10:30 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:19.166 17:10:30 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:19.166 17:10:30 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:19.166 17:10:30 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:19.166 17:10:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:19.166 17:10:30 -- common/autotest_common.sh@10 -- # set +x 00:28:19.166 17:10:30 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:19.166 17:10:30 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=330257 00:28:19.166 17:10:30 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:19.166 17:10:30 -- spdkcli/common.sh@34 -- # waitforlisten 330257 00:28:19.166 17:10:30 -- common/autotest_common.sh@829 -- # '[' -z 330257 ']' 00:28:19.166 17:10:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:19.166 17:10:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:19.166 17:10:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:19.166 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:19.166 17:10:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:19.166 17:10:30 -- common/autotest_common.sh@10 -- # set +x 00:28:19.166 [2024-11-29 17:10:30.540124] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:19.166 [2024-11-29 17:10:30.540215] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid330257 ] 00:28:19.166 EAL: No free 2048 kB hugepages reported on node 1 00:28:19.424 [2024-11-29 17:10:30.600554] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:19.424 [2024-11-29 17:10:30.714841] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:19.424 [2024-11-29 17:10:30.715068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:19.424 [2024-11-29 17:10:30.715075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:20.357 17:10:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:20.357 17:10:31 -- common/autotest_common.sh@862 -- # return 0 00:28:20.357 17:10:31 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:20.357 17:10:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:20.357 17:10:31 -- common/autotest_common.sh@10 -- # set +x 00:28:20.357 17:10:31 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:20.357 17:10:31 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:20.357 17:10:31 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:20.357 17:10:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:20.357 17:10:31 -- common/autotest_common.sh@10 -- # set +x 00:28:20.357 17:10:31 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:20.357 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:20.357 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:20.357 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:20.357 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:20.357 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:20.357 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:20.357 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:20.357 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:20.357 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:20.358 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:20.358 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:20.358 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:20.358 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:20.358 ' 00:28:20.616 [2024-11-29 17:10:32.006874] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:23.144 [2024-11-29 17:10:34.189213] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:24.077 [2024-11-29 17:10:35.441780] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:26.604 [2024-11-29 17:10:37.761108] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:28.504 [2024-11-29 17:10:39.759700] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:29.877 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:29.877 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:29.877 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:29.877 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:29.877 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:29.877 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:29.877 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:29.877 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:29.877 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:29.877 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:29.877 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:29.877 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:30.135 17:10:41 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:30.135 17:10:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:30.135 17:10:41 -- common/autotest_common.sh@10 -- # set +x 00:28:30.135 17:10:41 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:30.135 17:10:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:30.135 17:10:41 -- common/autotest_common.sh@10 -- # set +x 00:28:30.135 17:10:41 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:30.135 17:10:41 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:30.699 17:10:41 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:30.699 17:10:41 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:30.699 17:10:41 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:30.699 17:10:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:30.699 17:10:41 -- common/autotest_common.sh@10 -- # set +x 00:28:30.699 17:10:41 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:30.699 17:10:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:30.699 17:10:41 -- common/autotest_common.sh@10 -- # set +x 00:28:30.699 17:10:41 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:30.699 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:30.699 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:30.699 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:30.699 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:30.699 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:30.699 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:30.699 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:30.699 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:30.699 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:30.699 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:30.699 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:30.699 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:30.699 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:30.699 ' 00:28:35.957 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:35.957 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:35.957 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:35.957 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:35.957 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:35.957 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:35.957 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:35.957 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:35.957 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:35.957 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:35.957 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:35.957 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:35.957 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:35.957 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:35.957 17:10:47 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:35.957 17:10:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:35.957 17:10:47 -- common/autotest_common.sh@10 -- # set +x 00:28:35.957 17:10:47 -- spdkcli/nvmf.sh@90 -- # killprocess 330257 00:28:35.957 17:10:47 -- common/autotest_common.sh@936 -- # '[' -z 330257 ']' 00:28:35.957 17:10:47 -- common/autotest_common.sh@940 -- # kill -0 330257 00:28:35.957 17:10:47 -- common/autotest_common.sh@941 -- # uname 00:28:35.957 17:10:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:35.957 17:10:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 330257 00:28:35.957 17:10:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:35.957 17:10:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:35.957 17:10:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 330257' 00:28:35.957 killing process with pid 330257 00:28:35.957 17:10:47 -- common/autotest_common.sh@955 -- # kill 330257 00:28:35.957 [2024-11-29 17:10:47.235341] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:35.957 17:10:47 -- common/autotest_common.sh@960 -- # wait 330257 00:28:36.215 17:10:47 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:36.215 17:10:47 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:36.215 17:10:47 -- spdkcli/common.sh@13 -- # '[' -n 330257 ']' 00:28:36.215 17:10:47 -- spdkcli/common.sh@14 -- # killprocess 330257 00:28:36.215 17:10:47 -- common/autotest_common.sh@936 -- # '[' -z 330257 ']' 00:28:36.215 17:10:47 -- common/autotest_common.sh@940 -- # kill -0 330257 00:28:36.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (330257) - No such process 00:28:36.215 17:10:47 -- common/autotest_common.sh@963 -- # echo 'Process with pid 330257 is not found' 00:28:36.215 Process with pid 330257 is not found 00:28:36.215 17:10:47 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:36.215 17:10:47 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:36.215 17:10:47 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:36.215 00:28:36.215 real 0m17.140s 00:28:36.215 user 0m36.600s 00:28:36.215 sys 0m0.840s 00:28:36.215 17:10:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:36.215 17:10:47 -- common/autotest_common.sh@10 -- # set +x 00:28:36.215 ************************************ 00:28:36.215 END TEST spdkcli_nvmf_tcp 00:28:36.215 ************************************ 00:28:36.215 17:10:47 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:36.215 17:10:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:36.215 17:10:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:36.215 17:10:47 -- common/autotest_common.sh@10 -- # set +x 00:28:36.215 ************************************ 00:28:36.215 START TEST nvmf_identify_passthru 00:28:36.215 ************************************ 00:28:36.215 17:10:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:36.215 * Looking for test storage... 00:28:36.215 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:36.215 17:10:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:36.215 17:10:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:36.215 17:10:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:36.215 17:10:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:36.215 17:10:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:36.215 17:10:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:36.215 17:10:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:36.215 17:10:47 -- scripts/common.sh@335 -- # IFS=.-: 00:28:36.215 17:10:47 -- scripts/common.sh@335 -- # read -ra ver1 00:28:36.215 17:10:47 -- scripts/common.sh@336 -- # IFS=.-: 00:28:36.215 17:10:47 -- scripts/common.sh@336 -- # read -ra ver2 00:28:36.215 17:10:47 -- scripts/common.sh@337 -- # local 'op=<' 00:28:36.215 17:10:47 -- scripts/common.sh@339 -- # ver1_l=2 00:28:36.215 17:10:47 -- scripts/common.sh@340 -- # ver2_l=1 00:28:36.215 17:10:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:36.215 17:10:47 -- scripts/common.sh@343 -- # case "$op" in 00:28:36.215 17:10:47 -- scripts/common.sh@344 -- # : 1 00:28:36.215 17:10:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:36.215 17:10:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:36.215 17:10:47 -- scripts/common.sh@364 -- # decimal 1 00:28:36.215 17:10:47 -- scripts/common.sh@352 -- # local d=1 00:28:36.215 17:10:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:36.215 17:10:47 -- scripts/common.sh@354 -- # echo 1 00:28:36.215 17:10:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:36.215 17:10:47 -- scripts/common.sh@365 -- # decimal 2 00:28:36.215 17:10:47 -- scripts/common.sh@352 -- # local d=2 00:28:36.215 17:10:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:36.215 17:10:47 -- scripts/common.sh@354 -- # echo 2 00:28:36.215 17:10:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:36.474 17:10:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:36.474 17:10:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:36.474 17:10:47 -- scripts/common.sh@367 -- # return 0 00:28:36.474 17:10:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:36.474 17:10:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:36.474 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:36.474 --rc genhtml_branch_coverage=1 00:28:36.474 --rc genhtml_function_coverage=1 00:28:36.474 --rc genhtml_legend=1 00:28:36.474 --rc geninfo_all_blocks=1 00:28:36.474 --rc geninfo_unexecuted_blocks=1 00:28:36.474 00:28:36.474 ' 00:28:36.474 17:10:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:36.474 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:36.474 --rc genhtml_branch_coverage=1 00:28:36.474 --rc genhtml_function_coverage=1 00:28:36.474 --rc genhtml_legend=1 00:28:36.474 --rc geninfo_all_blocks=1 00:28:36.474 --rc geninfo_unexecuted_blocks=1 00:28:36.474 00:28:36.474 ' 00:28:36.474 17:10:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:36.474 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:36.474 --rc genhtml_branch_coverage=1 00:28:36.474 --rc genhtml_function_coverage=1 00:28:36.474 --rc genhtml_legend=1 00:28:36.474 --rc geninfo_all_blocks=1 00:28:36.474 --rc geninfo_unexecuted_blocks=1 00:28:36.474 00:28:36.474 ' 00:28:36.474 17:10:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:36.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:36.475 --rc genhtml_branch_coverage=1 00:28:36.475 --rc genhtml_function_coverage=1 00:28:36.475 --rc genhtml_legend=1 00:28:36.475 --rc geninfo_all_blocks=1 00:28:36.475 --rc geninfo_unexecuted_blocks=1 00:28:36.475 00:28:36.475 ' 00:28:36.475 17:10:47 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:36.475 17:10:47 -- nvmf/common.sh@7 -- # uname -s 00:28:36.475 17:10:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:36.475 17:10:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:36.475 17:10:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:36.475 17:10:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:36.475 17:10:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:36.475 17:10:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:36.475 17:10:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:36.475 17:10:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:36.475 17:10:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:36.475 17:10:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:36.475 17:10:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:36.475 17:10:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:36.475 17:10:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:36.475 17:10:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:36.475 17:10:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:36.475 17:10:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:36.475 17:10:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:36.475 17:10:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:36.475 17:10:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:36.475 17:10:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.475 17:10:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.475 17:10:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.475 17:10:47 -- paths/export.sh@5 -- # export PATH 00:28:36.475 17:10:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.475 17:10:47 -- nvmf/common.sh@46 -- # : 0 00:28:36.475 17:10:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:36.475 17:10:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:36.475 17:10:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:36.475 17:10:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:36.475 17:10:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:36.475 17:10:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:36.475 17:10:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:36.475 17:10:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:36.475 17:10:47 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:36.475 17:10:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:36.475 17:10:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:36.475 17:10:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:36.475 17:10:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.475 17:10:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.475 17:10:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.475 17:10:47 -- paths/export.sh@5 -- # export PATH 00:28:36.475 17:10:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:36.475 17:10:47 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:36.475 17:10:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:36.475 17:10:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:36.475 17:10:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:36.475 17:10:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:36.475 17:10:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:36.475 17:10:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:36.475 17:10:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:36.475 17:10:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:36.475 17:10:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:36.475 17:10:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:36.475 17:10:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:36.475 17:10:47 -- common/autotest_common.sh@10 -- # set +x 00:28:38.376 17:10:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:38.376 17:10:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:38.376 17:10:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:38.376 17:10:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:38.376 17:10:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:38.376 17:10:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:38.376 17:10:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:38.376 17:10:49 -- nvmf/common.sh@294 -- # net_devs=() 00:28:38.376 17:10:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:38.376 17:10:49 -- nvmf/common.sh@295 -- # e810=() 00:28:38.376 17:10:49 -- nvmf/common.sh@295 -- # local -ga e810 00:28:38.376 17:10:49 -- nvmf/common.sh@296 -- # x722=() 00:28:38.376 17:10:49 -- nvmf/common.sh@296 -- # local -ga x722 00:28:38.376 17:10:49 -- nvmf/common.sh@297 -- # mlx=() 00:28:38.376 17:10:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:38.376 17:10:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:38.376 17:10:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:38.376 17:10:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:38.376 17:10:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:38.376 17:10:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:38.376 17:10:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:38.376 17:10:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:38.376 17:10:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:38.377 17:10:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:38.377 17:10:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:38.377 17:10:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:38.377 17:10:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:38.377 17:10:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:38.377 17:10:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:38.377 17:10:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:38.377 17:10:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:38.377 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:38.377 17:10:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:38.377 17:10:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:38.377 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:38.377 17:10:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:38.377 17:10:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:38.377 17:10:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:38.377 17:10:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:38.377 17:10:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:38.377 17:10:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:38.377 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:38.377 17:10:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:38.377 17:10:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:38.377 17:10:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:38.377 17:10:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:38.377 17:10:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:38.377 17:10:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:38.377 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:38.377 17:10:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:38.377 17:10:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:38.377 17:10:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:38.377 17:10:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:38.377 17:10:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:38.377 17:10:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:38.377 17:10:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:38.377 17:10:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:38.377 17:10:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:38.377 17:10:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:38.377 17:10:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:38.377 17:10:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:38.377 17:10:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:38.377 17:10:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:38.377 17:10:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:38.377 17:10:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:38.377 17:10:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:38.377 17:10:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:38.377 17:10:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:38.377 17:10:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:38.377 17:10:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:38.377 17:10:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:38.377 17:10:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:38.377 17:10:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:38.377 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:38.377 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:28:38.377 00:28:38.377 --- 10.0.0.2 ping statistics --- 00:28:38.377 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:38.377 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:28:38.377 17:10:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:38.377 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:38.377 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:28:38.377 00:28:38.377 --- 10.0.0.1 ping statistics --- 00:28:38.377 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:38.377 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:28:38.377 17:10:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:38.377 17:10:49 -- nvmf/common.sh@410 -- # return 0 00:28:38.377 17:10:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:38.377 17:10:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:38.377 17:10:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:38.377 17:10:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:38.377 17:10:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:38.377 17:10:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:38.377 17:10:49 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:38.377 17:10:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:38.377 17:10:49 -- common/autotest_common.sh@10 -- # set +x 00:28:38.377 17:10:49 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:38.377 17:10:49 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:38.377 17:10:49 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:38.377 17:10:49 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:38.377 17:10:49 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:38.377 17:10:49 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:38.377 17:10:49 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:38.377 17:10:49 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:38.377 17:10:49 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:38.377 17:10:49 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:38.377 17:10:49 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:38.377 17:10:49 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:38.377 17:10:49 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:38.377 17:10:49 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:38.377 17:10:49 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:38.377 17:10:49 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:38.377 17:10:49 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:38.377 17:10:49 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:38.377 EAL: No free 2048 kB hugepages reported on node 1 00:28:43.637 17:10:53 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:43.637 17:10:53 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:43.637 17:10:53 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:43.637 17:10:53 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:43.637 EAL: No free 2048 kB hugepages reported on node 1 00:28:46.915 17:10:58 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:46.915 17:10:58 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:46.915 17:10:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:46.915 17:10:58 -- common/autotest_common.sh@10 -- # set +x 00:28:46.915 17:10:58 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:46.915 17:10:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:46.915 17:10:58 -- common/autotest_common.sh@10 -- # set +x 00:28:46.915 17:10:58 -- target/identify_passthru.sh@31 -- # nvmfpid=334999 00:28:46.915 17:10:58 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:46.915 17:10:58 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:46.915 17:10:58 -- target/identify_passthru.sh@35 -- # waitforlisten 334999 00:28:46.915 17:10:58 -- common/autotest_common.sh@829 -- # '[' -z 334999 ']' 00:28:46.915 17:10:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:46.915 17:10:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:46.915 17:10:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:46.915 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:46.915 17:10:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:46.915 17:10:58 -- common/autotest_common.sh@10 -- # set +x 00:28:46.915 [2024-11-29 17:10:58.268070] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:46.915 [2024-11-29 17:10:58.268167] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:46.915 EAL: No free 2048 kB hugepages reported on node 1 00:28:46.915 [2024-11-29 17:10:58.337723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:47.174 [2024-11-29 17:10:58.453894] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:47.174 [2024-11-29 17:10:58.454060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:47.174 [2024-11-29 17:10:58.454079] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:47.174 [2024-11-29 17:10:58.454092] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:47.174 [2024-11-29 17:10:58.455982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:47.174 [2024-11-29 17:10:58.456033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:47.174 [2024-11-29 17:10:58.456119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:47.174 [2024-11-29 17:10:58.456122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:47.174 17:10:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:47.174 17:10:58 -- common/autotest_common.sh@862 -- # return 0 00:28:47.174 17:10:58 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:47.174 17:10:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.174 17:10:58 -- common/autotest_common.sh@10 -- # set +x 00:28:47.174 INFO: Log level set to 20 00:28:47.174 INFO: Requests: 00:28:47.174 { 00:28:47.174 "jsonrpc": "2.0", 00:28:47.174 "method": "nvmf_set_config", 00:28:47.174 "id": 1, 00:28:47.174 "params": { 00:28:47.174 "admin_cmd_passthru": { 00:28:47.174 "identify_ctrlr": true 00:28:47.174 } 00:28:47.174 } 00:28:47.174 } 00:28:47.174 00:28:47.174 INFO: response: 00:28:47.174 { 00:28:47.174 "jsonrpc": "2.0", 00:28:47.174 "id": 1, 00:28:47.174 "result": true 00:28:47.174 } 00:28:47.174 00:28:47.174 17:10:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.174 17:10:58 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:47.174 17:10:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.174 17:10:58 -- common/autotest_common.sh@10 -- # set +x 00:28:47.174 INFO: Setting log level to 20 00:28:47.174 INFO: Setting log level to 20 00:28:47.174 INFO: Log level set to 20 00:28:47.174 INFO: Log level set to 20 00:28:47.174 INFO: Requests: 00:28:47.174 { 00:28:47.174 "jsonrpc": "2.0", 00:28:47.174 "method": "framework_start_init", 00:28:47.174 "id": 1 00:28:47.174 } 00:28:47.174 00:28:47.174 INFO: Requests: 00:28:47.174 { 00:28:47.174 "jsonrpc": "2.0", 00:28:47.174 "method": "framework_start_init", 00:28:47.174 "id": 1 00:28:47.174 } 00:28:47.174 00:28:47.432 [2024-11-29 17:10:58.623186] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:47.432 INFO: response: 00:28:47.432 { 00:28:47.432 "jsonrpc": "2.0", 00:28:47.432 "id": 1, 00:28:47.432 "result": true 00:28:47.432 } 00:28:47.432 00:28:47.432 INFO: response: 00:28:47.432 { 00:28:47.432 "jsonrpc": "2.0", 00:28:47.432 "id": 1, 00:28:47.432 "result": true 00:28:47.432 } 00:28:47.432 00:28:47.432 17:10:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.432 17:10:58 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:47.432 17:10:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.432 17:10:58 -- common/autotest_common.sh@10 -- # set +x 00:28:47.432 INFO: Setting log level to 40 00:28:47.432 INFO: Setting log level to 40 00:28:47.432 INFO: Setting log level to 40 00:28:47.432 [2024-11-29 17:10:58.633117] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:47.432 17:10:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.432 17:10:58 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:47.432 17:10:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:47.432 17:10:58 -- common/autotest_common.sh@10 -- # set +x 00:28:47.432 17:10:58 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:47.432 17:10:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.432 17:10:58 -- common/autotest_common.sh@10 -- # set +x 00:28:50.712 Nvme0n1 00:28:50.712 17:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.712 17:11:01 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:50.712 17:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.712 17:11:01 -- common/autotest_common.sh@10 -- # set +x 00:28:50.712 17:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.712 17:11:01 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:50.712 17:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.712 17:11:01 -- common/autotest_common.sh@10 -- # set +x 00:28:50.712 17:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.712 17:11:01 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:50.712 17:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.712 17:11:01 -- common/autotest_common.sh@10 -- # set +x 00:28:50.712 [2024-11-29 17:11:01.521599] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:50.712 17:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.712 17:11:01 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:50.712 17:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.712 17:11:01 -- common/autotest_common.sh@10 -- # set +x 00:28:50.712 [2024-11-29 17:11:01.529298] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:50.712 [ 00:28:50.712 { 00:28:50.712 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:50.712 "subtype": "Discovery", 00:28:50.712 "listen_addresses": [], 00:28:50.712 "allow_any_host": true, 00:28:50.712 "hosts": [] 00:28:50.712 }, 00:28:50.712 { 00:28:50.712 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:50.712 "subtype": "NVMe", 00:28:50.712 "listen_addresses": [ 00:28:50.712 { 00:28:50.712 "transport": "TCP", 00:28:50.712 "trtype": "TCP", 00:28:50.712 "adrfam": "IPv4", 00:28:50.712 "traddr": "10.0.0.2", 00:28:50.712 "trsvcid": "4420" 00:28:50.712 } 00:28:50.712 ], 00:28:50.712 "allow_any_host": true, 00:28:50.712 "hosts": [], 00:28:50.712 "serial_number": "SPDK00000000000001", 00:28:50.712 "model_number": "SPDK bdev Controller", 00:28:50.712 "max_namespaces": 1, 00:28:50.712 "min_cntlid": 1, 00:28:50.712 "max_cntlid": 65519, 00:28:50.712 "namespaces": [ 00:28:50.712 { 00:28:50.712 "nsid": 1, 00:28:50.712 "bdev_name": "Nvme0n1", 00:28:50.712 "name": "Nvme0n1", 00:28:50.712 "nguid": "A466AD744386459D8BA44AD8DDBA4F26", 00:28:50.712 "uuid": "a466ad74-4386-459d-8ba4-4ad8ddba4f26" 00:28:50.712 } 00:28:50.712 ] 00:28:50.712 } 00:28:50.712 ] 00:28:50.712 17:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.712 17:11:01 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:50.712 17:11:01 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:50.712 17:11:01 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:50.712 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.712 17:11:01 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:50.712 17:11:01 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:50.712 17:11:01 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:50.712 17:11:01 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:50.712 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.712 17:11:01 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:50.712 17:11:01 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:50.712 17:11:01 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:50.712 17:11:01 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:50.712 17:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.712 17:11:01 -- common/autotest_common.sh@10 -- # set +x 00:28:50.712 17:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.712 17:11:01 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:50.712 17:11:01 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:50.712 17:11:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:50.712 17:11:01 -- nvmf/common.sh@116 -- # sync 00:28:50.712 17:11:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:50.712 17:11:01 -- nvmf/common.sh@119 -- # set +e 00:28:50.712 17:11:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:50.712 17:11:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:50.712 rmmod nvme_tcp 00:28:50.712 rmmod nvme_fabrics 00:28:50.712 rmmod nvme_keyring 00:28:50.712 17:11:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:50.712 17:11:01 -- nvmf/common.sh@123 -- # set -e 00:28:50.712 17:11:01 -- nvmf/common.sh@124 -- # return 0 00:28:50.712 17:11:01 -- nvmf/common.sh@477 -- # '[' -n 334999 ']' 00:28:50.712 17:11:01 -- nvmf/common.sh@478 -- # killprocess 334999 00:28:50.712 17:11:01 -- common/autotest_common.sh@936 -- # '[' -z 334999 ']' 00:28:50.712 17:11:01 -- common/autotest_common.sh@940 -- # kill -0 334999 00:28:50.712 17:11:01 -- common/autotest_common.sh@941 -- # uname 00:28:50.712 17:11:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:50.712 17:11:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 334999 00:28:50.712 17:11:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:50.712 17:11:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:50.712 17:11:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 334999' 00:28:50.712 killing process with pid 334999 00:28:50.712 17:11:01 -- common/autotest_common.sh@955 -- # kill 334999 00:28:50.712 [2024-11-29 17:11:01.881801] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:50.712 17:11:01 -- common/autotest_common.sh@960 -- # wait 334999 00:28:52.085 17:11:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:52.085 17:11:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:52.085 17:11:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:52.085 17:11:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:52.085 17:11:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:52.085 17:11:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:52.085 17:11:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:52.085 17:11:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:54.616 17:11:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:54.616 00:28:54.616 real 0m18.016s 00:28:54.616 user 0m26.580s 00:28:54.616 sys 0m2.230s 00:28:54.616 17:11:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:54.616 17:11:05 -- common/autotest_common.sh@10 -- # set +x 00:28:54.616 ************************************ 00:28:54.616 END TEST nvmf_identify_passthru 00:28:54.616 ************************************ 00:28:54.616 17:11:05 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:54.616 17:11:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:54.616 17:11:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:54.616 17:11:05 -- common/autotest_common.sh@10 -- # set +x 00:28:54.616 ************************************ 00:28:54.616 START TEST nvmf_dif 00:28:54.616 ************************************ 00:28:54.616 17:11:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:54.616 * Looking for test storage... 00:28:54.616 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:54.616 17:11:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:54.616 17:11:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:54.616 17:11:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:54.616 17:11:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:54.616 17:11:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:54.616 17:11:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:54.616 17:11:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:54.616 17:11:05 -- scripts/common.sh@335 -- # IFS=.-: 00:28:54.616 17:11:05 -- scripts/common.sh@335 -- # read -ra ver1 00:28:54.616 17:11:05 -- scripts/common.sh@336 -- # IFS=.-: 00:28:54.616 17:11:05 -- scripts/common.sh@336 -- # read -ra ver2 00:28:54.616 17:11:05 -- scripts/common.sh@337 -- # local 'op=<' 00:28:54.616 17:11:05 -- scripts/common.sh@339 -- # ver1_l=2 00:28:54.616 17:11:05 -- scripts/common.sh@340 -- # ver2_l=1 00:28:54.616 17:11:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:54.616 17:11:05 -- scripts/common.sh@343 -- # case "$op" in 00:28:54.616 17:11:05 -- scripts/common.sh@344 -- # : 1 00:28:54.616 17:11:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:54.616 17:11:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:54.616 17:11:05 -- scripts/common.sh@364 -- # decimal 1 00:28:54.616 17:11:05 -- scripts/common.sh@352 -- # local d=1 00:28:54.616 17:11:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:54.616 17:11:05 -- scripts/common.sh@354 -- # echo 1 00:28:54.616 17:11:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:54.616 17:11:05 -- scripts/common.sh@365 -- # decimal 2 00:28:54.616 17:11:05 -- scripts/common.sh@352 -- # local d=2 00:28:54.616 17:11:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:54.616 17:11:05 -- scripts/common.sh@354 -- # echo 2 00:28:54.616 17:11:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:54.616 17:11:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:54.616 17:11:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:54.616 17:11:05 -- scripts/common.sh@367 -- # return 0 00:28:54.616 17:11:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:54.616 17:11:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:54.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:54.616 --rc genhtml_branch_coverage=1 00:28:54.616 --rc genhtml_function_coverage=1 00:28:54.616 --rc genhtml_legend=1 00:28:54.616 --rc geninfo_all_blocks=1 00:28:54.616 --rc geninfo_unexecuted_blocks=1 00:28:54.616 00:28:54.616 ' 00:28:54.616 17:11:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:54.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:54.616 --rc genhtml_branch_coverage=1 00:28:54.616 --rc genhtml_function_coverage=1 00:28:54.616 --rc genhtml_legend=1 00:28:54.616 --rc geninfo_all_blocks=1 00:28:54.616 --rc geninfo_unexecuted_blocks=1 00:28:54.616 00:28:54.616 ' 00:28:54.616 17:11:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:54.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:54.616 --rc genhtml_branch_coverage=1 00:28:54.616 --rc genhtml_function_coverage=1 00:28:54.616 --rc genhtml_legend=1 00:28:54.616 --rc geninfo_all_blocks=1 00:28:54.616 --rc geninfo_unexecuted_blocks=1 00:28:54.616 00:28:54.616 ' 00:28:54.616 17:11:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:54.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:54.616 --rc genhtml_branch_coverage=1 00:28:54.616 --rc genhtml_function_coverage=1 00:28:54.616 --rc genhtml_legend=1 00:28:54.616 --rc geninfo_all_blocks=1 00:28:54.616 --rc geninfo_unexecuted_blocks=1 00:28:54.616 00:28:54.616 ' 00:28:54.616 17:11:05 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:54.616 17:11:05 -- nvmf/common.sh@7 -- # uname -s 00:28:54.616 17:11:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:54.616 17:11:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:54.616 17:11:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:54.616 17:11:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:54.616 17:11:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:54.616 17:11:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:54.616 17:11:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:54.616 17:11:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:54.616 17:11:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:54.616 17:11:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:54.616 17:11:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:54.616 17:11:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:54.616 17:11:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:54.616 17:11:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:54.616 17:11:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:54.616 17:11:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:54.616 17:11:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:54.616 17:11:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:54.616 17:11:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:54.617 17:11:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:54.617 17:11:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:54.617 17:11:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:54.617 17:11:05 -- paths/export.sh@5 -- # export PATH 00:28:54.617 17:11:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:54.617 17:11:05 -- nvmf/common.sh@46 -- # : 0 00:28:54.617 17:11:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:54.617 17:11:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:54.617 17:11:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:54.617 17:11:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:54.617 17:11:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:54.617 17:11:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:54.617 17:11:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:54.617 17:11:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:54.617 17:11:05 -- target/dif.sh@15 -- # NULL_META=16 00:28:54.617 17:11:05 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:54.617 17:11:05 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:54.617 17:11:05 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:54.617 17:11:05 -- target/dif.sh@135 -- # nvmftestinit 00:28:54.617 17:11:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:54.617 17:11:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:54.617 17:11:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:54.617 17:11:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:54.617 17:11:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:54.617 17:11:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:54.617 17:11:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:54.617 17:11:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:54.617 17:11:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:54.617 17:11:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:54.617 17:11:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:54.617 17:11:05 -- common/autotest_common.sh@10 -- # set +x 00:28:56.519 17:11:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:56.519 17:11:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:56.519 17:11:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:56.519 17:11:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:56.519 17:11:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:56.519 17:11:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:56.519 17:11:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:56.519 17:11:07 -- nvmf/common.sh@294 -- # net_devs=() 00:28:56.519 17:11:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:56.519 17:11:07 -- nvmf/common.sh@295 -- # e810=() 00:28:56.519 17:11:07 -- nvmf/common.sh@295 -- # local -ga e810 00:28:56.519 17:11:07 -- nvmf/common.sh@296 -- # x722=() 00:28:56.519 17:11:07 -- nvmf/common.sh@296 -- # local -ga x722 00:28:56.519 17:11:07 -- nvmf/common.sh@297 -- # mlx=() 00:28:56.519 17:11:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:56.519 17:11:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:56.519 17:11:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:56.519 17:11:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:56.519 17:11:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:56.519 17:11:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:56.519 17:11:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:56.519 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:56.519 17:11:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:56.519 17:11:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:56.519 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:56.519 17:11:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:56.519 17:11:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:56.519 17:11:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:56.519 17:11:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:56.519 17:11:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:56.519 17:11:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:56.519 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:56.519 17:11:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:56.519 17:11:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:56.519 17:11:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:56.519 17:11:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:56.519 17:11:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:56.519 17:11:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:56.519 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:56.519 17:11:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:56.519 17:11:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:56.519 17:11:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:56.519 17:11:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:56.519 17:11:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:56.519 17:11:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:56.519 17:11:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:56.519 17:11:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:56.519 17:11:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:56.519 17:11:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:56.519 17:11:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:56.519 17:11:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:56.519 17:11:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:56.519 17:11:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:56.519 17:11:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:56.519 17:11:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:56.519 17:11:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:56.519 17:11:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:56.519 17:11:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:56.519 17:11:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:56.519 17:11:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:56.519 17:11:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:56.519 17:11:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:56.519 17:11:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:56.519 17:11:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:56.519 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:56.519 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.324 ms 00:28:56.519 00:28:56.519 --- 10.0.0.2 ping statistics --- 00:28:56.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:56.519 rtt min/avg/max/mdev = 0.324/0.324/0.324/0.000 ms 00:28:56.519 17:11:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:56.519 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:56.519 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:28:56.519 00:28:56.519 --- 10.0.0.1 ping statistics --- 00:28:56.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:56.519 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:28:56.519 17:11:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:56.519 17:11:07 -- nvmf/common.sh@410 -- # return 0 00:28:56.519 17:11:07 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:56.519 17:11:07 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:57.460 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:57.460 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:57.460 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:57.460 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:57.460 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:57.460 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:57.460 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:57.460 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:57.460 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:57.460 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:57.460 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:57.460 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:57.460 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:57.460 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:57.460 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:57.460 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:57.460 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:57.460 17:11:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:57.460 17:11:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:57.460 17:11:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:57.460 17:11:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:57.460 17:11:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:57.460 17:11:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:57.719 17:11:08 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:57.719 17:11:08 -- target/dif.sh@137 -- # nvmfappstart 00:28:57.719 17:11:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:57.719 17:11:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:57.719 17:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:57.719 17:11:08 -- nvmf/common.sh@469 -- # nvmfpid=338189 00:28:57.719 17:11:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:57.719 17:11:08 -- nvmf/common.sh@470 -- # waitforlisten 338189 00:28:57.719 17:11:08 -- common/autotest_common.sh@829 -- # '[' -z 338189 ']' 00:28:57.719 17:11:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:57.719 17:11:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:57.719 17:11:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:57.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:57.719 17:11:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:57.719 17:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:57.719 [2024-11-29 17:11:08.946786] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:57.719 [2024-11-29 17:11:08.946878] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:57.719 EAL: No free 2048 kB hugepages reported on node 1 00:28:57.719 [2024-11-29 17:11:09.015513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:57.719 [2024-11-29 17:11:09.131058] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:57.719 [2024-11-29 17:11:09.131224] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:57.719 [2024-11-29 17:11:09.131244] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:57.719 [2024-11-29 17:11:09.131268] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:57.719 [2024-11-29 17:11:09.131298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:58.654 17:11:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:58.654 17:11:09 -- common/autotest_common.sh@862 -- # return 0 00:28:58.654 17:11:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:58.654 17:11:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:58.654 17:11:09 -- common/autotest_common.sh@10 -- # set +x 00:28:58.654 17:11:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:58.654 17:11:09 -- target/dif.sh@139 -- # create_transport 00:28:58.654 17:11:09 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:58.654 17:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.654 17:11:09 -- common/autotest_common.sh@10 -- # set +x 00:28:58.654 [2024-11-29 17:11:09.930033] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:58.654 17:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.654 17:11:09 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:58.654 17:11:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:58.654 17:11:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:58.654 17:11:09 -- common/autotest_common.sh@10 -- # set +x 00:28:58.654 ************************************ 00:28:58.654 START TEST fio_dif_1_default 00:28:58.654 ************************************ 00:28:58.654 17:11:09 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:58.654 17:11:09 -- target/dif.sh@86 -- # create_subsystems 0 00:28:58.654 17:11:09 -- target/dif.sh@28 -- # local sub 00:28:58.654 17:11:09 -- target/dif.sh@30 -- # for sub in "$@" 00:28:58.654 17:11:09 -- target/dif.sh@31 -- # create_subsystem 0 00:28:58.654 17:11:09 -- target/dif.sh@18 -- # local sub_id=0 00:28:58.654 17:11:09 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:58.654 17:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.654 17:11:09 -- common/autotest_common.sh@10 -- # set +x 00:28:58.654 bdev_null0 00:28:58.654 17:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.654 17:11:09 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:58.654 17:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.654 17:11:09 -- common/autotest_common.sh@10 -- # set +x 00:28:58.654 17:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.654 17:11:09 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:58.654 17:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.654 17:11:09 -- common/autotest_common.sh@10 -- # set +x 00:28:58.654 17:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.654 17:11:09 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:58.654 17:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.654 17:11:09 -- common/autotest_common.sh@10 -- # set +x 00:28:58.654 [2024-11-29 17:11:09.966256] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:58.654 17:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.654 17:11:09 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:58.654 17:11:09 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:58.654 17:11:09 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:58.654 17:11:09 -- nvmf/common.sh@520 -- # config=() 00:28:58.654 17:11:09 -- nvmf/common.sh@520 -- # local subsystem config 00:28:58.654 17:11:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:58.654 17:11:09 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:58.654 17:11:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:58.654 { 00:28:58.654 "params": { 00:28:58.654 "name": "Nvme$subsystem", 00:28:58.654 "trtype": "$TEST_TRANSPORT", 00:28:58.654 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:58.654 "adrfam": "ipv4", 00:28:58.654 "trsvcid": "$NVMF_PORT", 00:28:58.654 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:58.654 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:58.654 "hdgst": ${hdgst:-false}, 00:28:58.654 "ddgst": ${ddgst:-false} 00:28:58.654 }, 00:28:58.654 "method": "bdev_nvme_attach_controller" 00:28:58.654 } 00:28:58.654 EOF 00:28:58.654 )") 00:28:58.654 17:11:09 -- target/dif.sh@82 -- # gen_fio_conf 00:28:58.654 17:11:09 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:58.654 17:11:09 -- target/dif.sh@54 -- # local file 00:28:58.654 17:11:09 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:58.654 17:11:09 -- target/dif.sh@56 -- # cat 00:28:58.654 17:11:09 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:58.654 17:11:09 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:58.654 17:11:09 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:58.654 17:11:09 -- common/autotest_common.sh@1330 -- # shift 00:28:58.654 17:11:09 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:58.654 17:11:09 -- nvmf/common.sh@542 -- # cat 00:28:58.654 17:11:09 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:58.654 17:11:09 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:58.654 17:11:09 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:58.654 17:11:09 -- target/dif.sh@72 -- # (( file <= files )) 00:28:58.654 17:11:09 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:58.654 17:11:09 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:58.654 17:11:09 -- nvmf/common.sh@544 -- # jq . 00:28:58.654 17:11:09 -- nvmf/common.sh@545 -- # IFS=, 00:28:58.654 17:11:09 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:58.654 "params": { 00:28:58.654 "name": "Nvme0", 00:28:58.654 "trtype": "tcp", 00:28:58.654 "traddr": "10.0.0.2", 00:28:58.654 "adrfam": "ipv4", 00:28:58.654 "trsvcid": "4420", 00:28:58.654 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:58.654 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:58.654 "hdgst": false, 00:28:58.654 "ddgst": false 00:28:58.654 }, 00:28:58.654 "method": "bdev_nvme_attach_controller" 00:28:58.654 }' 00:28:58.654 17:11:09 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:58.654 17:11:09 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:58.654 17:11:09 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:58.654 17:11:09 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:58.654 17:11:09 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:58.654 17:11:09 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:58.654 17:11:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:58.654 17:11:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:58.654 17:11:10 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:58.654 17:11:10 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:58.912 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:58.912 fio-3.35 00:28:58.912 Starting 1 thread 00:28:58.912 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.478 [2024-11-29 17:11:10.740325] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:59.478 [2024-11-29 17:11:10.740408] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:09.443 00:29:09.443 filename0: (groupid=0, jobs=1): err= 0: pid=338553: Fri Nov 29 17:11:20 2024 00:29:09.443 read: IOPS=99, BW=396KiB/s (406kB/s)(3968KiB/10015msec) 00:29:09.443 slat (nsec): min=4670, max=72034, avg=8344.57, stdev=3248.83 00:29:09.443 clat (usec): min=570, max=47415, avg=40354.55, stdev=5108.46 00:29:09.443 lat (usec): min=577, max=47442, avg=40362.89, stdev=5108.53 00:29:09.443 clat percentiles (usec): 00:29:09.443 | 1.00th=[ 611], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:09.443 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:09.443 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:09.443 | 99.00th=[41157], 99.50th=[41157], 99.90th=[47449], 99.95th=[47449], 00:29:09.443 | 99.99th=[47449] 00:29:09.443 bw ( KiB/s): min= 384, max= 512, per=99.70%, avg=395.20, stdev=29.87, samples=20 00:29:09.443 iops : min= 96, max= 128, avg=98.80, stdev= 7.47, samples=20 00:29:09.443 lat (usec) : 750=1.61% 00:29:09.443 lat (msec) : 50=98.39% 00:29:09.443 cpu : usr=91.80%, sys=7.92%, ctx=22, majf=0, minf=300 00:29:09.443 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:09.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:09.443 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:09.443 issued rwts: total=992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:09.443 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:09.443 00:29:09.443 Run status group 0 (all jobs): 00:29:09.443 READ: bw=396KiB/s (406kB/s), 396KiB/s-396KiB/s (406kB/s-406kB/s), io=3968KiB (4063kB), run=10015-10015msec 00:29:10.009 17:11:21 -- target/dif.sh@88 -- # destroy_subsystems 0 00:29:10.009 17:11:21 -- target/dif.sh@43 -- # local sub 00:29:10.009 17:11:21 -- target/dif.sh@45 -- # for sub in "$@" 00:29:10.009 17:11:21 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:10.009 17:11:21 -- target/dif.sh@36 -- # local sub_id=0 00:29:10.009 17:11:21 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 17:11:21 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 00:29:10.009 real 0m11.263s 00:29:10.009 user 0m10.493s 00:29:10.009 sys 0m1.051s 00:29:10.009 17:11:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 ************************************ 00:29:10.009 END TEST fio_dif_1_default 00:29:10.009 ************************************ 00:29:10.009 17:11:21 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:29:10.009 17:11:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:10.009 17:11:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 ************************************ 00:29:10.009 START TEST fio_dif_1_multi_subsystems 00:29:10.009 ************************************ 00:29:10.009 17:11:21 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:29:10.009 17:11:21 -- target/dif.sh@92 -- # local files=1 00:29:10.009 17:11:21 -- target/dif.sh@94 -- # create_subsystems 0 1 00:29:10.009 17:11:21 -- target/dif.sh@28 -- # local sub 00:29:10.009 17:11:21 -- target/dif.sh@30 -- # for sub in "$@" 00:29:10.009 17:11:21 -- target/dif.sh@31 -- # create_subsystem 0 00:29:10.009 17:11:21 -- target/dif.sh@18 -- # local sub_id=0 00:29:10.009 17:11:21 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 bdev_null0 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 17:11:21 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 17:11:21 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 17:11:21 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 [2024-11-29 17:11:21.261091] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 17:11:21 -- target/dif.sh@30 -- # for sub in "$@" 00:29:10.009 17:11:21 -- target/dif.sh@31 -- # create_subsystem 1 00:29:10.009 17:11:21 -- target/dif.sh@18 -- # local sub_id=1 00:29:10.009 17:11:21 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 bdev_null1 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 17:11:21 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 17:11:21 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 17:11:21 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:10.009 17:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.009 17:11:21 -- common/autotest_common.sh@10 -- # set +x 00:29:10.009 17:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.009 17:11:21 -- target/dif.sh@95 -- # fio /dev/fd/62 00:29:10.009 17:11:21 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:10.009 17:11:21 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:10.009 17:11:21 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:29:10.009 17:11:21 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:10.009 17:11:21 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:10.009 17:11:21 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:10.009 17:11:21 -- target/dif.sh@82 -- # gen_fio_conf 00:29:10.009 17:11:21 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:10.009 17:11:21 -- nvmf/common.sh@520 -- # config=() 00:29:10.009 17:11:21 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:10.009 17:11:21 -- nvmf/common.sh@520 -- # local subsystem config 00:29:10.009 17:11:21 -- target/dif.sh@54 -- # local file 00:29:10.009 17:11:21 -- common/autotest_common.sh@1330 -- # shift 00:29:10.009 17:11:21 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:10.009 17:11:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:10.009 17:11:21 -- target/dif.sh@56 -- # cat 00:29:10.009 17:11:21 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:10.009 17:11:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:10.009 { 00:29:10.009 "params": { 00:29:10.009 "name": "Nvme$subsystem", 00:29:10.009 "trtype": "$TEST_TRANSPORT", 00:29:10.009 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:10.009 "adrfam": "ipv4", 00:29:10.009 "trsvcid": "$NVMF_PORT", 00:29:10.009 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:10.009 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:10.009 "hdgst": ${hdgst:-false}, 00:29:10.009 "ddgst": ${ddgst:-false} 00:29:10.009 }, 00:29:10.009 "method": "bdev_nvme_attach_controller" 00:29:10.009 } 00:29:10.009 EOF 00:29:10.009 )") 00:29:10.009 17:11:21 -- nvmf/common.sh@542 -- # cat 00:29:10.010 17:11:21 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:10.010 17:11:21 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:10.010 17:11:21 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:10.010 17:11:21 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:10.010 17:11:21 -- target/dif.sh@72 -- # (( file <= files )) 00:29:10.010 17:11:21 -- target/dif.sh@73 -- # cat 00:29:10.010 17:11:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:10.010 17:11:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:10.010 { 00:29:10.010 "params": { 00:29:10.010 "name": "Nvme$subsystem", 00:29:10.010 "trtype": "$TEST_TRANSPORT", 00:29:10.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:10.010 "adrfam": "ipv4", 00:29:10.010 "trsvcid": "$NVMF_PORT", 00:29:10.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:10.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:10.010 "hdgst": ${hdgst:-false}, 00:29:10.010 "ddgst": ${ddgst:-false} 00:29:10.010 }, 00:29:10.010 "method": "bdev_nvme_attach_controller" 00:29:10.010 } 00:29:10.010 EOF 00:29:10.010 )") 00:29:10.010 17:11:21 -- target/dif.sh@72 -- # (( file++ )) 00:29:10.010 17:11:21 -- target/dif.sh@72 -- # (( file <= files )) 00:29:10.010 17:11:21 -- nvmf/common.sh@542 -- # cat 00:29:10.010 17:11:21 -- nvmf/common.sh@544 -- # jq . 00:29:10.010 17:11:21 -- nvmf/common.sh@545 -- # IFS=, 00:29:10.010 17:11:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:10.010 "params": { 00:29:10.010 "name": "Nvme0", 00:29:10.010 "trtype": "tcp", 00:29:10.010 "traddr": "10.0.0.2", 00:29:10.010 "adrfam": "ipv4", 00:29:10.010 "trsvcid": "4420", 00:29:10.010 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:10.010 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:10.010 "hdgst": false, 00:29:10.010 "ddgst": false 00:29:10.010 }, 00:29:10.010 "method": "bdev_nvme_attach_controller" 00:29:10.010 },{ 00:29:10.010 "params": { 00:29:10.010 "name": "Nvme1", 00:29:10.010 "trtype": "tcp", 00:29:10.010 "traddr": "10.0.0.2", 00:29:10.010 "adrfam": "ipv4", 00:29:10.010 "trsvcid": "4420", 00:29:10.010 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:10.010 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:10.010 "hdgst": false, 00:29:10.010 "ddgst": false 00:29:10.010 }, 00:29:10.010 "method": "bdev_nvme_attach_controller" 00:29:10.010 }' 00:29:10.010 17:11:21 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:10.010 17:11:21 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:10.010 17:11:21 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:10.010 17:11:21 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:10.010 17:11:21 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:10.010 17:11:21 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:10.010 17:11:21 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:10.010 17:11:21 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:10.010 17:11:21 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:10.010 17:11:21 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:10.268 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:10.268 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:10.268 fio-3.35 00:29:10.268 Starting 2 threads 00:29:10.268 EAL: No free 2048 kB hugepages reported on node 1 00:29:10.833 [2024-11-29 17:11:22.101667] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:10.833 [2024-11-29 17:11:22.101751] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:20.802 00:29:20.802 filename0: (groupid=0, jobs=1): err= 0: pid=339994: Fri Nov 29 17:11:32 2024 00:29:20.802 read: IOPS=145, BW=580KiB/s (594kB/s)(5808KiB/10010msec) 00:29:20.802 slat (nsec): min=6834, max=34671, avg=8474.62, stdev=2475.55 00:29:20.802 clat (usec): min=546, max=46244, avg=27547.27, stdev=19176.69 00:29:20.802 lat (usec): min=553, max=46279, avg=27555.74, stdev=19176.54 00:29:20.802 clat percentiles (usec): 00:29:20.802 | 1.00th=[ 562], 5.00th=[ 578], 10.00th=[ 586], 20.00th=[ 603], 00:29:20.802 | 30.00th=[ 635], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:20.802 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:20.802 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46400], 99.95th=[46400], 00:29:20.802 | 99.99th=[46400] 00:29:20.802 bw ( KiB/s): min= 384, max= 832, per=59.58%, avg=579.20, stdev=183.65, samples=20 00:29:20.802 iops : min= 96, max= 208, avg=144.80, stdev=45.91, samples=20 00:29:20.802 lat (usec) : 750=33.06%, 1000=0.48% 00:29:20.802 lat (msec) : 2=0.07%, 50=66.39% 00:29:20.802 cpu : usr=95.53%, sys=4.13%, ctx=16, majf=0, minf=173 00:29:20.802 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:20.802 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.803 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.803 issued rwts: total=1452,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.803 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:20.803 filename1: (groupid=0, jobs=1): err= 0: pid=339995: Fri Nov 29 17:11:32 2024 00:29:20.803 read: IOPS=97, BW=392KiB/s (401kB/s)(3920KiB/10011msec) 00:29:20.803 slat (nsec): min=6794, max=57199, avg=8482.67, stdev=2762.44 00:29:20.803 clat (usec): min=771, max=45256, avg=40831.91, stdev=2580.58 00:29:20.803 lat (usec): min=778, max=45275, avg=40840.40, stdev=2580.59 00:29:20.803 clat percentiles (usec): 00:29:20.803 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:20.803 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:20.803 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:20.803 | 99.00th=[41157], 99.50th=[42206], 99.90th=[45351], 99.95th=[45351], 00:29:20.803 | 99.99th=[45351] 00:29:20.803 bw ( KiB/s): min= 384, max= 416, per=40.13%, avg=390.40, stdev=13.13, samples=20 00:29:20.803 iops : min= 96, max= 104, avg=97.60, stdev= 3.28, samples=20 00:29:20.803 lat (usec) : 1000=0.41% 00:29:20.803 lat (msec) : 50=99.59% 00:29:20.803 cpu : usr=95.45%, sys=4.25%, ctx=13, majf=0, minf=171 00:29:20.803 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:20.803 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.803 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.803 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.803 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:20.803 00:29:20.803 Run status group 0 (all jobs): 00:29:20.803 READ: bw=972KiB/s (995kB/s), 392KiB/s-580KiB/s (401kB/s-594kB/s), io=9728KiB (9961kB), run=10010-10011msec 00:29:21.369 17:11:32 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:21.369 17:11:32 -- target/dif.sh@43 -- # local sub 00:29:21.369 17:11:32 -- target/dif.sh@45 -- # for sub in "$@" 00:29:21.369 17:11:32 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:21.369 17:11:32 -- target/dif.sh@36 -- # local sub_id=0 00:29:21.369 17:11:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:21.369 17:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.369 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.369 17:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.369 17:11:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:21.369 17:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.369 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.369 17:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.369 17:11:32 -- target/dif.sh@45 -- # for sub in "$@" 00:29:21.369 17:11:32 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:21.369 17:11:32 -- target/dif.sh@36 -- # local sub_id=1 00:29:21.369 17:11:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:21.369 17:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.369 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.369 17:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.369 17:11:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:21.369 17:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.369 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.369 17:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.369 00:29:21.369 real 0m11.329s 00:29:21.369 user 0m20.400s 00:29:21.369 sys 0m1.144s 00:29:21.369 17:11:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:21.369 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.369 ************************************ 00:29:21.369 END TEST fio_dif_1_multi_subsystems 00:29:21.369 ************************************ 00:29:21.369 17:11:32 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:21.369 17:11:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:21.369 17:11:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:21.369 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.369 ************************************ 00:29:21.369 START TEST fio_dif_rand_params 00:29:21.369 ************************************ 00:29:21.369 17:11:32 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:21.369 17:11:32 -- target/dif.sh@100 -- # local NULL_DIF 00:29:21.369 17:11:32 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:21.369 17:11:32 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:21.369 17:11:32 -- target/dif.sh@103 -- # bs=128k 00:29:21.369 17:11:32 -- target/dif.sh@103 -- # numjobs=3 00:29:21.369 17:11:32 -- target/dif.sh@103 -- # iodepth=3 00:29:21.369 17:11:32 -- target/dif.sh@103 -- # runtime=5 00:29:21.369 17:11:32 -- target/dif.sh@105 -- # create_subsystems 0 00:29:21.369 17:11:32 -- target/dif.sh@28 -- # local sub 00:29:21.370 17:11:32 -- target/dif.sh@30 -- # for sub in "$@" 00:29:21.370 17:11:32 -- target/dif.sh@31 -- # create_subsystem 0 00:29:21.370 17:11:32 -- target/dif.sh@18 -- # local sub_id=0 00:29:21.370 17:11:32 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:21.370 17:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.370 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.370 bdev_null0 00:29:21.370 17:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.370 17:11:32 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:21.370 17:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.370 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.370 17:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.370 17:11:32 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:21.370 17:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.370 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.370 17:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.370 17:11:32 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:21.370 17:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.370 17:11:32 -- common/autotest_common.sh@10 -- # set +x 00:29:21.370 [2024-11-29 17:11:32.617478] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:21.370 17:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.370 17:11:32 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:21.370 17:11:32 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:21.370 17:11:32 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:21.370 17:11:32 -- nvmf/common.sh@520 -- # config=() 00:29:21.370 17:11:32 -- nvmf/common.sh@520 -- # local subsystem config 00:29:21.370 17:11:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:21.370 17:11:32 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:21.370 17:11:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:21.370 { 00:29:21.370 "params": { 00:29:21.370 "name": "Nvme$subsystem", 00:29:21.370 "trtype": "$TEST_TRANSPORT", 00:29:21.370 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:21.370 "adrfam": "ipv4", 00:29:21.370 "trsvcid": "$NVMF_PORT", 00:29:21.370 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:21.370 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:21.370 "hdgst": ${hdgst:-false}, 00:29:21.370 "ddgst": ${ddgst:-false} 00:29:21.370 }, 00:29:21.370 "method": "bdev_nvme_attach_controller" 00:29:21.370 } 00:29:21.370 EOF 00:29:21.370 )") 00:29:21.370 17:11:32 -- target/dif.sh@82 -- # gen_fio_conf 00:29:21.370 17:11:32 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:21.370 17:11:32 -- target/dif.sh@54 -- # local file 00:29:21.370 17:11:32 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:21.370 17:11:32 -- target/dif.sh@56 -- # cat 00:29:21.370 17:11:32 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:21.370 17:11:32 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:21.370 17:11:32 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:21.370 17:11:32 -- common/autotest_common.sh@1330 -- # shift 00:29:21.370 17:11:32 -- nvmf/common.sh@542 -- # cat 00:29:21.370 17:11:32 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:21.370 17:11:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:21.370 17:11:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:21.370 17:11:32 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:21.370 17:11:32 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:21.370 17:11:32 -- target/dif.sh@72 -- # (( file <= files )) 00:29:21.370 17:11:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:21.370 17:11:32 -- nvmf/common.sh@544 -- # jq . 00:29:21.370 17:11:32 -- nvmf/common.sh@545 -- # IFS=, 00:29:21.370 17:11:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:21.370 "params": { 00:29:21.370 "name": "Nvme0", 00:29:21.370 "trtype": "tcp", 00:29:21.370 "traddr": "10.0.0.2", 00:29:21.370 "adrfam": "ipv4", 00:29:21.370 "trsvcid": "4420", 00:29:21.370 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:21.370 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:21.370 "hdgst": false, 00:29:21.370 "ddgst": false 00:29:21.370 }, 00:29:21.370 "method": "bdev_nvme_attach_controller" 00:29:21.370 }' 00:29:21.370 17:11:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:21.370 17:11:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:21.370 17:11:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:21.370 17:11:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:21.370 17:11:32 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:21.370 17:11:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:21.370 17:11:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:21.370 17:11:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:21.370 17:11:32 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:21.370 17:11:32 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:21.628 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:21.628 ... 00:29:21.628 fio-3.35 00:29:21.628 Starting 3 threads 00:29:21.628 EAL: No free 2048 kB hugepages reported on node 1 00:29:22.194 [2024-11-29 17:11:33.421554] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:22.194 [2024-11-29 17:11:33.421629] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:27.457 00:29:27.457 filename0: (groupid=0, jobs=1): err= 0: pid=341429: Fri Nov 29 17:11:38 2024 00:29:27.457 read: IOPS=241, BW=30.2MiB/s (31.6MB/s)(152MiB/5045msec) 00:29:27.457 slat (nsec): min=3962, max=52432, avg=14761.12, stdev=4573.91 00:29:27.457 clat (usec): min=4924, max=53702, avg=12370.29, stdev=4385.22 00:29:27.457 lat (usec): min=4935, max=53715, avg=12385.05, stdev=4385.22 00:29:27.457 clat percentiles (usec): 00:29:27.457 | 1.00th=[ 6783], 5.00th=[ 9110], 10.00th=[ 9896], 20.00th=[10683], 00:29:27.457 | 30.00th=[11076], 40.00th=[11469], 50.00th=[11863], 60.00th=[12256], 00:29:27.457 | 70.00th=[12780], 80.00th=[13435], 90.00th=[14353], 95.00th=[15270], 00:29:27.457 | 99.00th=[45876], 99.50th=[50070], 99.90th=[52167], 99.95th=[53740], 00:29:27.457 | 99.99th=[53740] 00:29:27.457 bw ( KiB/s): min=27648, max=33024, per=35.05%, avg=31129.60, stdev=1474.07, samples=10 00:29:27.457 iops : min= 216, max= 258, avg=243.20, stdev=11.52, samples=10 00:29:27.457 lat (msec) : 10=10.34%, 20=88.51%, 50=0.57%, 100=0.57% 00:29:27.457 cpu : usr=93.38%, sys=6.11%, ctx=8, majf=0, minf=105 00:29:27.457 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:27.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:27.457 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:27.457 issued rwts: total=1218,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:27.457 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:27.457 filename0: (groupid=0, jobs=1): err= 0: pid=341430: Fri Nov 29 17:11:38 2024 00:29:27.457 read: IOPS=228, BW=28.6MiB/s (30.0MB/s)(143MiB/5005msec) 00:29:27.457 slat (nsec): min=4673, max=41629, avg=14357.48, stdev=4044.64 00:29:27.457 clat (usec): min=5042, max=53444, avg=13083.12, stdev=3798.03 00:29:27.457 lat (usec): min=5053, max=53466, avg=13097.48, stdev=3798.17 00:29:27.457 clat percentiles (usec): 00:29:27.457 | 1.00th=[ 6783], 5.00th=[ 9372], 10.00th=[10421], 20.00th=[11076], 00:29:27.457 | 30.00th=[11731], 40.00th=[12256], 50.00th=[12780], 60.00th=[13435], 00:29:27.457 | 70.00th=[13960], 80.00th=[14615], 90.00th=[15664], 95.00th=[16319], 00:29:27.457 | 99.00th=[17957], 99.50th=[45876], 99.90th=[53216], 99.95th=[53216], 00:29:27.457 | 99.99th=[53216] 00:29:27.457 bw ( KiB/s): min=24576, max=31488, per=32.95%, avg=29260.80, stdev=1877.53, samples=10 00:29:27.457 iops : min= 192, max= 246, avg=228.60, stdev=14.67, samples=10 00:29:27.457 lat (msec) : 10=7.68%, 20=91.54%, 50=0.52%, 100=0.26% 00:29:27.457 cpu : usr=93.96%, sys=5.52%, ctx=12, majf=0, minf=114 00:29:27.457 IO depths : 1=0.7%, 2=99.3%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:27.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:27.457 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:27.457 issued rwts: total=1146,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:27.457 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:27.457 filename0: (groupid=0, jobs=1): err= 0: pid=341431: Fri Nov 29 17:11:38 2024 00:29:27.457 read: IOPS=226, BW=28.4MiB/s (29.7MB/s)(142MiB/5005msec) 00:29:27.457 slat (usec): min=4, max=668, avg=17.63, stdev=19.88 00:29:27.457 clat (usec): min=4669, max=56017, avg=13192.60, stdev=5556.38 00:29:27.457 lat (usec): min=4681, max=56029, avg=13210.22, stdev=5556.02 00:29:27.457 clat percentiles (usec): 00:29:27.457 | 1.00th=[ 7898], 5.00th=[ 9896], 10.00th=[10421], 20.00th=[11076], 00:29:27.457 | 30.00th=[11469], 40.00th=[11994], 50.00th=[12256], 60.00th=[12911], 00:29:27.457 | 70.00th=[13435], 80.00th=[14091], 90.00th=[15139], 95.00th=[16057], 00:29:27.457 | 99.00th=[51643], 99.50th=[53216], 99.90th=[55837], 99.95th=[55837], 00:29:27.457 | 99.99th=[55837] 00:29:27.457 bw ( KiB/s): min=24320, max=31744, per=32.66%, avg=29004.80, stdev=2560.14, samples=10 00:29:27.457 iops : min= 190, max= 248, avg=226.60, stdev=20.00, samples=10 00:29:27.457 lat (msec) : 10=5.81%, 20=92.34%, 50=0.53%, 100=1.32% 00:29:27.457 cpu : usr=94.86%, sys=4.60%, ctx=12, majf=0, minf=105 00:29:27.457 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:27.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:27.457 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:27.457 issued rwts: total=1136,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:27.457 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:27.457 00:29:27.457 Run status group 0 (all jobs): 00:29:27.457 READ: bw=86.7MiB/s (90.9MB/s), 28.4MiB/s-30.2MiB/s (29.7MB/s-31.6MB/s), io=438MiB (459MB), run=5005-5045msec 00:29:27.457 17:11:38 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:27.457 17:11:38 -- target/dif.sh@43 -- # local sub 00:29:27.457 17:11:38 -- target/dif.sh@45 -- # for sub in "$@" 00:29:27.457 17:11:38 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:27.457 17:11:38 -- target/dif.sh@36 -- # local sub_id=0 00:29:27.457 17:11:38 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:27.457 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.457 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.457 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.457 17:11:38 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:27.457 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.457 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.457 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.457 17:11:38 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:27.457 17:11:38 -- target/dif.sh@109 -- # bs=4k 00:29:27.457 17:11:38 -- target/dif.sh@109 -- # numjobs=8 00:29:27.457 17:11:38 -- target/dif.sh@109 -- # iodepth=16 00:29:27.457 17:11:38 -- target/dif.sh@109 -- # runtime= 00:29:27.457 17:11:38 -- target/dif.sh@109 -- # files=2 00:29:27.457 17:11:38 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:27.457 17:11:38 -- target/dif.sh@28 -- # local sub 00:29:27.457 17:11:38 -- target/dif.sh@30 -- # for sub in "$@" 00:29:27.457 17:11:38 -- target/dif.sh@31 -- # create_subsystem 0 00:29:27.457 17:11:38 -- target/dif.sh@18 -- # local sub_id=0 00:29:27.457 17:11:38 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:27.457 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.457 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.457 bdev_null0 00:29:27.457 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.457 17:11:38 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:27.457 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.457 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.457 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.457 17:11:38 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:27.457 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.457 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.457 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.457 17:11:38 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:27.457 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.457 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.457 [2024-11-29 17:11:38.856838] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:27.457 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.458 17:11:38 -- target/dif.sh@30 -- # for sub in "$@" 00:29:27.458 17:11:38 -- target/dif.sh@31 -- # create_subsystem 1 00:29:27.458 17:11:38 -- target/dif.sh@18 -- # local sub_id=1 00:29:27.458 17:11:38 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:27.458 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.458 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.458 bdev_null1 00:29:27.458 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.458 17:11:38 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:27.458 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.458 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.458 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.458 17:11:38 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:27.458 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.458 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.458 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.458 17:11:38 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:27.458 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.458 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.716 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.716 17:11:38 -- target/dif.sh@30 -- # for sub in "$@" 00:29:27.716 17:11:38 -- target/dif.sh@31 -- # create_subsystem 2 00:29:27.716 17:11:38 -- target/dif.sh@18 -- # local sub_id=2 00:29:27.716 17:11:38 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:27.716 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.716 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.716 bdev_null2 00:29:27.716 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.716 17:11:38 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:27.716 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.716 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.716 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.716 17:11:38 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:27.716 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.716 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.716 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.716 17:11:38 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:27.716 17:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.716 17:11:38 -- common/autotest_common.sh@10 -- # set +x 00:29:27.716 17:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.716 17:11:38 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:27.716 17:11:38 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:27.716 17:11:38 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:27.716 17:11:38 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:27.716 17:11:38 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:27.716 17:11:38 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:27.716 17:11:38 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:27.716 17:11:38 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:27.716 17:11:38 -- target/dif.sh@82 -- # gen_fio_conf 00:29:27.716 17:11:38 -- nvmf/common.sh@520 -- # config=() 00:29:27.716 17:11:38 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:27.716 17:11:38 -- nvmf/common.sh@520 -- # local subsystem config 00:29:27.716 17:11:38 -- common/autotest_common.sh@1330 -- # shift 00:29:27.716 17:11:38 -- target/dif.sh@54 -- # local file 00:29:27.716 17:11:38 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:27.716 17:11:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:27.716 17:11:38 -- target/dif.sh@56 -- # cat 00:29:27.716 17:11:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:27.716 17:11:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:27.716 { 00:29:27.716 "params": { 00:29:27.716 "name": "Nvme$subsystem", 00:29:27.716 "trtype": "$TEST_TRANSPORT", 00:29:27.716 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:27.716 "adrfam": "ipv4", 00:29:27.716 "trsvcid": "$NVMF_PORT", 00:29:27.716 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:27.716 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:27.716 "hdgst": ${hdgst:-false}, 00:29:27.716 "ddgst": ${ddgst:-false} 00:29:27.716 }, 00:29:27.716 "method": "bdev_nvme_attach_controller" 00:29:27.716 } 00:29:27.716 EOF 00:29:27.716 )") 00:29:27.716 17:11:38 -- nvmf/common.sh@542 -- # cat 00:29:27.716 17:11:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:27.716 17:11:38 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:27.716 17:11:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:27.716 17:11:38 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:27.716 17:11:38 -- target/dif.sh@72 -- # (( file <= files )) 00:29:27.716 17:11:38 -- target/dif.sh@73 -- # cat 00:29:27.716 17:11:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:27.716 17:11:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:27.716 { 00:29:27.716 "params": { 00:29:27.716 "name": "Nvme$subsystem", 00:29:27.717 "trtype": "$TEST_TRANSPORT", 00:29:27.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:27.717 "adrfam": "ipv4", 00:29:27.717 "trsvcid": "$NVMF_PORT", 00:29:27.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:27.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:27.717 "hdgst": ${hdgst:-false}, 00:29:27.717 "ddgst": ${ddgst:-false} 00:29:27.717 }, 00:29:27.717 "method": "bdev_nvme_attach_controller" 00:29:27.717 } 00:29:27.717 EOF 00:29:27.717 )") 00:29:27.717 17:11:38 -- target/dif.sh@72 -- # (( file++ )) 00:29:27.717 17:11:38 -- target/dif.sh@72 -- # (( file <= files )) 00:29:27.717 17:11:38 -- target/dif.sh@73 -- # cat 00:29:27.717 17:11:38 -- nvmf/common.sh@542 -- # cat 00:29:27.717 17:11:38 -- target/dif.sh@72 -- # (( file++ )) 00:29:27.717 17:11:38 -- target/dif.sh@72 -- # (( file <= files )) 00:29:27.717 17:11:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:27.717 17:11:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:27.717 { 00:29:27.717 "params": { 00:29:27.717 "name": "Nvme$subsystem", 00:29:27.717 "trtype": "$TEST_TRANSPORT", 00:29:27.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:27.717 "adrfam": "ipv4", 00:29:27.717 "trsvcid": "$NVMF_PORT", 00:29:27.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:27.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:27.717 "hdgst": ${hdgst:-false}, 00:29:27.717 "ddgst": ${ddgst:-false} 00:29:27.717 }, 00:29:27.717 "method": "bdev_nvme_attach_controller" 00:29:27.717 } 00:29:27.717 EOF 00:29:27.717 )") 00:29:27.717 17:11:38 -- nvmf/common.sh@542 -- # cat 00:29:27.717 17:11:38 -- nvmf/common.sh@544 -- # jq . 00:29:27.717 17:11:38 -- nvmf/common.sh@545 -- # IFS=, 00:29:27.717 17:11:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:27.717 "params": { 00:29:27.717 "name": "Nvme0", 00:29:27.717 "trtype": "tcp", 00:29:27.717 "traddr": "10.0.0.2", 00:29:27.717 "adrfam": "ipv4", 00:29:27.717 "trsvcid": "4420", 00:29:27.717 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:27.717 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:27.717 "hdgst": false, 00:29:27.717 "ddgst": false 00:29:27.717 }, 00:29:27.717 "method": "bdev_nvme_attach_controller" 00:29:27.717 },{ 00:29:27.717 "params": { 00:29:27.717 "name": "Nvme1", 00:29:27.717 "trtype": "tcp", 00:29:27.717 "traddr": "10.0.0.2", 00:29:27.717 "adrfam": "ipv4", 00:29:27.717 "trsvcid": "4420", 00:29:27.717 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:27.717 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:27.717 "hdgst": false, 00:29:27.717 "ddgst": false 00:29:27.717 }, 00:29:27.717 "method": "bdev_nvme_attach_controller" 00:29:27.717 },{ 00:29:27.717 "params": { 00:29:27.717 "name": "Nvme2", 00:29:27.717 "trtype": "tcp", 00:29:27.717 "traddr": "10.0.0.2", 00:29:27.717 "adrfam": "ipv4", 00:29:27.717 "trsvcid": "4420", 00:29:27.717 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:27.717 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:27.717 "hdgst": false, 00:29:27.717 "ddgst": false 00:29:27.717 }, 00:29:27.717 "method": "bdev_nvme_attach_controller" 00:29:27.717 }' 00:29:27.717 17:11:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:27.717 17:11:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:27.717 17:11:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:27.717 17:11:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:27.717 17:11:38 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:27.717 17:11:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:27.717 17:11:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:27.717 17:11:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:27.717 17:11:38 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:27.717 17:11:38 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:27.975 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:27.976 ... 00:29:27.976 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:27.976 ... 00:29:27.976 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:27.976 ... 00:29:27.976 fio-3.35 00:29:27.976 Starting 24 threads 00:29:27.976 EAL: No free 2048 kB hugepages reported on node 1 00:29:28.912 [2024-11-29 17:11:40.101557] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:28.912 [2024-11-29 17:11:40.101634] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:38.892 00:29:38.892 filename0: (groupid=0, jobs=1): err= 0: pid=342322: Fri Nov 29 17:11:50 2024 00:29:38.892 read: IOPS=51, BW=205KiB/s (209kB/s)(2048KiB/10011msec) 00:29:38.892 slat (nsec): min=3655, max=63590, avg=30531.83, stdev=10542.20 00:29:38.892 clat (msec): min=95, max=414, avg=312.54, stdev=64.92 00:29:38.892 lat (msec): min=95, max=414, avg=312.57, stdev=64.93 00:29:38.892 clat percentiles (msec): 00:29:38.892 | 1.00th=[ 171], 5.00th=[ 199], 10.00th=[ 203], 20.00th=[ 228], 00:29:38.892 | 30.00th=[ 292], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.892 | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 372], 95.00th=[ 384], 00:29:38.892 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:29:38.892 | 99.99th=[ 414] 00:29:38.892 bw ( KiB/s): min= 128, max= 384, per=3.90%, avg=198.40, stdev=77.59, samples=20 00:29:38.892 iops : min= 32, max= 96, avg=49.60, stdev=19.40, samples=20 00:29:38.892 lat (msec) : 100=0.39%, 250=21.09%, 500=78.52% 00:29:38.892 cpu : usr=98.45%, sys=1.18%, ctx=16, majf=0, minf=32 00:29:38.892 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:38.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.892 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.892 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.892 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.892 filename0: (groupid=0, jobs=1): err= 0: pid=342323: Fri Nov 29 17:11:50 2024 00:29:38.892 read: IOPS=62, BW=249KiB/s (255kB/s)(2496KiB/10035msec) 00:29:38.892 slat (nsec): min=4409, max=84750, avg=26190.02, stdev=20129.32 00:29:38.892 clat (msec): min=93, max=393, avg=256.99, stdev=82.96 00:29:38.892 lat (msec): min=93, max=393, avg=257.02, stdev=82.96 00:29:38.892 clat percentiles (msec): 00:29:38.892 | 1.00th=[ 94], 5.00th=[ 134], 10.00th=[ 161], 20.00th=[ 174], 00:29:38.892 | 30.00th=[ 201], 40.00th=[ 220], 50.00th=[ 247], 60.00th=[ 296], 00:29:38.892 | 70.00th=[ 317], 80.00th=[ 351], 90.00th=[ 368], 95.00th=[ 384], 00:29:38.892 | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 393], 99.95th=[ 393], 00:29:38.892 | 99.99th=[ 393] 00:29:38.892 bw ( KiB/s): min= 128, max= 384, per=4.79%, avg=243.20, stdev=91.93, samples=20 00:29:38.892 iops : min= 32, max= 96, avg=60.80, stdev=22.98, samples=20 00:29:38.892 lat (msec) : 100=2.56%, 250=51.60%, 500=45.83% 00:29:38.892 cpu : usr=98.46%, sys=1.01%, ctx=60, majf=0, minf=37 00:29:38.892 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:38.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.892 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.892 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.892 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.892 filename0: (groupid=0, jobs=1): err= 0: pid=342324: Fri Nov 29 17:11:50 2024 00:29:38.892 read: IOPS=52, BW=211KiB/s (216kB/s)(2112KiB/10031msec) 00:29:38.892 slat (usec): min=8, max=128, avg=36.73, stdev=17.66 00:29:38.892 clat (msec): min=88, max=434, avg=303.60, stdev=77.02 00:29:38.892 lat (msec): min=88, max=434, avg=303.63, stdev=77.02 00:29:38.892 clat percentiles (msec): 00:29:38.892 | 1.00th=[ 89], 5.00th=[ 174], 10.00th=[ 199], 20.00th=[ 226], 00:29:38.892 | 30.00th=[ 288], 40.00th=[ 305], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.892 | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 384], 95.00th=[ 384], 00:29:38.892 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 435], 99.95th=[ 435], 00:29:38.892 | 99.99th=[ 435] 00:29:38.892 bw ( KiB/s): min= 128, max= 384, per=4.02%, avg=204.80, stdev=75.33, samples=20 00:29:38.892 iops : min= 32, max= 96, avg=51.20, stdev=18.83, samples=20 00:29:38.892 lat (msec) : 100=3.03%, 250=24.24%, 500=72.73% 00:29:38.892 cpu : usr=98.49%, sys=0.99%, ctx=16, majf=0, minf=34 00:29:38.892 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:29:38.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.892 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.892 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.892 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.892 filename0: (groupid=0, jobs=1): err= 0: pid=342325: Fri Nov 29 17:11:50 2024 00:29:38.892 read: IOPS=54, BW=219KiB/s (224kB/s)(2200KiB/10039msec) 00:29:38.892 slat (usec): min=4, max=137, avg=68.85, stdev=32.90 00:29:38.892 clat (msec): min=45, max=382, avg=291.20, stdev=79.59 00:29:38.892 lat (msec): min=45, max=382, avg=291.27, stdev=79.61 00:29:38.892 clat percentiles (msec): 00:29:38.892 | 1.00th=[ 46], 5.00th=[ 129], 10.00th=[ 197], 20.00th=[ 201], 00:29:38.892 | 30.00th=[ 234], 40.00th=[ 300], 50.00th=[ 317], 60.00th=[ 330], 00:29:38.892 | 70.00th=[ 351], 80.00th=[ 363], 90.00th=[ 368], 95.00th=[ 380], 00:29:38.892 | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:29:38.892 | 99.99th=[ 384] 00:29:38.892 bw ( KiB/s): min= 128, max= 384, per=4.20%, avg=213.60, stdev=73.10, samples=20 00:29:38.892 iops : min= 32, max= 96, avg=53.40, stdev=18.27, samples=20 00:29:38.892 lat (msec) : 50=1.09%, 100=2.91%, 250=26.55%, 500=69.45% 00:29:38.892 cpu : usr=98.47%, sys=0.98%, ctx=18, majf=0, minf=61 00:29:38.892 IO depths : 1=5.3%, 2=11.5%, 4=24.7%, 8=51.3%, 16=7.3%, 32=0.0%, >=64=0.0% 00:29:38.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.892 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.892 issued rwts: total=550,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.893 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.893 filename0: (groupid=0, jobs=1): err= 0: pid=342326: Fri Nov 29 17:11:50 2024 00:29:38.893 read: IOPS=52, BW=211KiB/s (216kB/s)(2112KiB/10004msec) 00:29:38.893 slat (usec): min=7, max=109, avg=25.31, stdev=23.99 00:29:38.893 clat (msec): min=5, max=430, avg=302.95, stdev=85.76 00:29:38.893 lat (msec): min=5, max=430, avg=302.98, stdev=85.75 00:29:38.893 clat percentiles (msec): 00:29:38.893 | 1.00th=[ 6], 5.00th=[ 129], 10.00th=[ 201], 20.00th=[ 224], 00:29:38.893 | 30.00th=[ 292], 40.00th=[ 317], 50.00th=[ 326], 60.00th=[ 351], 00:29:38.893 | 70.00th=[ 359], 80.00th=[ 368], 90.00th=[ 380], 95.00th=[ 393], 00:29:38.893 | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 430], 99.95th=[ 430], 00:29:38.893 | 99.99th=[ 430] 00:29:38.893 bw ( KiB/s): min= 128, max= 368, per=3.98%, avg=202.11, stdev=73.94, samples=19 00:29:38.893 iops : min= 32, max= 92, avg=50.53, stdev=18.49, samples=19 00:29:38.893 lat (msec) : 10=3.03%, 250=21.21%, 500=75.76% 00:29:38.893 cpu : usr=98.70%, sys=0.89%, ctx=20, majf=0, minf=30 00:29:38.893 IO depths : 1=2.5%, 2=8.7%, 4=25.0%, 8=53.8%, 16=10.0%, 32=0.0%, >=64=0.0% 00:29:38.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.893 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.893 filename0: (groupid=0, jobs=1): err= 0: pid=342327: Fri Nov 29 17:11:50 2024 00:29:38.893 read: IOPS=52, BW=211KiB/s (216kB/s)(2112KiB/10005msec) 00:29:38.893 slat (usec): min=5, max=130, avg=65.95, stdev=30.95 00:29:38.893 clat (msec): min=5, max=573, avg=302.59, stdev=83.19 00:29:38.893 lat (msec): min=5, max=573, avg=302.65, stdev=83.20 00:29:38.893 clat percentiles (msec): 00:29:38.893 | 1.00th=[ 9], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 226], 00:29:38.893 | 30.00th=[ 284], 40.00th=[ 305], 50.00th=[ 330], 60.00th=[ 342], 00:29:38.893 | 70.00th=[ 351], 80.00th=[ 359], 90.00th=[ 376], 95.00th=[ 384], 00:29:38.893 | 99.00th=[ 414], 99.50th=[ 502], 99.90th=[ 575], 99.95th=[ 575], 00:29:38.893 | 99.99th=[ 575] 00:29:38.893 bw ( KiB/s): min= 128, max= 256, per=3.98%, avg=202.11, stdev=64.93, samples=19 00:29:38.893 iops : min= 32, max= 64, avg=50.53, stdev=16.23, samples=19 00:29:38.893 lat (msec) : 10=3.03%, 250=21.97%, 500=74.24%, 750=0.76% 00:29:38.893 cpu : usr=98.78%, sys=0.79%, ctx=71, majf=0, minf=31 00:29:38.893 IO depths : 1=5.5%, 2=11.7%, 4=25.0%, 8=50.8%, 16=7.0%, 32=0.0%, >=64=0.0% 00:29:38.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.893 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.893 filename0: (groupid=0, jobs=1): err= 0: pid=342328: Fri Nov 29 17:11:50 2024 00:29:38.893 read: IOPS=51, BW=204KiB/s (209kB/s)(2048KiB/10016msec) 00:29:38.893 slat (nsec): min=13517, max=78586, avg=33567.53, stdev=10505.81 00:29:38.893 clat (msec): min=197, max=436, avg=312.69, stdev=63.56 00:29:38.893 lat (msec): min=197, max=436, avg=312.73, stdev=63.56 00:29:38.893 clat percentiles (msec): 00:29:38.893 | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 228], 00:29:38.893 | 30.00th=[ 292], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.893 | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 372], 95.00th=[ 384], 00:29:38.893 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 439], 99.95th=[ 439], 00:29:38.893 | 99.99th=[ 439] 00:29:38.893 bw ( KiB/s): min= 128, max= 384, per=3.90%, avg=198.40, stdev=77.42, samples=20 00:29:38.893 iops : min= 32, max= 96, avg=49.60, stdev=19.35, samples=20 00:29:38.893 lat (msec) : 250=25.00%, 500=75.00% 00:29:38.893 cpu : usr=98.33%, sys=1.10%, ctx=168, majf=0, minf=35 00:29:38.893 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:38.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.893 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.893 filename0: (groupid=0, jobs=1): err= 0: pid=342329: Fri Nov 29 17:11:50 2024 00:29:38.893 read: IOPS=51, BW=204KiB/s (209kB/s)(2048KiB/10016msec) 00:29:38.893 slat (nsec): min=9237, max=83530, avg=36711.74, stdev=12172.23 00:29:38.893 clat (msec): min=197, max=472, avg=312.68, stdev=63.54 00:29:38.893 lat (msec): min=197, max=472, avg=312.72, stdev=63.54 00:29:38.893 clat percentiles (msec): 00:29:38.893 | 1.00th=[ 199], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 228], 00:29:38.893 | 30.00th=[ 292], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.893 | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 372], 95.00th=[ 384], 00:29:38.893 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 472], 99.95th=[ 472], 00:29:38.893 | 99.99th=[ 472] 00:29:38.893 bw ( KiB/s): min= 128, max= 368, per=3.90%, avg=198.40, stdev=74.76, samples=20 00:29:38.893 iops : min= 32, max= 92, avg=49.60, stdev=18.69, samples=20 00:29:38.893 lat (msec) : 250=25.00%, 500=75.00% 00:29:38.893 cpu : usr=98.50%, sys=1.00%, ctx=57, majf=0, minf=30 00:29:38.893 IO depths : 1=3.9%, 2=10.2%, 4=25.0%, 8=52.3%, 16=8.6%, 32=0.0%, >=64=0.0% 00:29:38.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.893 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.893 filename1: (groupid=0, jobs=1): err= 0: pid=342330: Fri Nov 29 17:11:50 2024 00:29:38.893 read: IOPS=51, BW=205KiB/s (210kB/s)(2048KiB/10006msec) 00:29:38.893 slat (nsec): min=8280, max=93870, avg=26567.99, stdev=11786.30 00:29:38.893 clat (msec): min=88, max=449, avg=312.39, stdev=65.94 00:29:38.893 lat (msec): min=88, max=449, avg=312.41, stdev=65.94 00:29:38.893 clat percentiles (msec): 00:29:38.893 | 1.00th=[ 134], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 245], 00:29:38.893 | 30.00th=[ 288], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.893 | 70.00th=[ 359], 80.00th=[ 363], 90.00th=[ 384], 95.00th=[ 397], 00:29:38.893 | 99.00th=[ 414], 99.50th=[ 435], 99.90th=[ 451], 99.95th=[ 451], 00:29:38.893 | 99.99th=[ 451] 00:29:38.893 bw ( KiB/s): min= 128, max= 256, per=3.98%, avg=202.05, stdev=63.33, samples=19 00:29:38.893 iops : min= 32, max= 64, avg=50.47, stdev=15.80, samples=19 00:29:38.893 lat (msec) : 100=0.78%, 250=20.70%, 500=78.52% 00:29:38.893 cpu : usr=98.60%, sys=0.97%, ctx=33, majf=0, minf=37 00:29:38.893 IO depths : 1=4.5%, 2=10.7%, 4=25.0%, 8=51.8%, 16=8.0%, 32=0.0%, >=64=0.0% 00:29:38.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.893 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.893 filename1: (groupid=0, jobs=1): err= 0: pid=342331: Fri Nov 29 17:11:50 2024 00:29:38.893 read: IOPS=51, BW=204KiB/s (209kB/s)(2048KiB/10016msec) 00:29:38.893 slat (usec): min=10, max=111, avg=40.26, stdev=16.38 00:29:38.893 clat (msec): min=197, max=414, avg=312.61, stdev=63.15 00:29:38.893 lat (msec): min=197, max=414, avg=312.65, stdev=63.16 00:29:38.893 clat percentiles (msec): 00:29:38.893 | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 228], 00:29:38.893 | 30.00th=[ 292], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.893 | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 372], 95.00th=[ 384], 00:29:38.893 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:29:38.893 | 99.99th=[ 414] 00:29:38.893 bw ( KiB/s): min= 128, max= 384, per=3.90%, avg=198.40, stdev=77.42, samples=20 00:29:38.893 iops : min= 32, max= 96, avg=49.60, stdev=19.35, samples=20 00:29:38.893 lat (msec) : 250=25.00%, 500=75.00% 00:29:38.893 cpu : usr=98.38%, sys=1.00%, ctx=31, majf=0, minf=38 00:29:38.893 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:38.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.893 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.893 filename1: (groupid=0, jobs=1): err= 0: pid=342332: Fri Nov 29 17:11:50 2024 00:29:38.893 read: IOPS=58, BW=236KiB/s (242kB/s)(2368KiB/10035msec) 00:29:38.893 slat (nsec): min=5721, max=83511, avg=25495.16, stdev=15666.94 00:29:38.893 clat (msec): min=92, max=413, avg=270.89, stdev=78.93 00:29:38.893 lat (msec): min=92, max=413, avg=270.92, stdev=78.93 00:29:38.893 clat percentiles (msec): 00:29:38.893 | 1.00th=[ 93], 5.00th=[ 120], 10.00th=[ 163], 20.00th=[ 199], 00:29:38.893 | 30.00th=[ 220], 40.00th=[ 232], 50.00th=[ 292], 60.00th=[ 309], 00:29:38.893 | 70.00th=[ 317], 80.00th=[ 351], 90.00th=[ 363], 95.00th=[ 384], 00:29:38.893 | 99.00th=[ 393], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:29:38.893 | 99.99th=[ 414] 00:29:38.893 bw ( KiB/s): min= 128, max= 384, per=4.54%, avg=230.40, stdev=74.94, samples=20 00:29:38.893 iops : min= 32, max= 96, avg=57.60, stdev=18.73, samples=20 00:29:38.893 lat (msec) : 100=2.70%, 250=38.18%, 500=59.12% 00:29:38.893 cpu : usr=98.79%, sys=0.72%, ctx=21, majf=0, minf=28 00:29:38.893 IO depths : 1=3.7%, 2=10.0%, 4=25.0%, 8=52.5%, 16=8.8%, 32=0.0%, >=64=0.0% 00:29:38.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.893 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.893 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.893 filename1: (groupid=0, jobs=1): err= 0: pid=342333: Fri Nov 29 17:11:50 2024 00:29:38.893 read: IOPS=58, BW=236KiB/s (242kB/s)(2368KiB/10037msec) 00:29:38.893 slat (usec): min=4, max=137, avg=28.34, stdev=17.76 00:29:38.893 clat (msec): min=94, max=367, avg=270.85, stdev=74.58 00:29:38.893 lat (msec): min=94, max=367, avg=270.87, stdev=74.58 00:29:38.893 clat percentiles (msec): 00:29:38.893 | 1.00th=[ 95], 5.00th=[ 103], 10.00th=[ 174], 20.00th=[ 201], 00:29:38.893 | 30.00th=[ 226], 40.00th=[ 234], 50.00th=[ 292], 60.00th=[ 313], 00:29:38.893 | 70.00th=[ 326], 80.00th=[ 347], 90.00th=[ 363], 95.00th=[ 368], 00:29:38.893 | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], 00:29:38.893 | 99.99th=[ 368] 00:29:38.893 bw ( KiB/s): min= 128, max= 384, per=4.54%, avg=230.40, stdev=77.76, samples=20 00:29:38.893 iops : min= 32, max= 96, avg=57.60, stdev=19.44, samples=20 00:29:38.893 lat (msec) : 100=2.70%, 250=39.86%, 500=57.43% 00:29:38.893 cpu : usr=98.58%, sys=0.95%, ctx=17, majf=0, minf=23 00:29:38.894 IO depths : 1=4.4%, 2=9.5%, 4=21.5%, 8=56.6%, 16=8.1%, 32=0.0%, >=64=0.0% 00:29:38.894 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 complete : 0=0.0%, 4=93.0%, 8=1.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.894 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.894 filename1: (groupid=0, jobs=1): err= 0: pid=342334: Fri Nov 29 17:11:50 2024 00:29:38.894 read: IOPS=52, BW=211KiB/s (216kB/s)(2112KiB/10004msec) 00:29:38.894 slat (usec): min=8, max=100, avg=31.21, stdev=21.39 00:29:38.894 clat (msec): min=8, max=544, avg=302.86, stdev=82.84 00:29:38.894 lat (msec): min=8, max=544, avg=302.90, stdev=82.84 00:29:38.894 clat percentiles (msec): 00:29:38.894 | 1.00th=[ 9], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 226], 00:29:38.894 | 30.00th=[ 288], 40.00th=[ 305], 50.00th=[ 330], 60.00th=[ 342], 00:29:38.894 | 70.00th=[ 351], 80.00th=[ 363], 90.00th=[ 372], 95.00th=[ 384], 00:29:38.894 | 99.00th=[ 414], 99.50th=[ 493], 99.90th=[ 542], 99.95th=[ 542], 00:29:38.894 | 99.99th=[ 542] 00:29:38.894 bw ( KiB/s): min= 128, max= 272, per=3.98%, avg=202.11, stdev=62.02, samples=19 00:29:38.894 iops : min= 32, max= 68, avg=50.53, stdev=15.50, samples=19 00:29:38.894 lat (msec) : 10=3.03%, 100=0.38%, 250=21.21%, 500=75.00%, 750=0.38% 00:29:38.894 cpu : usr=98.39%, sys=1.08%, ctx=41, majf=0, minf=31 00:29:38.894 IO depths : 1=5.5%, 2=11.7%, 4=25.0%, 8=50.8%, 16=7.0%, 32=0.0%, >=64=0.0% 00:29:38.894 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.894 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.894 filename1: (groupid=0, jobs=1): err= 0: pid=342335: Fri Nov 29 17:11:50 2024 00:29:38.894 read: IOPS=51, BW=204KiB/s (209kB/s)(2048KiB/10016msec) 00:29:38.894 slat (usec): min=3, max=144, avg=62.89, stdev=31.07 00:29:38.894 clat (msec): min=89, max=542, avg=312.39, stdev=71.48 00:29:38.894 lat (msec): min=89, max=542, avg=312.45, stdev=71.48 00:29:38.894 clat percentiles (msec): 00:29:38.894 | 1.00th=[ 118], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 226], 00:29:38.894 | 30.00th=[ 288], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 347], 00:29:38.894 | 70.00th=[ 351], 80.00th=[ 368], 90.00th=[ 384], 95.00th=[ 414], 00:29:38.894 | 99.00th=[ 493], 99.50th=[ 498], 99.90th=[ 542], 99.95th=[ 542], 00:29:38.894 | 99.99th=[ 542] 00:29:38.894 bw ( KiB/s): min= 128, max= 272, per=3.90%, avg=198.40, stdev=62.60, samples=20 00:29:38.894 iops : min= 32, max= 68, avg=49.60, stdev=15.65, samples=20 00:29:38.894 lat (msec) : 100=0.78%, 250=22.27%, 500=76.56%, 750=0.39% 00:29:38.894 cpu : usr=98.55%, sys=0.91%, ctx=23, majf=0, minf=37 00:29:38.894 IO depths : 1=4.5%, 2=10.7%, 4=25.0%, 8=51.8%, 16=8.0%, 32=0.0%, >=64=0.0% 00:29:38.894 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.894 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.894 filename1: (groupid=0, jobs=1): err= 0: pid=342336: Fri Nov 29 17:11:50 2024 00:29:38.894 read: IOPS=51, BW=204KiB/s (209kB/s)(2048KiB/10016msec) 00:29:38.894 slat (usec): min=4, max=139, avg=67.73, stdev=29.15 00:29:38.894 clat (msec): min=172, max=414, avg=312.40, stdev=63.59 00:29:38.894 lat (msec): min=172, max=414, avg=312.47, stdev=63.59 00:29:38.894 clat percentiles (msec): 00:29:38.894 | 1.00th=[ 197], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 228], 00:29:38.894 | 30.00th=[ 292], 40.00th=[ 313], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.894 | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 380], 95.00th=[ 384], 00:29:38.894 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:29:38.894 | 99.99th=[ 414] 00:29:38.894 bw ( KiB/s): min= 128, max= 384, per=3.90%, avg=198.40, stdev=77.42, samples=20 00:29:38.894 iops : min= 32, max= 96, avg=49.60, stdev=19.35, samples=20 00:29:38.894 lat (msec) : 250=21.88%, 500=78.12% 00:29:38.894 cpu : usr=98.36%, sys=1.00%, ctx=79, majf=0, minf=27 00:29:38.894 IO depths : 1=5.3%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.2%, 32=0.0%, >=64=0.0% 00:29:38.894 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.894 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.894 filename1: (groupid=0, jobs=1): err= 0: pid=342337: Fri Nov 29 17:11:50 2024 00:29:38.894 read: IOPS=52, BW=211KiB/s (216kB/s)(2112KiB/10031msec) 00:29:38.894 slat (nsec): min=5452, max=95958, avg=33948.95, stdev=11499.11 00:29:38.894 clat (msec): min=89, max=434, avg=303.61, stdev=77.01 00:29:38.894 lat (msec): min=89, max=434, avg=303.64, stdev=77.01 00:29:38.894 clat percentiles (msec): 00:29:38.894 | 1.00th=[ 89], 5.00th=[ 174], 10.00th=[ 199], 20.00th=[ 224], 00:29:38.894 | 30.00th=[ 288], 40.00th=[ 305], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.894 | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 384], 95.00th=[ 384], 00:29:38.894 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 435], 99.95th=[ 435], 00:29:38.894 | 99.99th=[ 435] 00:29:38.894 bw ( KiB/s): min= 128, max= 384, per=4.02%, avg=204.80, stdev=75.33, samples=20 00:29:38.894 iops : min= 32, max= 96, avg=51.20, stdev=18.83, samples=20 00:29:38.894 lat (msec) : 100=3.03%, 250=24.24%, 500=72.73% 00:29:38.894 cpu : usr=98.50%, sys=1.10%, ctx=21, majf=0, minf=33 00:29:38.894 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:29:38.894 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.894 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.894 filename2: (groupid=0, jobs=1): err= 0: pid=342338: Fri Nov 29 17:11:50 2024 00:29:38.894 read: IOPS=51, BW=205KiB/s (210kB/s)(2048KiB/10006msec) 00:29:38.894 slat (usec): min=9, max=140, avg=81.90, stdev=24.33 00:29:38.894 clat (msec): min=160, max=542, avg=311.96, stdev=66.84 00:29:38.894 lat (msec): min=160, max=542, avg=312.04, stdev=66.85 00:29:38.894 clat percentiles (msec): 00:29:38.894 | 1.00th=[ 167], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 243], 00:29:38.894 | 30.00th=[ 288], 40.00th=[ 313], 50.00th=[ 326], 60.00th=[ 351], 00:29:38.894 | 70.00th=[ 355], 80.00th=[ 359], 90.00th=[ 380], 95.00th=[ 393], 00:29:38.894 | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 542], 99.95th=[ 542], 00:29:38.894 | 99.99th=[ 542] 00:29:38.894 bw ( KiB/s): min= 128, max= 256, per=3.98%, avg=202.11, stdev=63.38, samples=19 00:29:38.894 iops : min= 32, max= 64, avg=50.53, stdev=15.84, samples=19 00:29:38.894 lat (msec) : 250=23.05%, 500=76.56%, 750=0.39% 00:29:38.894 cpu : usr=98.70%, sys=0.83%, ctx=24, majf=0, minf=35 00:29:38.894 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:38.894 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.894 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.894 filename2: (groupid=0, jobs=1): err= 0: pid=342339: Fri Nov 29 17:11:50 2024 00:29:38.894 read: IOPS=51, BW=204KiB/s (209kB/s)(2048KiB/10016msec) 00:29:38.894 slat (usec): min=10, max=130, avg=44.42, stdev=20.03 00:29:38.894 clat (msec): min=173, max=414, avg=312.65, stdev=63.54 00:29:38.894 lat (msec): min=173, max=414, avg=312.70, stdev=63.55 00:29:38.894 clat percentiles (msec): 00:29:38.894 | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 228], 00:29:38.894 | 30.00th=[ 292], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.894 | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 380], 95.00th=[ 384], 00:29:38.894 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:29:38.894 | 99.99th=[ 414] 00:29:38.894 bw ( KiB/s): min= 128, max= 368, per=3.90%, avg=198.40, stdev=73.49, samples=20 00:29:38.894 iops : min= 32, max= 92, avg=49.60, stdev=18.37, samples=20 00:29:38.894 lat (msec) : 250=24.61%, 500=75.39% 00:29:38.894 cpu : usr=98.65%, sys=0.84%, ctx=22, majf=0, minf=28 00:29:38.894 IO depths : 1=1.6%, 2=7.8%, 4=25.0%, 8=54.7%, 16=10.9%, 32=0.0%, >=64=0.0% 00:29:38.894 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.894 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.894 filename2: (groupid=0, jobs=1): err= 0: pid=342340: Fri Nov 29 17:11:50 2024 00:29:38.894 read: IOPS=52, BW=211KiB/s (216kB/s)(2112KiB/10005msec) 00:29:38.894 slat (nsec): min=8044, max=93873, avg=24113.21, stdev=21667.92 00:29:38.894 clat (msec): min=5, max=651, avg=302.96, stdev=103.68 00:29:38.894 lat (msec): min=5, max=651, avg=302.99, stdev=103.67 00:29:38.894 clat percentiles (msec): 00:29:38.894 | 1.00th=[ 9], 5.00th=[ 125], 10.00th=[ 199], 20.00th=[ 224], 00:29:38.894 | 30.00th=[ 257], 40.00th=[ 305], 50.00th=[ 326], 60.00th=[ 351], 00:29:38.894 | 70.00th=[ 355], 80.00th=[ 363], 90.00th=[ 384], 95.00th=[ 405], 00:29:38.894 | 99.00th=[ 625], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], 00:29:38.894 | 99.99th=[ 651] 00:29:38.894 bw ( KiB/s): min= 112, max= 256, per=3.96%, avg=201.26, stdev=63.40, samples=19 00:29:38.894 iops : min= 28, max= 64, avg=50.32, stdev=15.85, samples=19 00:29:38.894 lat (msec) : 10=3.03%, 100=1.14%, 250=23.48%, 500=69.70%, 750=2.65% 00:29:38.894 cpu : usr=98.65%, sys=0.94%, ctx=23, majf=0, minf=26 00:29:38.894 IO depths : 1=3.4%, 2=9.7%, 4=25.0%, 8=52.8%, 16=9.1%, 32=0.0%, >=64=0.0% 00:29:38.894 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 complete : 0=0.0%, 4=94.1%, 8=0.2%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.894 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.894 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.894 filename2: (groupid=0, jobs=1): err= 0: pid=342341: Fri Nov 29 17:11:50 2024 00:29:38.894 read: IOPS=51, BW=205KiB/s (210kB/s)(2048KiB/10003msec) 00:29:38.894 slat (usec): min=7, max=133, avg=55.44, stdev=36.82 00:29:38.894 clat (msec): min=7, max=481, avg=312.12, stdev=82.92 00:29:38.894 lat (msec): min=7, max=481, avg=312.17, stdev=82.92 00:29:38.894 clat percentiles (msec): 00:29:38.894 | 1.00th=[ 49], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 226], 00:29:38.894 | 30.00th=[ 292], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.894 | 70.00th=[ 368], 80.00th=[ 380], 90.00th=[ 388], 95.00th=[ 405], 00:29:38.895 | 99.00th=[ 451], 99.50th=[ 456], 99.90th=[ 481], 99.95th=[ 481], 00:29:38.895 | 99.99th=[ 481] 00:29:38.895 bw ( KiB/s): min= 128, max= 384, per=3.85%, avg=195.37, stdev=74.40, samples=19 00:29:38.895 iops : min= 32, max= 96, avg=48.84, stdev=18.60, samples=19 00:29:38.895 lat (msec) : 10=0.39%, 50=2.73%, 250=19.92%, 500=76.95% 00:29:38.895 cpu : usr=98.46%, sys=0.99%, ctx=55, majf=0, minf=32 00:29:38.895 IO depths : 1=3.3%, 2=9.6%, 4=25.0%, 8=52.9%, 16=9.2%, 32=0.0%, >=64=0.0% 00:29:38.895 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.895 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.895 filename2: (groupid=0, jobs=1): err= 0: pid=342342: Fri Nov 29 17:11:50 2024 00:29:38.895 read: IOPS=51, BW=205KiB/s (210kB/s)(2048KiB/10003msec) 00:29:38.895 slat (usec): min=7, max=123, avg=26.39, stdev=11.23 00:29:38.895 clat (msec): min=136, max=480, avg=312.35, stdev=63.52 00:29:38.895 lat (msec): min=136, max=481, avg=312.37, stdev=63.53 00:29:38.895 clat percentiles (msec): 00:29:38.895 | 1.00th=[ 199], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 245], 00:29:38.895 | 30.00th=[ 288], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.895 | 70.00th=[ 359], 80.00th=[ 363], 90.00th=[ 372], 95.00th=[ 384], 00:29:38.895 | 99.00th=[ 414], 99.50th=[ 472], 99.90th=[ 481], 99.95th=[ 481], 00:29:38.895 | 99.99th=[ 481] 00:29:38.895 bw ( KiB/s): min= 128, max= 256, per=3.98%, avg=202.11, stdev=63.38, samples=19 00:29:38.895 iops : min= 32, max= 64, avg=50.53, stdev=15.84, samples=19 00:29:38.895 lat (msec) : 250=22.27%, 500=77.73% 00:29:38.895 cpu : usr=98.11%, sys=1.33%, ctx=61, majf=0, minf=35 00:29:38.895 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:38.895 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.895 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.895 filename2: (groupid=0, jobs=1): err= 0: pid=342343: Fri Nov 29 17:11:50 2024 00:29:38.895 read: IOPS=52, BW=211KiB/s (216kB/s)(2112KiB/10033msec) 00:29:38.895 slat (nsec): min=7824, max=76623, avg=23581.82, stdev=7819.97 00:29:38.895 clat (msec): min=94, max=414, avg=303.82, stdev=76.20 00:29:38.895 lat (msec): min=94, max=414, avg=303.84, stdev=76.21 00:29:38.895 clat percentiles (msec): 00:29:38.895 | 1.00th=[ 94], 5.00th=[ 174], 10.00th=[ 199], 20.00th=[ 226], 00:29:38.895 | 30.00th=[ 288], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 351], 00:29:38.895 | 70.00th=[ 359], 80.00th=[ 368], 90.00th=[ 384], 95.00th=[ 384], 00:29:38.895 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:29:38.895 | 99.99th=[ 414] 00:29:38.895 bw ( KiB/s): min= 128, max= 384, per=4.02%, avg=204.80, stdev=75.33, samples=20 00:29:38.895 iops : min= 32, max= 96, avg=51.20, stdev=18.83, samples=20 00:29:38.895 lat (msec) : 100=3.03%, 250=23.86%, 500=73.11% 00:29:38.895 cpu : usr=98.00%, sys=1.32%, ctx=53, majf=0, minf=46 00:29:38.895 IO depths : 1=4.2%, 2=10.4%, 4=25.0%, 8=52.1%, 16=8.3%, 32=0.0%, >=64=0.0% 00:29:38.895 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.895 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.895 filename2: (groupid=0, jobs=1): err= 0: pid=342344: Fri Nov 29 17:11:50 2024 00:29:38.895 read: IOPS=51, BW=205KiB/s (210kB/s)(2048KiB/10004msec) 00:29:38.895 slat (usec): min=7, max=110, avg=42.94, stdev=33.63 00:29:38.895 clat (msec): min=48, max=485, avg=312.21, stdev=82.51 00:29:38.895 lat (msec): min=48, max=485, avg=312.25, stdev=82.50 00:29:38.895 clat percentiles (msec): 00:29:38.895 | 1.00th=[ 48], 5.00th=[ 199], 10.00th=[ 201], 20.00th=[ 226], 00:29:38.895 | 30.00th=[ 292], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 355], 00:29:38.895 | 70.00th=[ 368], 80.00th=[ 384], 90.00th=[ 388], 95.00th=[ 405], 00:29:38.895 | 99.00th=[ 460], 99.50th=[ 472], 99.90th=[ 485], 99.95th=[ 485], 00:29:38.895 | 99.99th=[ 485] 00:29:38.895 bw ( KiB/s): min= 128, max= 368, per=3.85%, avg=195.37, stdev=75.72, samples=19 00:29:38.895 iops : min= 32, max= 92, avg=48.84, stdev=18.93, samples=19 00:29:38.895 lat (msec) : 50=3.12%, 250=19.92%, 500=76.95% 00:29:38.895 cpu : usr=98.62%, sys=0.90%, ctx=28, majf=0, minf=26 00:29:38.895 IO depths : 1=3.5%, 2=9.8%, 4=25.0%, 8=52.7%, 16=9.0%, 32=0.0%, >=64=0.0% 00:29:38.895 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.895 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.895 filename2: (groupid=0, jobs=1): err= 0: pid=342345: Fri Nov 29 17:11:50 2024 00:29:38.895 read: IOPS=52, BW=211KiB/s (216kB/s)(2112KiB/10028msec) 00:29:38.895 slat (usec): min=6, max=116, avg=49.70, stdev=27.02 00:29:38.895 clat (msec): min=89, max=472, avg=303.47, stdev=77.41 00:29:38.895 lat (msec): min=89, max=472, avg=303.52, stdev=77.41 00:29:38.895 clat percentiles (msec): 00:29:38.895 | 1.00th=[ 90], 5.00th=[ 174], 10.00th=[ 199], 20.00th=[ 226], 00:29:38.895 | 30.00th=[ 288], 40.00th=[ 309], 50.00th=[ 326], 60.00th=[ 351], 00:29:38.895 | 70.00th=[ 359], 80.00th=[ 368], 90.00th=[ 384], 95.00th=[ 384], 00:29:38.895 | 99.00th=[ 414], 99.50th=[ 439], 99.90th=[ 472], 99.95th=[ 472], 00:29:38.895 | 99.99th=[ 472] 00:29:38.895 bw ( KiB/s): min= 128, max= 384, per=4.02%, avg=204.80, stdev=76.58, samples=20 00:29:38.895 iops : min= 32, max= 96, avg=51.20, stdev=19.14, samples=20 00:29:38.895 lat (msec) : 100=3.03%, 250=23.86%, 500=73.11% 00:29:38.895 cpu : usr=98.60%, sys=0.93%, ctx=53, majf=0, minf=37 00:29:38.895 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:29:38.895 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.895 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.895 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:38.895 00:29:38.895 Run status group 0 (all jobs): 00:29:38.895 READ: bw=5071KiB/s (5192kB/s), 204KiB/s-249KiB/s (209kB/s-255kB/s), io=49.7MiB (52.1MB), run=10003-10039msec 00:29:39.460 17:11:50 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:39.460 17:11:50 -- target/dif.sh@43 -- # local sub 00:29:39.460 17:11:50 -- target/dif.sh@45 -- # for sub in "$@" 00:29:39.460 17:11:50 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:39.461 17:11:50 -- target/dif.sh@36 -- # local sub_id=0 00:29:39.461 17:11:50 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@45 -- # for sub in "$@" 00:29:39.461 17:11:50 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:39.461 17:11:50 -- target/dif.sh@36 -- # local sub_id=1 00:29:39.461 17:11:50 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@45 -- # for sub in "$@" 00:29:39.461 17:11:50 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:39.461 17:11:50 -- target/dif.sh@36 -- # local sub_id=2 00:29:39.461 17:11:50 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:39.461 17:11:50 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:39.461 17:11:50 -- target/dif.sh@115 -- # numjobs=2 00:29:39.461 17:11:50 -- target/dif.sh@115 -- # iodepth=8 00:29:39.461 17:11:50 -- target/dif.sh@115 -- # runtime=5 00:29:39.461 17:11:50 -- target/dif.sh@115 -- # files=1 00:29:39.461 17:11:50 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:39.461 17:11:50 -- target/dif.sh@28 -- # local sub 00:29:39.461 17:11:50 -- target/dif.sh@30 -- # for sub in "$@" 00:29:39.461 17:11:50 -- target/dif.sh@31 -- # create_subsystem 0 00:29:39.461 17:11:50 -- target/dif.sh@18 -- # local sub_id=0 00:29:39.461 17:11:50 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 bdev_null0 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 [2024-11-29 17:11:50.691571] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@30 -- # for sub in "$@" 00:29:39.461 17:11:50 -- target/dif.sh@31 -- # create_subsystem 1 00:29:39.461 17:11:50 -- target/dif.sh@18 -- # local sub_id=1 00:29:39.461 17:11:50 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 bdev_null1 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:39.461 17:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.461 17:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:39.461 17:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.461 17:11:50 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:39.461 17:11:50 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:39.461 17:11:50 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:39.461 17:11:50 -- nvmf/common.sh@520 -- # config=() 00:29:39.461 17:11:50 -- nvmf/common.sh@520 -- # local subsystem config 00:29:39.461 17:11:50 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:39.461 17:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:39.461 17:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:39.461 { 00:29:39.461 "params": { 00:29:39.461 "name": "Nvme$subsystem", 00:29:39.461 "trtype": "$TEST_TRANSPORT", 00:29:39.461 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:39.461 "adrfam": "ipv4", 00:29:39.461 "trsvcid": "$NVMF_PORT", 00:29:39.461 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:39.461 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:39.461 "hdgst": ${hdgst:-false}, 00:29:39.461 "ddgst": ${ddgst:-false} 00:29:39.461 }, 00:29:39.461 "method": "bdev_nvme_attach_controller" 00:29:39.461 } 00:29:39.461 EOF 00:29:39.461 )") 00:29:39.461 17:11:50 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:39.461 17:11:50 -- target/dif.sh@82 -- # gen_fio_conf 00:29:39.461 17:11:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:39.461 17:11:50 -- target/dif.sh@54 -- # local file 00:29:39.461 17:11:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:39.461 17:11:50 -- target/dif.sh@56 -- # cat 00:29:39.461 17:11:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:39.461 17:11:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:39.461 17:11:50 -- common/autotest_common.sh@1330 -- # shift 00:29:39.461 17:11:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:39.461 17:11:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:39.461 17:11:50 -- nvmf/common.sh@542 -- # cat 00:29:39.461 17:11:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:39.461 17:11:50 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:39.461 17:11:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:39.461 17:11:50 -- target/dif.sh@72 -- # (( file <= files )) 00:29:39.461 17:11:50 -- target/dif.sh@73 -- # cat 00:29:39.461 17:11:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:39.461 17:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:39.461 17:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:39.461 { 00:29:39.461 "params": { 00:29:39.461 "name": "Nvme$subsystem", 00:29:39.461 "trtype": "$TEST_TRANSPORT", 00:29:39.461 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:39.461 "adrfam": "ipv4", 00:29:39.461 "trsvcid": "$NVMF_PORT", 00:29:39.461 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:39.461 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:39.461 "hdgst": ${hdgst:-false}, 00:29:39.461 "ddgst": ${ddgst:-false} 00:29:39.461 }, 00:29:39.461 "method": "bdev_nvme_attach_controller" 00:29:39.461 } 00:29:39.461 EOF 00:29:39.461 )") 00:29:39.461 17:11:50 -- nvmf/common.sh@542 -- # cat 00:29:39.461 17:11:50 -- target/dif.sh@72 -- # (( file++ )) 00:29:39.461 17:11:50 -- target/dif.sh@72 -- # (( file <= files )) 00:29:39.461 17:11:50 -- nvmf/common.sh@544 -- # jq . 00:29:39.461 17:11:50 -- nvmf/common.sh@545 -- # IFS=, 00:29:39.461 17:11:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:39.461 "params": { 00:29:39.461 "name": "Nvme0", 00:29:39.461 "trtype": "tcp", 00:29:39.461 "traddr": "10.0.0.2", 00:29:39.461 "adrfam": "ipv4", 00:29:39.461 "trsvcid": "4420", 00:29:39.461 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:39.461 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:39.461 "hdgst": false, 00:29:39.461 "ddgst": false 00:29:39.461 }, 00:29:39.461 "method": "bdev_nvme_attach_controller" 00:29:39.461 },{ 00:29:39.461 "params": { 00:29:39.461 "name": "Nvme1", 00:29:39.461 "trtype": "tcp", 00:29:39.461 "traddr": "10.0.0.2", 00:29:39.461 "adrfam": "ipv4", 00:29:39.461 "trsvcid": "4420", 00:29:39.461 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:39.461 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:39.461 "hdgst": false, 00:29:39.461 "ddgst": false 00:29:39.461 }, 00:29:39.461 "method": "bdev_nvme_attach_controller" 00:29:39.461 }' 00:29:39.462 17:11:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:39.462 17:11:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:39.462 17:11:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:39.462 17:11:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:39.462 17:11:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:39.462 17:11:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:39.462 17:11:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:39.462 17:11:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:39.462 17:11:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:39.462 17:11:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:39.720 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:39.720 ... 00:29:39.720 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:39.720 ... 00:29:39.720 fio-3.35 00:29:39.720 Starting 4 threads 00:29:39.720 EAL: No free 2048 kB hugepages reported on node 1 00:29:40.652 [2024-11-29 17:11:51.772108] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:40.652 [2024-11-29 17:11:51.772173] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:45.912 00:29:45.912 filename0: (groupid=0, jobs=1): err= 0: pid=343887: Fri Nov 29 17:11:56 2024 00:29:45.912 read: IOPS=1995, BW=15.6MiB/s (16.3MB/s)(78.0MiB/5003msec) 00:29:45.912 slat (nsec): min=3879, max=56889, avg=16070.50, stdev=8421.94 00:29:45.912 clat (usec): min=704, max=11834, avg=3955.63, stdev=550.41 00:29:45.912 lat (usec): min=712, max=11862, avg=3971.70, stdev=550.35 00:29:45.912 clat percentiles (usec): 00:29:45.912 | 1.00th=[ 2409], 5.00th=[ 3130], 10.00th=[ 3392], 20.00th=[ 3720], 00:29:45.912 | 30.00th=[ 3851], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 4015], 00:29:45.912 | 70.00th=[ 4080], 80.00th=[ 4146], 90.00th=[ 4359], 95.00th=[ 4752], 00:29:45.912 | 99.00th=[ 5932], 99.50th=[ 6259], 99.90th=[ 7308], 99.95th=[ 9765], 00:29:45.912 | 99.99th=[11863] 00:29:45.912 bw ( KiB/s): min=15406, max=16240, per=25.15%, avg=15959.80, stdev=269.49, samples=10 00:29:45.912 iops : min= 1925, max= 2030, avg=1994.90, stdev=33.86, samples=10 00:29:45.912 lat (usec) : 750=0.02% 00:29:45.912 lat (msec) : 2=0.53%, 4=56.77%, 10=42.67%, 20=0.01% 00:29:45.912 cpu : usr=95.90%, sys=3.62%, ctx=11, majf=0, minf=9 00:29:45.912 IO depths : 1=0.3%, 2=11.9%, 4=60.3%, 8=27.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:45.912 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:45.912 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:45.912 issued rwts: total=9981,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:45.912 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:45.912 filename0: (groupid=0, jobs=1): err= 0: pid=343888: Fri Nov 29 17:11:56 2024 00:29:45.912 read: IOPS=1940, BW=15.2MiB/s (15.9MB/s)(75.8MiB/5001msec) 00:29:45.912 slat (nsec): min=3743, max=82855, avg=17591.95, stdev=8865.13 00:29:45.912 clat (usec): min=618, max=11068, avg=4060.72, stdev=639.42 00:29:45.912 lat (usec): min=636, max=11079, avg=4078.31, stdev=639.02 00:29:45.912 clat percentiles (usec): 00:29:45.912 | 1.00th=[ 2147], 5.00th=[ 3294], 10.00th=[ 3621], 20.00th=[ 3818], 00:29:45.912 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3982], 60.00th=[ 4047], 00:29:45.912 | 70.00th=[ 4113], 80.00th=[ 4228], 90.00th=[ 4686], 95.00th=[ 5145], 00:29:45.912 | 99.00th=[ 6587], 99.50th=[ 6849], 99.90th=[ 7504], 99.95th=[ 9110], 00:29:45.912 | 99.99th=[11076] 00:29:45.912 bw ( KiB/s): min=15278, max=15872, per=24.51%, avg=15551.78, stdev=167.83, samples=9 00:29:45.912 iops : min= 1909, max= 1984, avg=1943.89, stdev=21.13, samples=9 00:29:45.912 lat (usec) : 750=0.04%, 1000=0.11% 00:29:45.912 lat (msec) : 2=0.76%, 4=52.48%, 10=46.59%, 20=0.01% 00:29:45.912 cpu : usr=95.28%, sys=4.20%, ctx=37, majf=0, minf=9 00:29:45.912 IO depths : 1=0.1%, 2=12.8%, 4=59.6%, 8=27.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:45.912 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:45.912 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:45.912 issued rwts: total=9706,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:45.912 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:45.912 filename1: (groupid=0, jobs=1): err= 0: pid=343889: Fri Nov 29 17:11:56 2024 00:29:45.912 read: IOPS=1974, BW=15.4MiB/s (16.2MB/s)(77.2MiB/5002msec) 00:29:45.912 slat (nsec): min=3634, max=60869, avg=17802.73, stdev=8698.36 00:29:45.912 clat (usec): min=653, max=11605, avg=3989.62, stdev=579.93 00:29:45.912 lat (usec): min=665, max=11617, avg=4007.42, stdev=579.77 00:29:45.912 clat percentiles (usec): 00:29:45.912 | 1.00th=[ 2180], 5.00th=[ 3228], 10.00th=[ 3523], 20.00th=[ 3752], 00:29:45.912 | 30.00th=[ 3851], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 4015], 00:29:45.912 | 70.00th=[ 4080], 80.00th=[ 4178], 90.00th=[ 4424], 95.00th=[ 4883], 00:29:45.912 | 99.00th=[ 6259], 99.50th=[ 6783], 99.90th=[ 7570], 99.95th=[ 8979], 00:29:45.912 | 99.99th=[11600] 00:29:45.912 bw ( KiB/s): min=15472, max=16080, per=24.83%, avg=15754.67, stdev=211.36, samples=9 00:29:45.912 iops : min= 1934, max= 2010, avg=1969.33, stdev=26.42, samples=9 00:29:45.912 lat (usec) : 750=0.01%, 1000=0.07% 00:29:45.912 lat (msec) : 2=0.52%, 4=56.98%, 10=42.41%, 20=0.01% 00:29:45.912 cpu : usr=95.58%, sys=3.92%, ctx=8, majf=0, minf=9 00:29:45.912 IO depths : 1=0.2%, 2=13.7%, 4=58.2%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:45.912 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:45.912 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:45.912 issued rwts: total=9877,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:45.912 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:45.912 filename1: (groupid=0, jobs=1): err= 0: pid=343890: Fri Nov 29 17:11:56 2024 00:29:45.912 read: IOPS=2021, BW=15.8MiB/s (16.6MB/s)(79.0MiB/5002msec) 00:29:45.912 slat (nsec): min=3752, max=54890, avg=20131.33, stdev=7461.86 00:29:45.912 clat (usec): min=630, max=12214, avg=3883.92, stdev=526.66 00:29:45.912 lat (usec): min=649, max=12229, avg=3904.05, stdev=527.01 00:29:45.912 clat percentiles (usec): 00:29:45.912 | 1.00th=[ 2474], 5.00th=[ 3064], 10.00th=[ 3326], 20.00th=[ 3621], 00:29:45.912 | 30.00th=[ 3785], 40.00th=[ 3884], 50.00th=[ 3916], 60.00th=[ 3982], 00:29:45.912 | 70.00th=[ 4047], 80.00th=[ 4113], 90.00th=[ 4228], 95.00th=[ 4490], 00:29:45.912 | 99.00th=[ 5538], 99.50th=[ 5997], 99.90th=[ 7111], 99.95th=[10421], 00:29:45.912 | 99.99th=[10421] 00:29:45.912 bw ( KiB/s): min=15984, max=16384, per=25.50%, avg=16176.00, stdev=133.63, samples=9 00:29:45.912 iops : min= 1998, max= 2048, avg=2022.00, stdev=16.70, samples=9 00:29:45.912 lat (usec) : 750=0.01%, 1000=0.09% 00:29:45.912 lat (msec) : 2=0.44%, 4=64.47%, 10=34.91%, 20=0.08% 00:29:45.912 cpu : usr=95.60%, sys=3.88%, ctx=7, majf=0, minf=0 00:29:45.912 IO depths : 1=0.3%, 2=17.3%, 4=56.1%, 8=26.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:45.912 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:45.912 complete : 0=0.0%, 4=91.3%, 8=8.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:45.912 issued rwts: total=10114,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:45.912 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:45.912 00:29:45.912 Run status group 0 (all jobs): 00:29:45.912 READ: bw=62.0MiB/s (65.0MB/s), 15.2MiB/s-15.8MiB/s (15.9MB/s-16.6MB/s), io=310MiB (325MB), run=5001-5003msec 00:29:45.912 17:11:57 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:45.912 17:11:57 -- target/dif.sh@43 -- # local sub 00:29:45.912 17:11:57 -- target/dif.sh@45 -- # for sub in "$@" 00:29:45.912 17:11:57 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:45.912 17:11:57 -- target/dif.sh@36 -- # local sub_id=0 00:29:45.912 17:11:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:45.912 17:11:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.912 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.912 17:11:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.912 17:11:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:45.912 17:11:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.912 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.912 17:11:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.912 17:11:57 -- target/dif.sh@45 -- # for sub in "$@" 00:29:45.912 17:11:57 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:45.912 17:11:57 -- target/dif.sh@36 -- # local sub_id=1 00:29:45.913 17:11:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:45.913 17:11:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.913 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.913 17:11:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.913 17:11:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:45.913 17:11:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.913 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.913 17:11:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.913 00:29:45.913 real 0m24.579s 00:29:45.913 user 4m35.006s 00:29:45.913 sys 0m4.910s 00:29:45.913 17:11:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:45.913 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.913 ************************************ 00:29:45.913 END TEST fio_dif_rand_params 00:29:45.913 ************************************ 00:29:45.913 17:11:57 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:45.913 17:11:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:45.913 17:11:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:45.913 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.913 ************************************ 00:29:45.913 START TEST fio_dif_digest 00:29:45.913 ************************************ 00:29:45.913 17:11:57 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:45.913 17:11:57 -- target/dif.sh@123 -- # local NULL_DIF 00:29:45.913 17:11:57 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:45.913 17:11:57 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:45.913 17:11:57 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:45.913 17:11:57 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:45.913 17:11:57 -- target/dif.sh@127 -- # numjobs=3 00:29:45.913 17:11:57 -- target/dif.sh@127 -- # iodepth=3 00:29:45.913 17:11:57 -- target/dif.sh@127 -- # runtime=10 00:29:45.913 17:11:57 -- target/dif.sh@128 -- # hdgst=true 00:29:45.913 17:11:57 -- target/dif.sh@128 -- # ddgst=true 00:29:45.913 17:11:57 -- target/dif.sh@130 -- # create_subsystems 0 00:29:45.913 17:11:57 -- target/dif.sh@28 -- # local sub 00:29:45.913 17:11:57 -- target/dif.sh@30 -- # for sub in "$@" 00:29:45.913 17:11:57 -- target/dif.sh@31 -- # create_subsystem 0 00:29:45.913 17:11:57 -- target/dif.sh@18 -- # local sub_id=0 00:29:45.913 17:11:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:45.913 17:11:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.913 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.913 bdev_null0 00:29:45.913 17:11:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.913 17:11:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:45.913 17:11:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.913 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.913 17:11:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.913 17:11:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:45.913 17:11:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.913 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.913 17:11:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.913 17:11:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:45.913 17:11:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.913 17:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:45.913 [2024-11-29 17:11:57.225146] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:45.913 17:11:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.913 17:11:57 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:45.913 17:11:57 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:45.913 17:11:57 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:45.913 17:11:57 -- nvmf/common.sh@520 -- # config=() 00:29:45.913 17:11:57 -- nvmf/common.sh@520 -- # local subsystem config 00:29:45.913 17:11:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:45.913 17:11:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:45.913 { 00:29:45.913 "params": { 00:29:45.913 "name": "Nvme$subsystem", 00:29:45.913 "trtype": "$TEST_TRANSPORT", 00:29:45.913 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:45.913 "adrfam": "ipv4", 00:29:45.913 "trsvcid": "$NVMF_PORT", 00:29:45.913 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:45.913 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:45.913 "hdgst": ${hdgst:-false}, 00:29:45.913 "ddgst": ${ddgst:-false} 00:29:45.913 }, 00:29:45.913 "method": "bdev_nvme_attach_controller" 00:29:45.913 } 00:29:45.913 EOF 00:29:45.913 )") 00:29:45.913 17:11:57 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:45.913 17:11:57 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:45.913 17:11:57 -- target/dif.sh@82 -- # gen_fio_conf 00:29:45.913 17:11:57 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:45.913 17:11:57 -- target/dif.sh@54 -- # local file 00:29:45.913 17:11:57 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:45.913 17:11:57 -- target/dif.sh@56 -- # cat 00:29:45.913 17:11:57 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:45.913 17:11:57 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:45.913 17:11:57 -- common/autotest_common.sh@1330 -- # shift 00:29:45.913 17:11:57 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:45.913 17:11:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:45.913 17:11:57 -- nvmf/common.sh@542 -- # cat 00:29:45.913 17:11:57 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:45.913 17:11:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:45.913 17:11:57 -- target/dif.sh@72 -- # (( file <= files )) 00:29:45.913 17:11:57 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:45.913 17:11:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:45.913 17:11:57 -- nvmf/common.sh@544 -- # jq . 00:29:45.913 17:11:57 -- nvmf/common.sh@545 -- # IFS=, 00:29:45.913 17:11:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:45.913 "params": { 00:29:45.913 "name": "Nvme0", 00:29:45.913 "trtype": "tcp", 00:29:45.913 "traddr": "10.0.0.2", 00:29:45.913 "adrfam": "ipv4", 00:29:45.913 "trsvcid": "4420", 00:29:45.913 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:45.913 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:45.913 "hdgst": true, 00:29:45.913 "ddgst": true 00:29:45.913 }, 00:29:45.913 "method": "bdev_nvme_attach_controller" 00:29:45.913 }' 00:29:45.913 17:11:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:45.913 17:11:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:45.913 17:11:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:45.913 17:11:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:45.913 17:11:57 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:45.913 17:11:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:45.913 17:11:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:45.913 17:11:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:45.913 17:11:57 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:45.913 17:11:57 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:46.171 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:46.171 ... 00:29:46.171 fio-3.35 00:29:46.171 Starting 3 threads 00:29:46.171 EAL: No free 2048 kB hugepages reported on node 1 00:29:46.737 [2024-11-29 17:11:57.980920] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:46.737 [2024-11-29 17:11:57.980986] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:58.929 00:29:58.929 filename0: (groupid=0, jobs=1): err= 0: pid=344670: Fri Nov 29 17:12:08 2024 00:29:58.930 read: IOPS=207, BW=25.9MiB/s (27.2MB/s)(260MiB/10048msec) 00:29:58.930 slat (nsec): min=4403, max=74363, avg=16706.24, stdev=5418.94 00:29:58.930 clat (usec): min=8903, max=52963, avg=14437.18, stdev=1634.57 00:29:58.930 lat (usec): min=8920, max=52985, avg=14453.88, stdev=1634.73 00:29:58.930 clat percentiles (usec): 00:29:58.930 | 1.00th=[11469], 5.00th=[12518], 10.00th=[12911], 20.00th=[13435], 00:29:58.930 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14353], 60.00th=[14746], 00:29:58.930 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15795], 95.00th=[16188], 00:29:58.930 | 99.00th=[17433], 99.50th=[17957], 99.90th=[24511], 99.95th=[47449], 00:29:58.930 | 99.99th=[53216] 00:29:58.930 bw ( KiB/s): min=25088, max=28160, per=34.49%, avg=26611.20, stdev=991.40, samples=20 00:29:58.930 iops : min= 196, max= 220, avg=207.90, stdev= 7.75, samples=20 00:29:58.930 lat (msec) : 10=0.19%, 20=99.57%, 50=0.19%, 100=0.05% 00:29:58.930 cpu : usr=94.97%, sys=4.54%, ctx=19, majf=0, minf=184 00:29:58.930 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:58.930 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:58.930 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:58.930 issued rwts: total=2082,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:58.930 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:58.930 filename0: (groupid=0, jobs=1): err= 0: pid=344671: Fri Nov 29 17:12:08 2024 00:29:58.930 read: IOPS=197, BW=24.6MiB/s (25.8MB/s)(248MiB/10045msec) 00:29:58.930 slat (nsec): min=3723, max=51583, avg=20098.96, stdev=4795.39 00:29:58.930 clat (usec): min=9971, max=52958, avg=15174.34, stdev=1647.44 00:29:58.930 lat (usec): min=9990, max=52972, avg=15194.44, stdev=1647.39 00:29:58.930 clat percentiles (usec): 00:29:58.930 | 1.00th=[12387], 5.00th=[13304], 10.00th=[13698], 20.00th=[14222], 00:29:58.930 | 30.00th=[14484], 40.00th=[14877], 50.00th=[15139], 60.00th=[15401], 00:29:58.930 | 70.00th=[15664], 80.00th=[16057], 90.00th=[16581], 95.00th=[16909], 00:29:58.930 | 99.00th=[17957], 99.50th=[18482], 99.90th=[51119], 99.95th=[53216], 00:29:58.930 | 99.99th=[53216] 00:29:58.930 bw ( KiB/s): min=23552, max=26624, per=32.81%, avg=25308.00, stdev=930.03, samples=20 00:29:58.930 iops : min= 184, max= 208, avg=197.70, stdev= 7.29, samples=20 00:29:58.930 lat (msec) : 10=0.05%, 20=99.80%, 50=0.05%, 100=0.10% 00:29:58.930 cpu : usr=95.62%, sys=3.86%, ctx=15, majf=0, minf=125 00:29:58.930 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:58.930 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:58.930 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:58.930 issued rwts: total=1980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:58.930 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:58.930 filename0: (groupid=0, jobs=1): err= 0: pid=344672: Fri Nov 29 17:12:08 2024 00:29:58.930 read: IOPS=198, BW=24.8MiB/s (26.0MB/s)(249MiB/10046msec) 00:29:58.930 slat (nsec): min=4496, max=89453, avg=16088.81, stdev=5120.21 00:29:58.930 clat (usec): min=11424, max=56199, avg=15073.04, stdev=2272.86 00:29:58.930 lat (usec): min=11438, max=56218, avg=15089.13, stdev=2272.75 00:29:58.930 clat percentiles (usec): 00:29:58.930 | 1.00th=[12387], 5.00th=[13042], 10.00th=[13435], 20.00th=[13960], 00:29:58.930 | 30.00th=[14353], 40.00th=[14615], 50.00th=[15008], 60.00th=[15270], 00:29:58.930 | 70.00th=[15664], 80.00th=[15926], 90.00th=[16450], 95.00th=[16909], 00:29:58.930 | 99.00th=[17695], 99.50th=[19006], 99.90th=[55313], 99.95th=[56361], 00:29:58.930 | 99.99th=[56361] 00:29:58.930 bw ( KiB/s): min=23040, max=27136, per=33.05%, avg=25500.00, stdev=1213.76, samples=20 00:29:58.930 iops : min= 180, max= 212, avg=199.20, stdev= 9.50, samples=20 00:29:58.930 lat (msec) : 20=99.75%, 50=0.05%, 100=0.20% 00:29:58.930 cpu : usr=95.00%, sys=4.52%, ctx=13, majf=0, minf=133 00:29:58.930 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:58.930 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:58.930 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:58.930 issued rwts: total=1994,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:58.930 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:58.930 00:29:58.930 Run status group 0 (all jobs): 00:29:58.930 READ: bw=75.3MiB/s (79.0MB/s), 24.6MiB/s-25.9MiB/s (25.8MB/s-27.2MB/s), io=757MiB (794MB), run=10045-10048msec 00:29:58.930 17:12:08 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:58.930 17:12:08 -- target/dif.sh@43 -- # local sub 00:29:58.930 17:12:08 -- target/dif.sh@45 -- # for sub in "$@" 00:29:58.930 17:12:08 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:58.930 17:12:08 -- target/dif.sh@36 -- # local sub_id=0 00:29:58.930 17:12:08 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:58.930 17:12:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.930 17:12:08 -- common/autotest_common.sh@10 -- # set +x 00:29:58.930 17:12:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.930 17:12:08 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:58.930 17:12:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.930 17:12:08 -- common/autotest_common.sh@10 -- # set +x 00:29:58.930 17:12:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.930 00:29:58.930 real 0m11.275s 00:29:58.930 user 0m29.938s 00:29:58.930 sys 0m1.562s 00:29:58.930 17:12:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:58.930 17:12:08 -- common/autotest_common.sh@10 -- # set +x 00:29:58.930 ************************************ 00:29:58.930 END TEST fio_dif_digest 00:29:58.930 ************************************ 00:29:58.930 17:12:08 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:58.930 17:12:08 -- target/dif.sh@147 -- # nvmftestfini 00:29:58.930 17:12:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:58.930 17:12:08 -- nvmf/common.sh@116 -- # sync 00:29:58.930 17:12:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:58.930 17:12:08 -- nvmf/common.sh@119 -- # set +e 00:29:58.930 17:12:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:58.930 17:12:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:58.930 rmmod nvme_tcp 00:29:58.930 rmmod nvme_fabrics 00:29:58.930 rmmod nvme_keyring 00:29:58.930 17:12:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:58.930 17:12:08 -- nvmf/common.sh@123 -- # set -e 00:29:58.930 17:12:08 -- nvmf/common.sh@124 -- # return 0 00:29:58.930 17:12:08 -- nvmf/common.sh@477 -- # '[' -n 338189 ']' 00:29:58.930 17:12:08 -- nvmf/common.sh@478 -- # killprocess 338189 00:29:58.930 17:12:08 -- common/autotest_common.sh@936 -- # '[' -z 338189 ']' 00:29:58.930 17:12:08 -- common/autotest_common.sh@940 -- # kill -0 338189 00:29:58.930 17:12:08 -- common/autotest_common.sh@941 -- # uname 00:29:58.930 17:12:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:58.930 17:12:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 338189 00:29:58.930 17:12:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:58.930 17:12:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:58.930 17:12:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 338189' 00:29:58.930 killing process with pid 338189 00:29:58.930 17:12:08 -- common/autotest_common.sh@955 -- # kill 338189 00:29:58.930 17:12:08 -- common/autotest_common.sh@960 -- # wait 338189 00:29:58.930 17:12:08 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:58.930 17:12:08 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:58.930 Waiting for block devices as requested 00:29:58.930 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:58.930 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:58.930 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:58.930 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:59.188 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:59.188 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:59.188 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:59.188 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:59.188 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:59.446 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:59.446 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:59.446 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:59.705 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:59.705 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:59.705 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:59.705 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:59.963 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:59.963 17:12:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:59.963 17:12:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:59.963 17:12:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:59.963 17:12:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:59.963 17:12:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:59.963 17:12:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:59.963 17:12:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:02.491 17:12:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:02.491 00:30:02.491 real 1m7.766s 00:30:02.491 user 6m34.539s 00:30:02.491 sys 0m14.847s 00:30:02.491 17:12:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:02.491 17:12:13 -- common/autotest_common.sh@10 -- # set +x 00:30:02.491 ************************************ 00:30:02.491 END TEST nvmf_dif 00:30:02.491 ************************************ 00:30:02.491 17:12:13 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:30:02.491 17:12:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:02.491 17:12:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:02.491 17:12:13 -- common/autotest_common.sh@10 -- # set +x 00:30:02.491 ************************************ 00:30:02.491 START TEST nvmf_abort_qd_sizes 00:30:02.491 ************************************ 00:30:02.491 17:12:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:30:02.491 * Looking for test storage... 00:30:02.491 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:02.491 17:12:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:02.491 17:12:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:02.491 17:12:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:02.491 17:12:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:02.491 17:12:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:02.491 17:12:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:02.491 17:12:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:02.491 17:12:13 -- scripts/common.sh@335 -- # IFS=.-: 00:30:02.491 17:12:13 -- scripts/common.sh@335 -- # read -ra ver1 00:30:02.491 17:12:13 -- scripts/common.sh@336 -- # IFS=.-: 00:30:02.491 17:12:13 -- scripts/common.sh@336 -- # read -ra ver2 00:30:02.491 17:12:13 -- scripts/common.sh@337 -- # local 'op=<' 00:30:02.491 17:12:13 -- scripts/common.sh@339 -- # ver1_l=2 00:30:02.491 17:12:13 -- scripts/common.sh@340 -- # ver2_l=1 00:30:02.491 17:12:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:02.491 17:12:13 -- scripts/common.sh@343 -- # case "$op" in 00:30:02.491 17:12:13 -- scripts/common.sh@344 -- # : 1 00:30:02.491 17:12:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:02.491 17:12:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:02.491 17:12:13 -- scripts/common.sh@364 -- # decimal 1 00:30:02.491 17:12:13 -- scripts/common.sh@352 -- # local d=1 00:30:02.491 17:12:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:02.491 17:12:13 -- scripts/common.sh@354 -- # echo 1 00:30:02.491 17:12:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:02.491 17:12:13 -- scripts/common.sh@365 -- # decimal 2 00:30:02.491 17:12:13 -- scripts/common.sh@352 -- # local d=2 00:30:02.491 17:12:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:02.491 17:12:13 -- scripts/common.sh@354 -- # echo 2 00:30:02.491 17:12:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:02.491 17:12:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:02.491 17:12:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:02.491 17:12:13 -- scripts/common.sh@367 -- # return 0 00:30:02.491 17:12:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:02.491 17:12:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:02.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:02.491 --rc genhtml_branch_coverage=1 00:30:02.491 --rc genhtml_function_coverage=1 00:30:02.491 --rc genhtml_legend=1 00:30:02.491 --rc geninfo_all_blocks=1 00:30:02.491 --rc geninfo_unexecuted_blocks=1 00:30:02.491 00:30:02.491 ' 00:30:02.491 17:12:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:02.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:02.491 --rc genhtml_branch_coverage=1 00:30:02.491 --rc genhtml_function_coverage=1 00:30:02.491 --rc genhtml_legend=1 00:30:02.491 --rc geninfo_all_blocks=1 00:30:02.491 --rc geninfo_unexecuted_blocks=1 00:30:02.491 00:30:02.491 ' 00:30:02.491 17:12:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:02.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:02.492 --rc genhtml_branch_coverage=1 00:30:02.492 --rc genhtml_function_coverage=1 00:30:02.492 --rc genhtml_legend=1 00:30:02.492 --rc geninfo_all_blocks=1 00:30:02.492 --rc geninfo_unexecuted_blocks=1 00:30:02.492 00:30:02.492 ' 00:30:02.492 17:12:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:02.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:02.492 --rc genhtml_branch_coverage=1 00:30:02.492 --rc genhtml_function_coverage=1 00:30:02.492 --rc genhtml_legend=1 00:30:02.492 --rc geninfo_all_blocks=1 00:30:02.492 --rc geninfo_unexecuted_blocks=1 00:30:02.492 00:30:02.492 ' 00:30:02.492 17:12:13 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:02.492 17:12:13 -- nvmf/common.sh@7 -- # uname -s 00:30:02.492 17:12:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:02.492 17:12:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:02.492 17:12:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:02.492 17:12:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:02.492 17:12:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:02.492 17:12:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:02.492 17:12:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:02.492 17:12:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:02.492 17:12:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:02.492 17:12:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:02.492 17:12:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:02.492 17:12:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:02.492 17:12:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:02.492 17:12:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:02.492 17:12:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:02.492 17:12:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:02.492 17:12:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:02.492 17:12:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:02.492 17:12:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:02.492 17:12:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.492 17:12:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.492 17:12:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.492 17:12:13 -- paths/export.sh@5 -- # export PATH 00:30:02.492 17:12:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.492 17:12:13 -- nvmf/common.sh@46 -- # : 0 00:30:02.492 17:12:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:02.492 17:12:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:02.492 17:12:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:02.492 17:12:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:02.492 17:12:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:02.492 17:12:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:02.492 17:12:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:02.492 17:12:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:02.492 17:12:13 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:30:02.492 17:12:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:02.492 17:12:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:02.492 17:12:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:02.492 17:12:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:02.492 17:12:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:02.492 17:12:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:02.492 17:12:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:02.492 17:12:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:02.492 17:12:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:02.492 17:12:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:02.492 17:12:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:02.492 17:12:13 -- common/autotest_common.sh@10 -- # set +x 00:30:04.422 17:12:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:04.422 17:12:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:04.422 17:12:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:04.422 17:12:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:04.422 17:12:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:04.422 17:12:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:04.422 17:12:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:04.422 17:12:15 -- nvmf/common.sh@294 -- # net_devs=() 00:30:04.422 17:12:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:04.422 17:12:15 -- nvmf/common.sh@295 -- # e810=() 00:30:04.422 17:12:15 -- nvmf/common.sh@295 -- # local -ga e810 00:30:04.422 17:12:15 -- nvmf/common.sh@296 -- # x722=() 00:30:04.422 17:12:15 -- nvmf/common.sh@296 -- # local -ga x722 00:30:04.422 17:12:15 -- nvmf/common.sh@297 -- # mlx=() 00:30:04.422 17:12:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:04.422 17:12:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:04.422 17:12:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:04.422 17:12:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:04.422 17:12:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:04.422 17:12:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:04.422 17:12:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:04.422 17:12:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:04.423 17:12:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:04.423 17:12:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:04.423 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:04.423 17:12:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:04.423 17:12:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:04.423 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:04.423 17:12:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:04.423 17:12:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:04.423 17:12:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:04.423 17:12:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:04.423 17:12:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:04.423 17:12:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:04.423 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:04.423 17:12:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:04.423 17:12:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:04.423 17:12:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:04.423 17:12:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:04.423 17:12:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:04.423 17:12:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:04.423 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:04.423 17:12:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:04.423 17:12:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:04.423 17:12:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:04.423 17:12:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:04.423 17:12:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:04.423 17:12:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:04.423 17:12:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:04.423 17:12:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:04.423 17:12:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:04.423 17:12:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:04.423 17:12:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:04.423 17:12:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:04.423 17:12:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:04.423 17:12:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:04.423 17:12:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:04.423 17:12:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:04.423 17:12:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:04.423 17:12:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:04.423 17:12:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:04.423 17:12:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:04.423 17:12:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:04.423 17:12:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:04.423 17:12:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:04.423 17:12:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:04.423 17:12:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:04.423 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:04.423 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:30:04.423 00:30:04.423 --- 10.0.0.2 ping statistics --- 00:30:04.423 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:04.423 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:30:04.423 17:12:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:04.423 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:04.423 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:30:04.423 00:30:04.423 --- 10.0.0.1 ping statistics --- 00:30:04.423 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:04.423 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:30:04.423 17:12:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:04.423 17:12:15 -- nvmf/common.sh@410 -- # return 0 00:30:04.423 17:12:15 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:30:04.423 17:12:15 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:30:05.360 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:30:05.360 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:30:05.360 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:30:05.360 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:30:05.360 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:30:05.360 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:30:05.360 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:30:05.360 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:30:05.360 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:30:05.360 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:30:05.360 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:30:05.360 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:30:05.360 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:30:05.360 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:30:05.619 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:30:05.619 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:30:06.553 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:30:06.553 17:12:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:06.553 17:12:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:06.553 17:12:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:06.553 17:12:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:06.553 17:12:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:06.553 17:12:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:06.553 17:12:17 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:30:06.553 17:12:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:06.553 17:12:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:06.553 17:12:17 -- common/autotest_common.sh@10 -- # set +x 00:30:06.553 17:12:17 -- nvmf/common.sh@469 -- # nvmfpid=350303 00:30:06.553 17:12:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:30:06.553 17:12:17 -- nvmf/common.sh@470 -- # waitforlisten 350303 00:30:06.553 17:12:17 -- common/autotest_common.sh@829 -- # '[' -z 350303 ']' 00:30:06.553 17:12:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:06.553 17:12:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:06.553 17:12:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:06.553 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:06.553 17:12:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:06.553 17:12:17 -- common/autotest_common.sh@10 -- # set +x 00:30:06.553 [2024-11-29 17:12:17.921720] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:06.553 [2024-11-29 17:12:17.921792] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:06.553 EAL: No free 2048 kB hugepages reported on node 1 00:30:06.811 [2024-11-29 17:12:17.984253] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:06.811 [2024-11-29 17:12:18.091118] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:06.811 [2024-11-29 17:12:18.091265] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:06.811 [2024-11-29 17:12:18.091290] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:06.811 [2024-11-29 17:12:18.091307] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:06.811 [2024-11-29 17:12:18.091365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:06.811 [2024-11-29 17:12:18.091392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:06.811 [2024-11-29 17:12:18.091451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:06.811 [2024-11-29 17:12:18.091459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:07.745 17:12:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:07.745 17:12:18 -- common/autotest_common.sh@862 -- # return 0 00:30:07.745 17:12:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:07.745 17:12:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:07.745 17:12:18 -- common/autotest_common.sh@10 -- # set +x 00:30:07.745 17:12:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:07.745 17:12:18 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:30:07.745 17:12:18 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:30:07.745 17:12:18 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:30:07.745 17:12:18 -- scripts/common.sh@311 -- # local bdf bdfs 00:30:07.745 17:12:18 -- scripts/common.sh@312 -- # local nvmes 00:30:07.745 17:12:18 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:30:07.745 17:12:18 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:30:07.745 17:12:18 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:30:07.745 17:12:18 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:30:07.745 17:12:18 -- scripts/common.sh@322 -- # uname -s 00:30:07.745 17:12:18 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:30:07.745 17:12:18 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:30:07.745 17:12:18 -- scripts/common.sh@327 -- # (( 1 )) 00:30:07.745 17:12:18 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:30:07.745 17:12:18 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:30:07.745 17:12:18 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:30:07.745 17:12:18 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:30:07.745 17:12:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:07.745 17:12:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:07.745 17:12:18 -- common/autotest_common.sh@10 -- # set +x 00:30:07.745 ************************************ 00:30:07.745 START TEST spdk_target_abort 00:30:07.745 ************************************ 00:30:07.745 17:12:18 -- common/autotest_common.sh@1114 -- # spdk_target 00:30:07.745 17:12:18 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:30:07.745 17:12:18 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:30:07.745 17:12:18 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:30:07.745 17:12:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:07.745 17:12:18 -- common/autotest_common.sh@10 -- # set +x 00:30:11.026 spdk_targetn1 00:30:11.026 17:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.026 17:12:21 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:11.026 17:12:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.026 17:12:21 -- common/autotest_common.sh@10 -- # set +x 00:30:11.026 [2024-11-29 17:12:21.748171] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:11.026 17:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.026 17:12:21 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:30:11.026 17:12:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.027 17:12:21 -- common/autotest_common.sh@10 -- # set +x 00:30:11.027 17:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:30:11.027 17:12:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.027 17:12:21 -- common/autotest_common.sh@10 -- # set +x 00:30:11.027 17:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:30:11.027 17:12:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.027 17:12:21 -- common/autotest_common.sh@10 -- # set +x 00:30:11.027 [2024-11-29 17:12:21.780482] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:11.027 17:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:11.027 17:12:21 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:11.027 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.304 Initializing NVMe Controllers 00:30:14.304 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:14.304 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:14.304 Initialization complete. Launching workers. 00:30:14.304 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12799, failed: 0 00:30:14.304 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1194, failed to submit 11605 00:30:14.304 success 741, unsuccess 453, failed 0 00:30:14.304 17:12:25 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:14.304 17:12:25 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:14.304 EAL: No free 2048 kB hugepages reported on node 1 00:30:17.581 Initializing NVMe Controllers 00:30:17.581 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:17.581 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:17.581 Initialization complete. Launching workers. 00:30:17.581 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8446, failed: 0 00:30:17.581 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1229, failed to submit 7217 00:30:17.581 success 346, unsuccess 883, failed 0 00:30:17.581 17:12:28 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:17.581 17:12:28 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:17.581 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.858 Initializing NVMe Controllers 00:30:20.858 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:20.858 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:20.858 Initialization complete. Launching workers. 00:30:20.858 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32424, failed: 0 00:30:20.858 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2643, failed to submit 29781 00:30:20.858 success 542, unsuccess 2101, failed 0 00:30:20.858 17:12:31 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:20.858 17:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:20.858 17:12:31 -- common/autotest_common.sh@10 -- # set +x 00:30:20.858 17:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:20.858 17:12:31 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:20.858 17:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:20.858 17:12:31 -- common/autotest_common.sh@10 -- # set +x 00:30:21.791 17:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.791 17:12:32 -- target/abort_qd_sizes.sh@62 -- # killprocess 350303 00:30:21.791 17:12:32 -- common/autotest_common.sh@936 -- # '[' -z 350303 ']' 00:30:21.791 17:12:32 -- common/autotest_common.sh@940 -- # kill -0 350303 00:30:21.791 17:12:32 -- common/autotest_common.sh@941 -- # uname 00:30:21.791 17:12:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:21.791 17:12:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 350303 00:30:21.791 17:12:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:21.791 17:12:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:21.791 17:12:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 350303' 00:30:21.791 killing process with pid 350303 00:30:21.791 17:12:32 -- common/autotest_common.sh@955 -- # kill 350303 00:30:21.791 17:12:32 -- common/autotest_common.sh@960 -- # wait 350303 00:30:21.791 00:30:21.791 real 0m14.293s 00:30:21.791 user 0m56.653s 00:30:21.791 sys 0m2.526s 00:30:21.791 17:12:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:21.791 17:12:33 -- common/autotest_common.sh@10 -- # set +x 00:30:21.791 ************************************ 00:30:21.791 END TEST spdk_target_abort 00:30:21.791 ************************************ 00:30:21.791 17:12:33 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:21.791 17:12:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:21.791 17:12:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:21.791 17:12:33 -- common/autotest_common.sh@10 -- # set +x 00:30:22.049 ************************************ 00:30:22.049 START TEST kernel_target_abort 00:30:22.049 ************************************ 00:30:22.049 17:12:33 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:22.049 17:12:33 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:22.049 17:12:33 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:22.049 17:12:33 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:22.049 17:12:33 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:22.049 17:12:33 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:22.049 17:12:33 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:22.049 17:12:33 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:22.049 17:12:33 -- nvmf/common.sh@627 -- # local block nvme 00:30:22.049 17:12:33 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:22.049 17:12:33 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:22.049 17:12:33 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:22.049 17:12:33 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:22.982 Waiting for block devices as requested 00:30:22.983 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:23.241 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:23.241 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:23.241 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:23.500 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:23.500 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:23.500 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:23.500 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:23.500 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:23.758 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:23.758 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:23.758 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:23.758 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:24.015 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:24.015 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:24.015 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:24.015 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:24.272 17:12:35 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:24.272 17:12:35 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:24.272 17:12:35 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:24.272 17:12:35 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:24.272 17:12:35 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:24.272 No valid GPT data, bailing 00:30:24.272 17:12:35 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:24.272 17:12:35 -- scripts/common.sh@393 -- # pt= 00:30:24.272 17:12:35 -- scripts/common.sh@394 -- # return 1 00:30:24.272 17:12:35 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:24.272 17:12:35 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:24.272 17:12:35 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:24.272 17:12:35 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:24.272 17:12:35 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:24.272 17:12:35 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:24.272 17:12:35 -- nvmf/common.sh@654 -- # echo 1 00:30:24.272 17:12:35 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:24.272 17:12:35 -- nvmf/common.sh@656 -- # echo 1 00:30:24.272 17:12:35 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:24.272 17:12:35 -- nvmf/common.sh@663 -- # echo tcp 00:30:24.272 17:12:35 -- nvmf/common.sh@664 -- # echo 4420 00:30:24.272 17:12:35 -- nvmf/common.sh@665 -- # echo ipv4 00:30:24.272 17:12:35 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:24.272 17:12:35 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:24.272 00:30:24.272 Discovery Log Number of Records 2, Generation counter 2 00:30:24.272 =====Discovery Log Entry 0====== 00:30:24.272 trtype: tcp 00:30:24.272 adrfam: ipv4 00:30:24.272 subtype: current discovery subsystem 00:30:24.272 treq: not specified, sq flow control disable supported 00:30:24.272 portid: 1 00:30:24.272 trsvcid: 4420 00:30:24.272 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:24.272 traddr: 10.0.0.1 00:30:24.272 eflags: none 00:30:24.272 sectype: none 00:30:24.272 =====Discovery Log Entry 1====== 00:30:24.272 trtype: tcp 00:30:24.272 adrfam: ipv4 00:30:24.272 subtype: nvme subsystem 00:30:24.272 treq: not specified, sq flow control disable supported 00:30:24.272 portid: 1 00:30:24.272 trsvcid: 4420 00:30:24.272 subnqn: kernel_target 00:30:24.272 traddr: 10.0.0.1 00:30:24.272 eflags: none 00:30:24.272 sectype: none 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:24.272 17:12:35 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:24.272 EAL: No free 2048 kB hugepages reported on node 1 00:30:27.551 Initializing NVMe Controllers 00:30:27.551 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:27.551 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:27.551 Initialization complete. Launching workers. 00:30:27.551 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 45934, failed: 0 00:30:27.551 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 45934, failed to submit 0 00:30:27.551 success 0, unsuccess 45934, failed 0 00:30:27.551 17:12:38 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:27.551 17:12:38 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:27.551 EAL: No free 2048 kB hugepages reported on node 1 00:30:30.831 Initializing NVMe Controllers 00:30:30.831 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:30.831 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:30.831 Initialization complete. Launching workers. 00:30:30.831 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 83397, failed: 0 00:30:30.831 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 21018, failed to submit 62379 00:30:30.831 success 0, unsuccess 21018, failed 0 00:30:30.831 17:12:41 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:30.831 17:12:41 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:30.831 EAL: No free 2048 kB hugepages reported on node 1 00:30:34.108 Initializing NVMe Controllers 00:30:34.108 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:34.108 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:34.108 Initialization complete. Launching workers. 00:30:34.108 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 80362, failed: 0 00:30:34.108 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20070, failed to submit 60292 00:30:34.108 success 0, unsuccess 20070, failed 0 00:30:34.108 17:12:44 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:34.108 17:12:44 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:34.108 17:12:44 -- nvmf/common.sh@677 -- # echo 0 00:30:34.108 17:12:44 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:34.108 17:12:44 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:34.108 17:12:44 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:34.108 17:12:44 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:34.108 17:12:44 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:34.108 17:12:44 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:34.108 00:30:34.108 real 0m11.791s 00:30:34.108 user 0m5.989s 00:30:34.108 sys 0m2.223s 00:30:34.108 17:12:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:34.108 17:12:45 -- common/autotest_common.sh@10 -- # set +x 00:30:34.108 ************************************ 00:30:34.108 END TEST kernel_target_abort 00:30:34.108 ************************************ 00:30:34.108 17:12:45 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:34.108 17:12:45 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:34.108 17:12:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:34.108 17:12:45 -- nvmf/common.sh@116 -- # sync 00:30:34.108 17:12:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:34.108 17:12:45 -- nvmf/common.sh@119 -- # set +e 00:30:34.108 17:12:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:34.108 17:12:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:34.108 rmmod nvme_tcp 00:30:34.108 rmmod nvme_fabrics 00:30:34.108 rmmod nvme_keyring 00:30:34.108 17:12:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:34.108 17:12:45 -- nvmf/common.sh@123 -- # set -e 00:30:34.108 17:12:45 -- nvmf/common.sh@124 -- # return 0 00:30:34.108 17:12:45 -- nvmf/common.sh@477 -- # '[' -n 350303 ']' 00:30:34.108 17:12:45 -- nvmf/common.sh@478 -- # killprocess 350303 00:30:34.108 17:12:45 -- common/autotest_common.sh@936 -- # '[' -z 350303 ']' 00:30:34.108 17:12:45 -- common/autotest_common.sh@940 -- # kill -0 350303 00:30:34.108 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (350303) - No such process 00:30:34.108 17:12:45 -- common/autotest_common.sh@963 -- # echo 'Process with pid 350303 is not found' 00:30:34.108 Process with pid 350303 is not found 00:30:34.108 17:12:45 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:34.108 17:12:45 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:35.043 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:35.043 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:35.043 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:35.043 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:35.043 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:35.043 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:35.043 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:35.043 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:35.043 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:35.043 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:35.043 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:35.043 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:35.043 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:35.043 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:35.043 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:35.043 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:35.043 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:35.302 17:12:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:35.302 17:12:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:35.302 17:12:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:35.302 17:12:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:35.302 17:12:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:35.302 17:12:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:35.302 17:12:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:37.205 17:12:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:37.205 00:30:37.205 real 0m35.200s 00:30:37.205 user 1m5.017s 00:30:37.205 sys 0m8.071s 00:30:37.205 17:12:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:37.205 17:12:48 -- common/autotest_common.sh@10 -- # set +x 00:30:37.205 ************************************ 00:30:37.205 END TEST nvmf_abort_qd_sizes 00:30:37.205 ************************************ 00:30:37.205 17:12:48 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:37.205 17:12:48 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:37.205 17:12:48 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:37.205 17:12:48 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:37.205 17:12:48 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:37.205 17:12:48 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:37.205 17:12:48 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:37.205 17:12:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:37.205 17:12:48 -- common/autotest_common.sh@10 -- # set +x 00:30:37.205 17:12:48 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:37.205 17:12:48 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:37.205 17:12:48 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:37.206 17:12:48 -- common/autotest_common.sh@10 -- # set +x 00:30:39.107 INFO: APP EXITING 00:30:39.107 INFO: killing all VMs 00:30:39.107 INFO: killing vhost app 00:30:39.107 INFO: EXIT DONE 00:30:40.042 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:40.042 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:40.042 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:40.042 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:40.042 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:40.042 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:40.042 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:40.042 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:40.042 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:40.042 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:40.042 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:40.042 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:40.042 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:40.042 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:40.042 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:40.301 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:40.301 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:41.235 Cleaning 00:30:41.235 Removing: /var/run/dpdk/spdk0/config 00:30:41.235 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:41.235 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:41.235 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:41.235 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:41.235 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:41.235 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:41.235 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:41.235 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:41.235 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:41.235 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:41.235 Removing: /var/run/dpdk/spdk1/config 00:30:41.235 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:41.494 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:41.494 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:41.494 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:41.494 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:41.494 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:41.494 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:41.494 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:41.494 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:41.494 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:41.494 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:41.494 Removing: /var/run/dpdk/spdk2/config 00:30:41.494 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:41.494 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:41.494 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:41.494 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:41.494 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:41.494 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:41.494 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:41.494 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:41.494 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:41.494 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:41.494 Removing: /var/run/dpdk/spdk3/config 00:30:41.494 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:41.494 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:41.494 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:41.494 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:41.494 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:41.494 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:41.494 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:41.494 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:41.494 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:41.494 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:41.494 Removing: /var/run/dpdk/spdk4/config 00:30:41.494 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:41.494 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:41.494 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:41.494 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:41.494 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:41.494 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:41.494 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:41.494 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:41.494 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:41.494 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:41.494 Removing: /dev/shm/bdev_svc_trace.1 00:30:41.494 Removing: /dev/shm/nvmf_trace.0 00:30:41.494 Removing: /dev/shm/spdk_tgt_trace.pid80069 00:30:41.494 Removing: /var/run/dpdk/spdk0 00:30:41.494 Removing: /var/run/dpdk/spdk1 00:30:41.494 Removing: /var/run/dpdk/spdk2 00:30:41.494 Removing: /var/run/dpdk/spdk3 00:30:41.494 Removing: /var/run/dpdk/spdk4 00:30:41.494 Removing: /var/run/dpdk/spdk_pid102161 00:30:41.494 Removing: /var/run/dpdk/spdk_pid159663 00:30:41.494 Removing: /var/run/dpdk/spdk_pid162330 00:30:41.494 Removing: /var/run/dpdk/spdk_pid169600 00:30:41.494 Removing: /var/run/dpdk/spdk_pid173053 00:30:41.494 Removing: /var/run/dpdk/spdk_pid175435 00:30:41.494 Removing: /var/run/dpdk/spdk_pid175850 00:30:41.494 Removing: /var/run/dpdk/spdk_pid180946 00:30:41.494 Removing: /var/run/dpdk/spdk_pid181230 00:30:41.494 Removing: /var/run/dpdk/spdk_pid183913 00:30:41.494 Removing: /var/run/dpdk/spdk_pid188430 00:30:41.494 Removing: /var/run/dpdk/spdk_pid190672 00:30:41.494 Removing: /var/run/dpdk/spdk_pid197486 00:30:41.494 Removing: /var/run/dpdk/spdk_pid203053 00:30:41.494 Removing: /var/run/dpdk/spdk_pid204292 00:30:41.494 Removing: /var/run/dpdk/spdk_pid205055 00:30:41.494 Removing: /var/run/dpdk/spdk_pid215616 00:30:41.494 Removing: /var/run/dpdk/spdk_pid217949 00:30:41.494 Removing: /var/run/dpdk/spdk_pid220825 00:30:41.494 Removing: /var/run/dpdk/spdk_pid222039 00:30:41.494 Removing: /var/run/dpdk/spdk_pid223536 00:30:41.494 Removing: /var/run/dpdk/spdk_pid224275 00:30:41.494 Removing: /var/run/dpdk/spdk_pid224456 00:30:41.494 Removing: /var/run/dpdk/spdk_pid224616 00:30:41.494 Removing: /var/run/dpdk/spdk_pid225206 00:30:41.494 Removing: /var/run/dpdk/spdk_pid226694 00:30:41.494 Removing: /var/run/dpdk/spdk_pid227636 00:30:41.494 Removing: /var/run/dpdk/spdk_pid228164 00:30:41.494 Removing: /var/run/dpdk/spdk_pid231788 00:30:41.494 Removing: /var/run/dpdk/spdk_pid235247 00:30:41.494 Removing: /var/run/dpdk/spdk_pid238890 00:30:41.494 Removing: /var/run/dpdk/spdk_pid263750 00:30:41.494 Removing: /var/run/dpdk/spdk_pid266715 00:30:41.494 Removing: /var/run/dpdk/spdk_pid270704 00:30:41.494 Removing: /var/run/dpdk/spdk_pid271673 00:30:41.494 Removing: /var/run/dpdk/spdk_pid272782 00:30:41.494 Removing: /var/run/dpdk/spdk_pid275375 00:30:41.494 Removing: /var/run/dpdk/spdk_pid277905 00:30:41.494 Removing: /var/run/dpdk/spdk_pid282305 00:30:41.494 Removing: /var/run/dpdk/spdk_pid282324 00:30:41.494 Removing: /var/run/dpdk/spdk_pid285260 00:30:41.494 Removing: /var/run/dpdk/spdk_pid285527 00:30:41.494 Removing: /var/run/dpdk/spdk_pid285667 00:30:41.494 Removing: /var/run/dpdk/spdk_pid286054 00:30:41.494 Removing: /var/run/dpdk/spdk_pid286059 00:30:41.494 Removing: /var/run/dpdk/spdk_pid287674 00:30:41.494 Removing: /var/run/dpdk/spdk_pid288891 00:30:41.494 Removing: /var/run/dpdk/spdk_pid290106 00:30:41.494 Removing: /var/run/dpdk/spdk_pid291323 00:30:41.494 Removing: /var/run/dpdk/spdk_pid292663 00:30:41.494 Removing: /var/run/dpdk/spdk_pid293880 00:30:41.494 Removing: /var/run/dpdk/spdk_pid297778 00:30:41.494 Removing: /var/run/dpdk/spdk_pid298237 00:30:41.494 Removing: /var/run/dpdk/spdk_pid299559 00:30:41.494 Removing: /var/run/dpdk/spdk_pid300314 00:30:41.494 Removing: /var/run/dpdk/spdk_pid304248 00:30:41.494 Removing: /var/run/dpdk/spdk_pid306294 00:30:41.494 Removing: /var/run/dpdk/spdk_pid309912 00:30:41.494 Removing: /var/run/dpdk/spdk_pid313640 00:30:41.494 Removing: /var/run/dpdk/spdk_pid317863 00:30:41.494 Removing: /var/run/dpdk/spdk_pid318396 00:30:41.494 Removing: /var/run/dpdk/spdk_pid318823 00:30:41.494 Removing: /var/run/dpdk/spdk_pid319239 00:30:41.494 Removing: /var/run/dpdk/spdk_pid319829 00:30:41.494 Removing: /var/run/dpdk/spdk_pid320385 00:30:41.494 Removing: /var/run/dpdk/spdk_pid320936 00:30:41.494 Removing: /var/run/dpdk/spdk_pid321491 00:30:41.494 Removing: /var/run/dpdk/spdk_pid324168 00:30:41.494 Removing: /var/run/dpdk/spdk_pid324436 00:30:41.494 Removing: /var/run/dpdk/spdk_pid328296 00:30:41.494 Removing: /var/run/dpdk/spdk_pid328476 00:30:41.494 Removing: /var/run/dpdk/spdk_pid330257 00:30:41.494 Removing: /var/run/dpdk/spdk_pid335421 00:30:41.495 Removing: /var/run/dpdk/spdk_pid335427 00:30:41.495 Removing: /var/run/dpdk/spdk_pid338371 00:30:41.495 Removing: /var/run/dpdk/spdk_pid339830 00:30:41.753 Removing: /var/run/dpdk/spdk_pid341365 00:30:41.753 Removing: /var/run/dpdk/spdk_pid342133 00:30:41.753 Removing: /var/run/dpdk/spdk_pid343703 00:30:41.753 Removing: /var/run/dpdk/spdk_pid344549 00:30:41.753 Removing: /var/run/dpdk/spdk_pid350743 00:30:41.753 Removing: /var/run/dpdk/spdk_pid351143 00:30:41.753 Removing: /var/run/dpdk/spdk_pid351547 00:30:41.753 Removing: /var/run/dpdk/spdk_pid353026 00:30:41.753 Removing: /var/run/dpdk/spdk_pid353437 00:30:41.753 Removing: /var/run/dpdk/spdk_pid353846 00:30:41.753 Removing: /var/run/dpdk/spdk_pid78348 00:30:41.753 Removing: /var/run/dpdk/spdk_pid79235 00:30:41.753 Removing: /var/run/dpdk/spdk_pid80069 00:30:41.753 Removing: /var/run/dpdk/spdk_pid80566 00:30:41.753 Removing: /var/run/dpdk/spdk_pid81910 00:30:41.753 Removing: /var/run/dpdk/spdk_pid82852 00:30:41.753 Removing: /var/run/dpdk/spdk_pid83060 00:30:41.753 Removing: /var/run/dpdk/spdk_pid83386 00:30:41.753 Removing: /var/run/dpdk/spdk_pid83729 00:30:41.753 Removing: /var/run/dpdk/spdk_pid83944 00:30:41.753 Removing: /var/run/dpdk/spdk_pid84102 00:30:41.753 Removing: /var/run/dpdk/spdk_pid84375 00:30:41.753 Removing: /var/run/dpdk/spdk_pid84575 00:30:41.753 Removing: /var/run/dpdk/spdk_pid85032 00:30:41.753 Removing: /var/run/dpdk/spdk_pid87589 00:30:41.753 Removing: /var/run/dpdk/spdk_pid87889 00:30:41.753 Removing: /var/run/dpdk/spdk_pid88089 00:30:41.753 Removing: /var/run/dpdk/spdk_pid88201 00:30:41.753 Removing: /var/run/dpdk/spdk_pid88642 00:30:41.753 Removing: /var/run/dpdk/spdk_pid88782 00:30:41.753 Removing: /var/run/dpdk/spdk_pid89219 00:30:41.753 Removing: /var/run/dpdk/spdk_pid89258 00:30:41.753 Removing: /var/run/dpdk/spdk_pid89529 00:30:41.753 Removing: /var/run/dpdk/spdk_pid89673 00:30:41.753 Removing: /var/run/dpdk/spdk_pid89843 00:30:41.753 Removing: /var/run/dpdk/spdk_pid89985 00:30:41.753 Removing: /var/run/dpdk/spdk_pid90375 00:30:41.753 Removing: /var/run/dpdk/spdk_pid90537 00:30:41.753 Removing: /var/run/dpdk/spdk_pid90865 00:30:41.753 Removing: /var/run/dpdk/spdk_pid91044 00:30:41.753 Removing: /var/run/dpdk/spdk_pid91186 00:30:41.753 Removing: /var/run/dpdk/spdk_pid91251 00:30:41.753 Removing: /var/run/dpdk/spdk_pid91391 00:30:41.753 Removing: /var/run/dpdk/spdk_pid91675 00:30:41.753 Removing: /var/run/dpdk/spdk_pid91819 00:30:41.753 Removing: /var/run/dpdk/spdk_pid92017 00:30:41.753 Removing: /var/run/dpdk/spdk_pid92355 00:30:41.753 Removing: /var/run/dpdk/spdk_pid92517 00:30:41.753 Removing: /var/run/dpdk/spdk_pid92660 00:30:41.753 Removing: /var/run/dpdk/spdk_pid92849 00:30:41.753 Removing: /var/run/dpdk/spdk_pid93331 00:30:41.753 Removing: /var/run/dpdk/spdk_pid93744 00:30:41.753 Removing: /var/run/dpdk/spdk_pid93893 00:30:41.753 Removing: /var/run/dpdk/spdk_pid94170 00:30:41.753 Removing: /var/run/dpdk/spdk_pid94316 00:30:41.753 Removing: /var/run/dpdk/spdk_pid94474 00:30:41.753 Removing: /var/run/dpdk/spdk_pid94739 00:30:41.753 Removing: /var/run/dpdk/spdk_pid94897 00:30:41.753 Removing: /var/run/dpdk/spdk_pid95043 00:30:41.753 Removing: /var/run/dpdk/spdk_pid95220 00:30:41.753 Removing: /var/run/dpdk/spdk_pid95466 00:30:41.753 Removing: /var/run/dpdk/spdk_pid95625 00:30:41.753 Removing: /var/run/dpdk/spdk_pid95769 00:30:41.753 Removing: /var/run/dpdk/spdk_pid96052 00:30:41.753 Removing: /var/run/dpdk/spdk_pid96193 00:30:41.753 Removing: /var/run/dpdk/spdk_pid96354 00:30:41.753 Removing: /var/run/dpdk/spdk_pid96611 00:30:41.753 Removing: /var/run/dpdk/spdk_pid96782 00:30:41.753 Removing: /var/run/dpdk/spdk_pid96920 00:30:41.753 Removing: /var/run/dpdk/spdk_pid97100 00:30:41.753 Removing: /var/run/dpdk/spdk_pid97347 00:30:41.753 Removing: /var/run/dpdk/spdk_pid97506 00:30:41.753 Removing: /var/run/dpdk/spdk_pid97650 00:30:41.753 Removing: /var/run/dpdk/spdk_pid97927 00:30:41.753 Removing: /var/run/dpdk/spdk_pid98078 00:30:41.753 Removing: /var/run/dpdk/spdk_pid98237 00:30:41.753 Removing: /var/run/dpdk/spdk_pid98508 00:30:41.753 Removing: /var/run/dpdk/spdk_pid98666 00:30:41.753 Removing: /var/run/dpdk/spdk_pid98815 00:30:41.753 Removing: /var/run/dpdk/spdk_pid99094 00:30:41.753 Removing: /var/run/dpdk/spdk_pid99238 00:30:41.753 Removing: /var/run/dpdk/spdk_pid99398 00:30:41.754 Removing: /var/run/dpdk/spdk_pid99596 00:30:41.754 Removing: /var/run/dpdk/spdk_pid99809 00:30:41.754 Clean 00:30:41.754 killing process with pid 49675 00:30:49.868 killing process with pid 49672 00:30:49.868 killing process with pid 49674 00:30:49.868 killing process with pid 49673 00:30:49.868 17:13:01 -- common/autotest_common.sh@1446 -- # return 0 00:30:49.868 17:13:01 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:49.868 17:13:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:49.868 17:13:01 -- common/autotest_common.sh@10 -- # set +x 00:30:49.868 17:13:01 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:49.868 17:13:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:49.868 17:13:01 -- common/autotest_common.sh@10 -- # set +x 00:30:49.868 17:13:01 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:49.868 17:13:01 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:49.868 17:13:01 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:49.868 17:13:01 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:49.868 17:13:01 -- spdk/autotest.sh@383 -- # hostname 00:30:49.868 17:13:01 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:50.125 geninfo: WARNING: invalid characters removed from testname! 00:31:16.716 17:13:27 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:20.006 17:13:31 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:22.539 17:13:33 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:25.824 17:13:36 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:27.731 17:13:39 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:31.023 17:13:41 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:32.931 17:13:44 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:33.191 17:13:44 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:33.191 17:13:44 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:33.191 17:13:44 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:33.191 17:13:44 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:33.191 17:13:44 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:33.191 17:13:44 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:33.191 17:13:44 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:33.191 17:13:44 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:33.191 17:13:44 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:33.191 17:13:44 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:33.191 17:13:44 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:33.191 17:13:44 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:33.191 17:13:44 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:33.191 17:13:44 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:33.191 17:13:44 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:33.191 17:13:44 -- scripts/common.sh@343 -- $ case "$op" in 00:31:33.191 17:13:44 -- scripts/common.sh@344 -- $ : 1 00:31:33.191 17:13:44 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:33.191 17:13:44 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:33.191 17:13:44 -- scripts/common.sh@364 -- $ decimal 1 00:31:33.191 17:13:44 -- scripts/common.sh@352 -- $ local d=1 00:31:33.191 17:13:44 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:33.191 17:13:44 -- scripts/common.sh@354 -- $ echo 1 00:31:33.191 17:13:44 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:33.191 17:13:44 -- scripts/common.sh@365 -- $ decimal 2 00:31:33.191 17:13:44 -- scripts/common.sh@352 -- $ local d=2 00:31:33.191 17:13:44 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:33.191 17:13:44 -- scripts/common.sh@354 -- $ echo 2 00:31:33.191 17:13:44 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:33.191 17:13:44 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:33.191 17:13:44 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:33.191 17:13:44 -- scripts/common.sh@367 -- $ return 0 00:31:33.191 17:13:44 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:33.191 17:13:44 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:33.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:33.191 --rc genhtml_branch_coverage=1 00:31:33.191 --rc genhtml_function_coverage=1 00:31:33.191 --rc genhtml_legend=1 00:31:33.191 --rc geninfo_all_blocks=1 00:31:33.191 --rc geninfo_unexecuted_blocks=1 00:31:33.191 00:31:33.191 ' 00:31:33.191 17:13:44 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:33.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:33.191 --rc genhtml_branch_coverage=1 00:31:33.191 --rc genhtml_function_coverage=1 00:31:33.191 --rc genhtml_legend=1 00:31:33.191 --rc geninfo_all_blocks=1 00:31:33.191 --rc geninfo_unexecuted_blocks=1 00:31:33.191 00:31:33.191 ' 00:31:33.191 17:13:44 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:33.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:33.191 --rc genhtml_branch_coverage=1 00:31:33.191 --rc genhtml_function_coverage=1 00:31:33.191 --rc genhtml_legend=1 00:31:33.191 --rc geninfo_all_blocks=1 00:31:33.191 --rc geninfo_unexecuted_blocks=1 00:31:33.191 00:31:33.191 ' 00:31:33.191 17:13:44 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:33.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:33.191 --rc genhtml_branch_coverage=1 00:31:33.191 --rc genhtml_function_coverage=1 00:31:33.191 --rc genhtml_legend=1 00:31:33.191 --rc geninfo_all_blocks=1 00:31:33.191 --rc geninfo_unexecuted_blocks=1 00:31:33.191 00:31:33.191 ' 00:31:33.191 17:13:44 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:33.191 17:13:44 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:33.191 17:13:44 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:33.191 17:13:44 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:33.191 17:13:44 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:33.191 17:13:44 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:33.191 17:13:44 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:33.191 17:13:44 -- paths/export.sh@5 -- $ export PATH 00:31:33.191 17:13:44 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:33.191 17:13:44 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:33.191 17:13:44 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:33.191 17:13:44 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732896824.XXXXXX 00:31:33.191 17:13:44 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732896824.luhMdP 00:31:33.191 17:13:44 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:33.191 17:13:44 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:33.191 17:13:44 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:33.191 17:13:44 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:33.191 17:13:44 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:33.191 17:13:44 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:33.191 17:13:44 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:33.191 17:13:44 -- common/autotest_common.sh@10 -- $ set +x 00:31:33.191 17:13:44 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:33.191 17:13:44 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:33.192 17:13:44 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:33.192 17:13:44 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:33.192 17:13:44 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:33.192 17:13:44 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:33.192 17:13:44 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:33.192 17:13:44 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:33.192 17:13:44 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:33.192 17:13:44 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:33.192 17:13:44 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:33.192 + [[ -n 7313 ]] 00:31:33.192 + sudo kill 7313 00:31:33.202 [Pipeline] } 00:31:33.217 [Pipeline] // stage 00:31:33.222 [Pipeline] } 00:31:33.236 [Pipeline] // timeout 00:31:33.241 [Pipeline] } 00:31:33.255 [Pipeline] // catchError 00:31:33.260 [Pipeline] } 00:31:33.275 [Pipeline] // wrap 00:31:33.281 [Pipeline] } 00:31:33.293 [Pipeline] // catchError 00:31:33.303 [Pipeline] stage 00:31:33.305 [Pipeline] { (Epilogue) 00:31:33.317 [Pipeline] catchError 00:31:33.319 [Pipeline] { 00:31:33.332 [Pipeline] echo 00:31:33.334 Cleanup processes 00:31:33.340 [Pipeline] sh 00:31:33.625 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:33.625 365840 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:33.639 [Pipeline] sh 00:31:33.922 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:33.923 ++ grep -v 'sudo pgrep' 00:31:33.923 ++ awk '{print $1}' 00:31:33.923 + sudo kill -9 00:31:33.923 + true 00:31:33.932 [Pipeline] sh 00:31:34.211 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:44.187 [Pipeline] sh 00:31:44.465 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:44.465 Artifacts sizes are good 00:31:44.479 [Pipeline] archiveArtifacts 00:31:44.486 Archiving artifacts 00:31:45.072 [Pipeline] sh 00:31:45.353 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:45.366 [Pipeline] cleanWs 00:31:45.376 [WS-CLEANUP] Deleting project workspace... 00:31:45.376 [WS-CLEANUP] Deferred wipeout is used... 00:31:45.382 [WS-CLEANUP] done 00:31:45.384 [Pipeline] } 00:31:45.400 [Pipeline] // catchError 00:31:45.412 [Pipeline] sh 00:31:45.692 + logger -p user.info -t JENKINS-CI 00:31:45.700 [Pipeline] } 00:31:45.716 [Pipeline] // stage 00:31:45.723 [Pipeline] } 00:31:45.739 [Pipeline] // node 00:31:45.745 [Pipeline] End of Pipeline 00:31:45.798 Finished: SUCCESS